00000100:00100000:1.0:1784093507.192384:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:31301:x1870757013588736:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093507.222382:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013588992 00000100:00100000:1.0:1784093507.222391:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013588992 00000100:00100000:1.0:1784093507.222575:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 114 00000100:00100000:1.0:1784093507.222585:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:31301:x1870757013588992:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093507.222866:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:31301:x1870757013588992:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 282us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093507.222884:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 114 00010000:00010000:1.0:1784093507.263619:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.263633:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.263640:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.263645:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093507.263649:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.263656:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.263666:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x93c5647 (ffff90721a781a00) 00010000:00010000:1.0:1784093507.263669:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093507.263673:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.263685:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c8dbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093507.267348:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013589632 00000100:00100000:1.0:1784093507.267359:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013589632 00000100:00100000:1.0:1784093507.267451:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 115 00000100:00100000:1.0:1784093507.267463:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:31305:x1870757013589632:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093507.267482:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093507.267507:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5340 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093507.267532:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784093507.267552:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1784093507.267557:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093507.267567:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 7 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.267585:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 7 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.267598:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784093507.267656:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:31305:x1870757013589632:12345-192.168.204.57@tcp:101:dd.0 Request processed in 196us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093507.267664:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 115 00000100:00100000:1.0:1784093507.278357:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013589760 00000100:00100000:1.0:1784093507.278368:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013589760 00002000:00100000:1.0:1784093507.278417:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (0->1048575) req@ffff90723e26d880 x1870757013589760/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:583/0 lens 488/0 e 0 to 0 dl 1784093518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093507.278470:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723e26d880 with x1870757013589760 ext(0->1048575) 00002000:00010000:1.0:1784093507.278476:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723e26d880 00000100:00100000:1.0:1784093507.278508:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 4 00000100:00100000:1.0:1784093507.278518:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013589760:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784093507.316310:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013589760:12345-192.168.204.57@tcp:4:dd.0 Request processed in 37787us (38027us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784093507.316528:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 4 00002000:00100000:1.0:1784093507.316542:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x9:0x0] (0->1048575) req@ffff90723e26d880 x1870757013589760/t4294967313(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:583/0 lens 488/448 e 0 to 0 dl 1784093518 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093507.316554:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723e26d880 with x1870757013589760 ext(0->1048575) 00002000:00010000:1.0:1784093507.316561:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723e26d880 00000100:00100000:1.0:1784093507.336661:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013590016 00000100:00100000:1.0:1784093507.336680:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013590016 00000100:00100000:1.0:1784093507.336784:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 116 00000100:00100000:1.0:1784093507.336808:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013590016:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:1.0:1784093507.336971:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013590016:12345-192.168.204.57@tcp:16:dd.0 Request processed in 167us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093507.336980:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 116 00000100:00100000:1.0:1784093507.340196:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013590272 00000100:00100000:1.0:1784093507.340213:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013590272 00000100:00100000:1.0:1784093507.340296:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 29 00000100:00100000:1.0:1784093507.340307:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:31305:x1870757013590272:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:1.0:1784093507.341474:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:31305:x1870757013590272:12345-192.168.204.57@tcp:35:dd.0 Request processed in 1166us (1423us total) trans 4294967405 rc 0/0 00000100:00100000:1.0:1784093507.341502:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 29 00000100:00100000:1.0:1784093507.369925:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024159232 00000100:00100000:1.0:1784093507.369934:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024159232 00000100:00100000:1.0:1784093507.369997:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1784093507.370007:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024159232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093507.370022:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093507.370036:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c8ddb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.370058:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c8ddb expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.370069:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c8ddb expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093507.370078:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093507.370129:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024159232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093507.370136:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1784093507.561679:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093507.561705:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024159360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093507.561809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784093508.402284:0:51335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 669479859477ns, next at 661924028893ns, rc = 0 00000004:00080000:1.0:1784093508.402391:0:51335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 669479968516ns, next at 618524517994ns, rc = 0 00000100:00100000:1.0:1784093508.975682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093508.977955:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013590784 00000100:00100000:1.0:1784093508.977963:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013590784 00000100:00100000:1.0:1784093508.978021:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 253 00000100:00100000:1.0:1784093508.978034:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:31498:x1870757013590784:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093508.978741:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:31498:x1870757013590784:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 702us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093508.978750:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 253 00000100:00100000:1.0:1784093508.984027:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013591040 00000100:00100000:1.0:1784093508.984037:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013591040 00000100:00100000:1.0:1784093508.984099:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 119 00000100:00100000:1.0:1784093508.984110:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:31498:x1870757013591040:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093508.984599:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:31498:x1870757013591040:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 489us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093508.984612:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 119 00000100:00100000:1.0:1784093508.985923:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013591168 00000100:00100000:1.0:1784093508.985930:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013591168 00000100:00100000:1.0:1784093508.986026:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 120 00000100:00100000:1.0:1784093508.986038:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:31498:x1870757013591168:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093508.986416:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:31498:x1870757013591168:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 380us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093508.986445:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 120 00000100:00100000:1.0:1784093509.017674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:1.0:1784093509.019561:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093509.019568:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c8dfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.019575:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093509.019579:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c8dfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.019592:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c8dfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.019600:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff90721a781700) 00010000:00010000:1.0:1784093509.019602:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093509.019605:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c8dfe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.019609:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c8dfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.019620:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093509.019621:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093509.019622:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093509.929114:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024159488 00000100:00100000:1.0:1784093509.929123:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024159488 00000100:00100000:1.0:1784093509.929177:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784093509.929185:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024159488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784093509.929210:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:9 count 1 00010000:00010000:1.0:1784093509.929233:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.929254:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.929264:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x9:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1784093509.929268:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093509.929273:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.929380:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.929394:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 5 pid: 6573 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093509.929406:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024159616:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784093509.929775:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1784093509.932353:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024159616:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784093509.932379:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093509.932620:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013591680 00000100:00100000:1.0:1784093509.932626:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013591680 00010000:00010000:1.0:1784093509.932668:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 6 pid: 6573 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093509.932710:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 183 00000100:00100000:1.0:1784093509.932731:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013591680:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093509.932748:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093509.932757:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 6 pid: 6573 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.932784:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 6 pid: 6573 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.932828:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d431d04f/0x9ce98053214c8dd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5340 expref: 6 pid: 6573 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.932859:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093509.932864:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093509.932870:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.932880:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.932905:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093509.932955:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013591680:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 235us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093509.932969:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 183 00010000:00010000:1.0:1784093509.933042:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093509.933049:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.933058:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093509.933062:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.933073:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.933098:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.933106:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001adec2e4/0x9ce98053214c8e05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093509.933125:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093509.933128:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093509.933130:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093510.010132:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093510.010167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093510.010198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093510.010223:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013591936 00000100:00100000:1.0:1784093510.010226:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013591936 00000100:00100000:1.0:1784093510.010260:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 408 00000100:00100000:1.0:1784093510.010271:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013591936:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093510.010315:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013591936:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093510.010325:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 408 00000100:00100000:1.0:1784093510.633751:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024159872:0@lo:400:kworker.0 00000100:00100000:1.0:1784093510.633823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093510.633893:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024160384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093510.633920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093510.633957:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024159744 00000100:00100000:1.0:1784093510.633961:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024159744 00000100:00100000:1.0:1784093510.634014:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1784093510.634040:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093510.634096:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024159744:12345-0@lo:400:kworker.0 Request processed in 62us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093510.634113:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1784093510.634190:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024159744:0@lo:400:kworker.0 00000100:00100000:1.0:1784093510.634249:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024159872:0@lo:400:kworker.0 00000100:00100000:1.0:1784093510.634456:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024160384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784093511.145644:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093512.681681:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093512.681705:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024160512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093512.681783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093512.682065:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024160512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093513.194566:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093514.217662:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093515.128722:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013592192 00000100:00100000:1.0:1784093515.128730:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013592192 00000100:00100000:1.0:1784093515.128779:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00100000:1.0:1784093515.128795:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013592192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093515.128860:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013592192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093515.128874:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 513 00010000:00010000:1.0:1784093515.241565:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784093515.753799:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093515.754526:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024160768:0@lo:400:kworker.0 00000100:00100000:1.0:1784093515.754584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093515.754640:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024161280:0@lo:400:kworker.0 00000100:00100000:1.0:1784093515.754680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093515.754712:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093515.754722:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024161152:0@lo:400:kworker.0 00000100:00100000:1.0:1784093515.754757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093515.754798:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024160768 00000100:00100000:1.0:1784093515.754804:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024160768 00000100:00100000:1.0:1784093515.754842:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1784093515.754857:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024160768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093515.754917:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024160768:12345-0@lo:400:kworker.0 Request processed in 64us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093515.754933:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:1.0:1784093515.754979:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093515.754985:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093515.755074:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024161152:0@lo:400:kworker.0 00010000:00010000:1.0:1784093517.289793:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784093517.802125:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784093518.313598:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093519.337665:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093520.249985:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013593088 00000100:00100000:1.0:1784093520.249996:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013593088 00000100:00100000:1.0:1784093520.250056:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013592960 00000100:00100000:1.0:1784093520.250060:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013592960 00000100:00100000:1.0:1784093520.250095:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 238 00000100:00100000:1.0:1784093520.250106:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013592960:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093520.250199:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013592960:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093520.250228:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 238 00000100:00100000:1.0:1784093520.874678:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024161536 00000100:00100000:1.0:1784093520.874684:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024161536 00000100:00100000:1.0:1784093520.874713:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1784093520.875084:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024161536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093520.875131:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024161536:12345-0@lo:400:kworker.0 Request processed in 411us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093520.875138:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00010000:1.0:1784093521.385672:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093522.410180:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093523.433620:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093524.457577:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093525.368684:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013593600 00000100:00100000:1.0:1784093525.368688:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013593600 00000100:00100000:1.0:1784093525.368715:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013593472 00000100:00100000:1.0:1784093525.368718:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013593472 00000100:00100000:1.0:1784093525.368748:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 240 00000100:00100000:1.0:1784093525.368754:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013593600:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093525.369131:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013593600:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 375us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093525.369138:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 240 00010000:00010000:1.0:1784093525.481766:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093525.994004:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024162432 00000100:00100000:1.0:1784093525.994012:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024162432 00000100:00100000:1.0:1784093525.994148:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784093525.994157:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024162432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093525.994191:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093525.994274:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024162432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093525.994281:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784093525.994462:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024162688:0@lo:400:kworker.0 00000100:00100000:1.0:1784093525.994496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093525.994547:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024162688 00000100:00100000:1.0:1784093525.994553:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024162688 00000100:00080000:1.0:1784093525.996814:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093525.996822:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093525.996858:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024162688:0@lo:400:kworker.0 00000100:00100000:2.0:1784093526.112916:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 123 00000100:00100000:2.0:1784093526.114451:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013594112 00000100:00100000:2.0:1784093526.114462:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013594112 00000100:00100000:2.0:1784093526.114603:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 258 00000100:00100000:2.0:1784093526.114615:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:31799:x1870757013594112:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093526.115111:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:31799:x1870757013594112:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 494us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093526.115120:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 258 00000100:00100000:1.0:1784093526.119079:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013594368 00000100:00100000:1.0:1784093526.119087:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013594368 00000100:00100000:1.0:1784093526.119142:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 124 00000100:00100000:1.0:1784093526.119152:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:31799:x1870757013594368:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093526.119558:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:31799:x1870757013594368:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 406us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093526.119565:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 124 00000100:00100000:2.0:1784093526.122143:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013594624 00000100:00100000:2.0:1784093526.122148:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013594624 00000100:00100000:2.0:1784093526.122180:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 260 00000100:00100000:2.0:1784093526.122186:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:31799:x1870757013594624:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093526.122559:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:31799:x1870757013594624:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 372us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093526.122567:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 260 00000100:00100000:2.0:1784093527.087599:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024163200 00000100:00100000:2.0:1784093527.087608:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024163200 00000100:00100000:2.0:1784093527.087657:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784093527.087667:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:51842:x1870757024163200:12345-0@lo:104: 00010000:00010000:2.0:1784093527.087679:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c8ddb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c8de2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.087758:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093527.087765:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:51842:x1870757024163200:12345-0@lo:104: Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093527.087772:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784093527.087930:0:51842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:51842:1870757024163200:0@lo:104: 00010000:00010000:1.0:1784093527.087952:0:51842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093527.088116:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024163328 00000100:00100000:2.0:1784093527.088119:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024163328 00010000:00010000:2.0:1784093527.088137:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c8ddb expref: 19 pid: 5772 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093527.088164:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784093527.088170:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024163328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093527.088180:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093527.088185:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c8ddb expref: 19 pid: 5772 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088195:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c8ddb expref: 19 pid: 5772 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088208:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12200/0x9ce98053214c8de2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c8ddb expref: 19 pid: 5772 timeout: 838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088219:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088227:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088240:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088246:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088252:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088258:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088269:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093527.088274:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088282:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088299:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093527.088307:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093527.088334:0:51842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093527.088345:0:51842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093527.088362:0:51842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214c8e0c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093527.088455:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024163328:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093527.088463:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784093528.043232:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093528.043307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784093528.043397:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093528.043450:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784093528.043463:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024163456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093528.043504:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093528.043559:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024163456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093528.043570:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1784093528.254444:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093528.256607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000001:00080000:1.0:1784093528.270989:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967407 is committed 00010000:00010000:2.0:1784093528.271363:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.271396:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.271405:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.271412:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093528.271417:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.271445:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.271472:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:2.0:1784093528.271475:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093528.271480:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.271487:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c8e21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093528.361510:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093528.361517:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093528.361524:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093528.361571:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.361584:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.361595:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093528.361617:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024163584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093528.361684:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093528.361752:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907206b0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784093528.362184:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024163584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093528.362203:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8e2f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.362213:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c8e2f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093528.362248:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093528.362252:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8e2f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.362258:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8e2f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093528.554541:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093528.593971:0:52040:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0cb45590 20000000:00000080:2.0:1784093528.593987:0:52040:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3bf000 uarg=0000000000000000 00010000:00010000:2.0:1784093528.594455:0:52040:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093528.594471:0:52040:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093528.594484:0:52040:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093528.594503:0:52040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214c8e36 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 52040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.594519:0:52040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214c8e2f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c8e28 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.594527:0:52040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41600/0x9ce98053214c8e36 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 52040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.594565:0:52040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68000/0x9ce98053214c8e2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c8e28 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.594580:0:52040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68000/0x9ce98053214c8e2f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c8e28 expref: 18 pid: 5772 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093528.594596:0:52040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:52040:1870757024163712:0@lo:104: 00000100:00100000:2.0:1784093528.594654:0:52040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093528.594701:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024163712 00000100:00100000:1.0:1784093528.594708:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024163712 00000100:00100000:2.0:1784093528.594711:0:52040:0:(client.c:2702:ptlrpc_set_wait()) set ffff907206b0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784093528.594766:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784093528.594778:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:52040:x1870757024163712:12345-0@lo:104: 00010000:00010000:2.0:1784093528.594791:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214c8e28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c8e2f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093528.594856:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093528.594863:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:52040:x1870757024163712:12345-0@lo:104: Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093528.594871:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784093528.595498:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024163840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093529.577583:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784093529.705501:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093529.705508:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093529.705512:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093529.705555:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.705565:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.705573:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093529.705595:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024163968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093529.705655:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093529.705705:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f54480 going to sleep for 11 seconds 00000100:00100000:2.0:1784093529.706097:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024163968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093529.706118:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.706145:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093529.706165:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093529.706170:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.706178:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093529.718906:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093529.725950:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013595648 00000100:00100000:2.0:1784093529.725960:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013595648 00000100:00100000:2.0:1784093529.726078:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 265 00000100:00100000:2.0:1784093529.726090:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:31962:x1870757013595648:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:2.0:1784093529.726138:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093529.726154:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8e7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5355 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.726165:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff907202e6b300) 00010000:00010000:2.0:1784093529.726172:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093529.726208:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.726219:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.726228:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093529.726377:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bc970376 reply state 00000000bdad7607 transno 4294967409 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093529.726386:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093529.726482:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:31962:x1870757013595648:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 394us (598us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784093529.726489:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 265 00010000:00010000:2.0:1784093529.728143:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.728155:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.728163:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.728169:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093529.728173:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.728180:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.728191:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093529.728194:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093529.728198:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093529.728204:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c8e8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784093529.730294:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093529.733512:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093529.733767:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013596160 00000100:00100000:1.0:1784093529.733777:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013596160 00000100:00100000:1.0:1784093529.733828:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 30 00000100:00100000:1.0:1784093529.733840:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:31962:x1870757013596160:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:1.0:1784093529.734179:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:31962:x1870757013596160:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 342us (671us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1784093529.734189:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 30 00000100:00100000:1.0:1784093529.753998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093529.758193:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000020:00000080:2.0:1784093530.448898:0:52283:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7a76d2a0 20000000:00000080:2.0:1784093530.448916:0:52283:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3a4000 uarg=0000000000000000 00010000:00010000:2.0:1784093530.449133:0:52283:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784093530.449167:0:52283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907204fce100) 00010000:00010000:2.0:1784093530.449172:0:52283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093530.449183:0:52283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c8e60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf534e expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093530.449206:0:52283:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784093530.449221:0:52283:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093530.449236:0:52283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214c8ed7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 52283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093530.449249:0:52283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214c8e44 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c8e3d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093530.449257:0:52283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41c00/0x9ce98053214c8ed7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 52283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093530.449289:0:52283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69c00/0x9ce98053214c8e44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c8e3d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093530.449303:0:52283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69c00/0x9ce98053214c8e44 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c8e3d expref: 18 pid: 5771 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093530.449318:0:52283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:52283:1870757024164096:0@lo:104: 00000100:00100000:2.0:1784093530.449397:0:52283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093530.449473:0:52283:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af900 going to sleep for 11 seconds 00010000:00010000:1.0:1784093530.449641:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784093530.449642:0:52283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:52283:1870757024164096:0@lo:104: 00010000:00010000:1.0:1784093530.449652:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093530.449662:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:2.0:1784093530.449663:0:52283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41c00/0x9ce98053214c8ed7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 52283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093530.449666:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093530.449685:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093530.449692:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093530.449698:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093530.449726:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093530.449733:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093530.449769:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093530.449777:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8e3d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c8e44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093530.449789:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024164224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093530.449800:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093530.449803:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093530.449806:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093530.449822:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784093530.450176:0:52283:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41c00/0x9ce98053214c8ed7 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093530.450184:0:52283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41c00/0x9ce98053214c8ed7 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093530.450931:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024164224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093530.488536:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013596800 00000100:00100000:1.0:1784093530.488547:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013596800 00000100:00100000:1.0:1784093530.488579:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:1.0:1784093530.488591:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013596800:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093530.488655:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013596800:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093530.488661:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:1.0:1784093530.488780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093530.488822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093530.488916:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 244 00000100:00100000:1.0:1784093530.488929:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013597184:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093530.488970:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013597184:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093530.488982:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 244 00000100:00100000:1.0:1784093531.113923:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784093531.113935:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024164480:0@lo:400:kworker.0 00000100:00100000:1.0:1784093531.113953:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024164608:0@lo:400:kworker.0 00000100:00100000:2.0:1784093531.114012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093531.114074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093531.114097:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024164480 00000100:00100000:2.0:1784093531.114104:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024164480 00000100:00100000:1.0:1784093531.114124:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024164608 00000100:00100000:1.0:1784093531.114130:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024164608 00000100:00100000:2.0:1784093531.114167:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1784093531.114182:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024164480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093531.114197:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1784093531.114208:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024164608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093531.114238:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024164480:12345-0@lo:400:kworker.0 Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093531.114248:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1784093531.114269:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024164608:12345-0@lo:400:kworker.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093531.114278:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1784093531.114294:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024164480:0@lo:400:kworker.0 00000100:00100000:1.0:1784093531.114308:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024164864 00000100:00100000:1.0:1784093531.114314:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024164864 00000100:00100000:1.0:1784093531.114372:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784093531.114373:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024164352:0@lo:400:kworker.0 00000100:00100000:1.0:1784093531.114399:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024164864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093531.114458:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093531.114499:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024164864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093531.114506:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784093531.114534:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024164608:0@lo:400:kworker.0 00000100:00100000:2.0:1784093531.114657:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024164864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093531.117530:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024164992:0@lo:400:kworker.0 00000100:00100000:2.0:1784093531.117595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093531.117851:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024164992:0@lo:400:kworker.0 00000100:00080000:1.0:1784093531.120384:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093531.588528:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000001:00080000:2.0:1784093531.611352:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000004:00080000:2.0:1784093531.611358:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000001:00080000:2.0:1784093531.611405:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00010000:00010000:2.0:1784093531.611455:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611464:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611471:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611478:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093531.611483:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611491:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611506:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784093531.611510:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093531.611515:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611522:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c8eec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093531.611636:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024165120 00000100:00100000:2.0:1784093531.611643:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024165120 00000100:00100000:2.0:1784093531.611687:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784093531.611697:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024165120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784093531.611719:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:10 count 1 00010000:00010000:2.0:1784093531.611738:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611756:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c8eb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf536a expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611764:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093531.611768:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093531.611772:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611796:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c8eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf536a expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.611809:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c8eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf536a expref: 6 pid: 6573 timeout: 792 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093531.611820:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024165248:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093531.611863:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af780 going to sleep for 11 seconds 00000100:00080000:1.0:1784093531.615137:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784093531.615334:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093531.615344:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.615356:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093531.615362:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.615374:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.615389:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.615398:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214c8ef3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.615478:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093531.615490:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093531.615492:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784093531.817536:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093531.817551:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093531.817556:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093531.817598:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c8efa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.817611:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c8efa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.817623:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c8efa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093531.817649:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024165376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093531.817710:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093531.817756:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024165376 00000100:00100000:1.0:1784093531.817763:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024165376 00000100:00100000:2.0:1784093531.817816:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af240 going to sleep for 11 seconds 00000100:00100000:1.0:1784093531.817819:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1784093531.817828:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024165376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093531.817842:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093531.817857:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214c8f01 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c8efa expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.817880:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214c8f01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c8efa expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.817892:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12800/0x9ce98053214c8f01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c8efa expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093531.817908:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784093531.817957:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024165376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093531.817963:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1784093531.936915:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024165504 00000100:00100000:2.0:1784093531.936922:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024165504 00000100:00100000:2.0:1784093531.936968:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784093531.936975:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:52478:x1870757024165504:12345-0@lo:104: 00010000:00010000:2.0:1784093531.936988:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c8efa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c8f01 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093531.937061:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093531.937067:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:52478:x1870757024165504:12345-0@lo:104: Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093531.937076:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784093531.937259:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093531.937275:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024165632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093531.937323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093531.937749:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024165632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093533.101667:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784093533.101807:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093533.161816:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024165760 00000100:00100000:1.0:1784093533.161824:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024165760 00000100:00100000:1.0:1784093533.161883:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784093533.161894:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024165760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093533.161929:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093533.161982:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024165760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093533.161997:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784093533.162044:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024165760:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1784093533.673515:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093533.673522:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093533.673528:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093533.673573:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.673575:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093533.673587:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093533.673599:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093533.673626:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024165888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093533.673702:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093533.673752:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907237b79a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784093533.673985:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024165888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093533.674004:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8f32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093533.674014:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c8f32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093533.674032:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093533.674038:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8f32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093533.674045:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214c8f2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8f32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093533.766945:0:52721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce23eb6f0 20000000:00000080:1.0:1784093533.766963:0:52721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d995c00 uarg=0000000000000000 00010000:00010000:1.0:1784093533.767180:0:52721:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093533.767212:0:52721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784093533.767216:0:52721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093533.767225:0:52721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c8f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5378 expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.767248:0:52721:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093533.767262:0:52721:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093533.767288:0:52721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214c8f39 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 52721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.767302:0:52721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c8f2b expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.767310:0:52721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12000/0x9ce98053214c8f39 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 52721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.767345:0:52721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c8f2b expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.767358:0:52721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f32 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c8f2b expref: 18 pid: 5771 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093533.767372:0:52721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:52721:1870757024166016:0@lo:104: 00000100:00100000:1.0:1784093533.767508:0:52721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093533.767561:0:52721:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784093533.767819:0:52721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:52721:1870757024166016:0@lo:104: 00010000:00010000:1.0:1784093533.767837:0:52721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12000/0x9ce98053214c8f39 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 52721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093533.768066:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024166144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093533.768098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784093533.768552:0:52721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12000/0x9ce98053214c8f39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.768563:0:52721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12000/0x9ce98053214c8f39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093533.768571:0:52721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12000/0x9ce98053214c8f39 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093533.768620:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024166144:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1784093534.711694:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1784093534.711709:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000020:00000080:1.0:1784093535.246385:0:52919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6b0c03c0 20000000:00000080:1.0:1784093535.246403:0:52919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d994000 uarg=0000000000000000 00010000:00010000:1.0:1784093535.246641:0:52919:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093535.246656:0:52919:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093535.246669:0:52919:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093535.246687:0:52919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246699:0:52919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246721:0:52919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246728:0:52919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246735:0:52919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246743:0:52919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246749:0:52919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093535.246753:0:52919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246762:0:52919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246775:0:52919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246782:0:52919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093535.246789:0:52919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13400/0x9ce98053214c8f55 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 52919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093535.274470:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093535.274478:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093535.274483:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093535.274522:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093535.274534:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093535.274545:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093535.274574:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024166272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093535.274639:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093535.274685:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907237b79840 going to sleep for 11 seconds 00000100:00100000:2.0:1784093535.274929:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024166272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093535.274955:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093535.274965:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093535.274982:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093535.274987:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093535.274994:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093535.609904:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013598464 00000100:00100000:1.0:1784093535.609926:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013598464 00000100:00100000:1.0:1784093535.610029:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 428 00000100:00100000:1.0:1784093535.610044:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013598464:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093535.610150:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013598464:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 108us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093535.610175:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 428 00000100:00100000:1.0:1784093536.234333:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024166912:0@lo:400:kworker.0 00000100:00100000:1.0:1784093536.234353:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024166400:0@lo:400:kworker.0 00000100:00100000:1.0:1784093536.234451:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024166528:0@lo:400:kworker.0 00000100:00100000:1.0:1784093536.234468:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024167040:0@lo:400:kworker.0 00000100:00100000:1.0:1784093536.234620:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024167168 00000100:00100000:1.0:1784093536.234626:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024167168 00000100:00100000:1.0:1784093536.234726:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784093536.234736:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024167168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093536.234765:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093536.234823:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024167168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093536.234831:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784093536.364883:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093536.366619:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093536.367802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093536.369602:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093536.370597:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093536.370629:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013599488 00000100:00100000:1.0:1784093536.370635:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013599488 00000100:00100000:1.0:1784093536.370667:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 131 00000100:00100000:1.0:1784093536.370675:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:32300:x1870757013599488:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093536.370980:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:32300:x1870757013599488:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 305us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093536.370995:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 131 00000100:00100000:2.0:1784093536.371676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093536.372880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093536.396828:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093536.399356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:2.0:1784093536.401605:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093536.401615:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093536.401622:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093536.401628:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093536.401631:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093536.401638:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093536.401647:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x93c5647 (ffff907202e6b900) 00010000:00010000:2.0:1784093536.401650:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093536.401653:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093536.401659:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c8f94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x13:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093536.404653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093536.413898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093536.413967:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013600384 00000100:00100000:2.0:1784093536.413979:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013600384 00002000:00100000:2.0:1784093536.414028:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa:0x0] (0->1048575) req@ffff90723e17d880 x1870757013600384/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:612/0 lens 488/0 e 0 to 0 dl 1784093547 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093536.414040:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723e17d880 with x1870757013600384 ext(0->1048575) 00002000:00010000:2.0:1784093536.414045:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723e17d880 00000100:00100000:2.0:1784093536.414072:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 5 00000100:00100000:2.0:1784093536.414082:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013600384:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:2.0:1784093536.422006:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2354:x1870757013600384:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 7916us (8109us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784093536.422020:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 5 00002000:00100000:2.0:1784093536.422033:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa:0x0] (0->1048575) req@ffff90723e17d880 x1870757013600384/t4294967315(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:612/0 lens 488/448 e 0 to 0 dl 1784093547 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093536.422044:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723e17d880 with x1870757013600384 ext(0->1048575) 00002000:00010000:2.0:1784093536.422051:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723e17d880 00000001:00080000:2.0:1784093536.433358:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:1.0:1784093536.433490:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:32304:x1870757013600512:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 9857us (10011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093536.433503:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 280 00000100:00100000:1.0:1784093536.445510:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013600640:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 10671us (10803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093536.445521:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 134 00000100:00100000:1.0:1784093536.447388:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013600896 00000100:00100000:1.0:1784093536.447397:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013600896 00000100:00100000:1.0:1784093536.447466:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 31 00000100:00100000:1.0:1784093536.447475:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:32304:x1870757013600896:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093536.447930:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:32304:x1870757013600896:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 455us (600us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784093536.447935:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 31 00000004:00080000:1.0:1784093537.360970:0:53163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 698438545037ns, next at 691836769583ns, rc = 0 00000004:00080000:1.0:1784093537.361113:0:53163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 698438690947ns, next at 671096815126ns, rc = 0 00000100:00100000:2.0:1784093537.929052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093537.929110:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013601024 00000100:00100000:1.0:1784093537.929119:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013601024 00000100:00100000:1.0:1784093537.929204:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:1.0:1784093537.929215:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:32496:x1870757013601024:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093537.929316:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:32496:x1870757013601024:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 103us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093537.929334:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:1.0:1784093537.938922:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013601536 00000100:00100000:1.0:1784093537.938931:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013601536 00000100:00100000:1.0:1784093537.938979:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 283 00000100:00100000:1.0:1784093537.938990:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:32496:x1870757013601536:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093537.939074:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:32496:x1870757013601536:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 86us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093537.939081:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 283 00000100:00100000:1.0:1784093537.940082:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093537.940116:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013601664 00000100:00100000:2.0:1784093537.940124:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013601664 00000100:00100000:2.0:1784093537.940162:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 137 00000100:00100000:2.0:1784093537.940173:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:32496:x1870757013601664:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093537.940585:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:32496:x1870757013601664:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 414us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093537.940600:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 137 00000100:00100000:2.0:1784093537.977647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784093538.869660:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093538.873185:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093538.873194:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c8fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093538.873203:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093538.873207:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c8fcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093538.873217:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c8fcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093538.873231:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c8fcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093538.873238:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c8fcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093538.873271:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093538.873274:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093538.873276:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093540.728808:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093540.728845:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093540.728875:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093540.728915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093540.728955:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013602688 00000100:00100000:1.0:1784093540.728962:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013602688 00000100:00100000:1.0:1784093540.728994:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013602816 00000100:00100000:1.0:1784093540.728997:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013602816 00000100:00100000:1.0:1784093540.729023:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 250 00000100:00100000:1.0:1784093540.729034:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013602688:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093540.729153:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013602688:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 121us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093540.729160:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 250 00000100:00100000:2.0:1784093541.353679:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024167680:0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.353685:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024168064:0@lo:400:kworker.0 00000100:00100000:2.0:1784093541.353761:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093541.353816:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024168192:0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.353831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093541.353851:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093541.353897:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024168064 00000100:00100000:1.0:1784093541.353903:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024168064 00000100:00100000:2.0:1784093541.353939:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024167680 00000100:00100000:2.0:1784093541.353945:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024167680 00000100:00100000:1.0:1784093541.353952:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024168320 00000100:00100000:1.0:1784093541.353958:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024168320 00000100:00100000:2.0:1784093541.353988:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1784093541.354001:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1784093541.354002:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024167680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.354014:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.354069:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024168064:12345-0@lo:400:kworker.0 Request processed in 58us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093541.354094:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1784093541.354101:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024167680:12345-0@lo:400:kworker.0 Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093541.354107:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1784093541.354264:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024168064:0@lo:400:kworker.0 00000100:00100000:2.0:1784093541.354278:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024167680:0@lo:400:kworker.0 00000100:00100000:2.0:1784093541.354299:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024168192:0@lo:400:kworker.0 00000100:00100000:2.0:1784093541.354587:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024168448:0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.354628:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024167936 00000100:00100000:1.0:1784093541.354634:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024167936 00000100:00100000:1.0:1784093541.354669:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1784093541.354677:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024167936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.354993:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024167936:12345-0@lo:400:kworker.0 Request processed in 316us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093541.354995:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024167936:0@lo:400:kworker.0 00000100:00100000:1.0:1784093541.355008:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00010000:1.0:1784093542.889555:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093542.901265:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:2.0:1784093543.401714:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784093543.401735:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024168576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093543.401799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093543.402107:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024168576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093543.913798:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093545.849513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093545.849556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093545.849597:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093545.849668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:2.0:1784093545.849949:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093545.850029:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013603200 00000100:00100000:1.0:1784093545.850034:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013603200 00000100:00100000:1.0:1784093545.850136:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 254 00000100:00100000:1.0:1784093545.850145:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013603200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093545.850196:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013603200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 51us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093545.850203:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 254 00000100:00080000:2.0:1784093545.850784:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093545.850788:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093546.474611:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024169088:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.474684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093546.474744:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024168704:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476398:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024169088:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476485:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024168960:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093546.476556:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024169472:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093546.476642:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024169472 00000100:00100000:1.0:1784093546.476647:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024169472 00000100:00100000:1.0:1784093546.476678:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784093546.476683:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476721:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024169472:12345-0@lo:400:kworker.0 Request processed in 37us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093546.476726:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784093546.476771:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024168960:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476785:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1784093546.476791:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723e17fb80, transno 4294967316 00000100:00100000:1.0:1784093546.476810:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024169472:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.476994:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024168832 00000100:00100000:1.0:1784093546.477000:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024168832 00000100:00100000:1.0:1784093546.477045:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784093546.477055:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024168832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093546.477088:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093546.477137:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024168832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093546.477144:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1784093546.477170:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093546.477294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093546.477327:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024169216:0@lo:400:kworker.0 00000100:00100000:1.0:1784093546.477330:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024168704 00000100:00100000:1.0:1784093546.477334:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024168704 00000100:00100000:2.0:1784093546.477356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093546.477363:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1784093546.477370:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024168704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093546.477395:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024169216 00000100:00100000:2.0:1784093546.477400:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024169216 00000100:00100000:1.0:1784093546.477451:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024168704:12345-0@lo:400:kworker.0 Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093546.477459:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1784093546.477462:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784093546.477473:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024169216:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093546.477495:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093546.477521:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024169216:12345-0@lo:400:kworker.0 Request processed in 48us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093546.477528:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784093546.477561:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024168704:0@lo:400:kworker.0 00000100:00100000:2.0:1784093546.477574:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024169216:0@lo:400:kworker.0 00010000:00010000:1.0:1784093546.985558:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093548.009650:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093548.521721:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024169600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093548.521790:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093548.521887:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024169600 00000100:00100000:2.0:1784093548.521894:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024169600 00000100:00100000:2.0:1784093548.521954:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784093548.521961:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024169600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093548.522002:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093548.522167:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024169600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093548.522178:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024169600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093548.522189:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784093550.969087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093550.969147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093550.969201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093550.969262:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013603584 00000100:00100000:1.0:1784093550.969279:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013603584 00000100:00100000:2.0:1784093550.969306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:2.0:1784093550.969374:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093550.969385:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093550.969394:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:1.0:1784093550.969412:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013603584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093550.969483:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 258 00000100:00100000:2.0:1784093550.969501:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013603712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093550.969558:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013603584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 149us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093550.969578:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013603712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093550.969579:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:2.0:1784093550.969599:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 258 00000100:00080000:2.0:1784093550.969771:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093551.082097:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093551.593764:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024169856:0@lo:400:kworker.0 00000100:00100000:1.0:1784093551.593837:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024170112:0@lo:400:kworker.0 00000100:00100000:2.0:1784093551.593858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093551.594023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093551.594045:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024170240:0@lo:400:kworker.0 00000100:00100000:2.0:1784093551.594091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093551.594107:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024170112 00000100:00100000:1.0:1784093551.594122:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024170112 00000100:00100000:2.0:1784093551.594146:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024170240 00000100:00100000:2.0:1784093551.594152:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024170240 00000100:00100000:1.0:1784093551.594175:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1784093551.594192:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024170112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093551.594212:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1784093551.594228:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024170240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093551.594269:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024170112:12345-0@lo:400:kworker.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093551.594288:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1784093551.594306:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024170240:12345-0@lo:400:kworker.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093551.594327:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1784093551.594365:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024169984:0@lo:400:kworker.0 00000100:00100000:1.0:1784093551.594394:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024170112:0@lo:400:kworker.0 00000100:00100000:2.0:1784093551.594492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093551.594529:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024170368 00000100:00100000:2.0:1784093551.594535:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024170496:0@lo:400:kworker.0 00000100:00100000:1.0:1784093551.594536:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024170368 00000100:00100000:2.0:1784093551.594576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093551.594615:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1784093551.594630:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024170368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093551.594686:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024169984:0@lo:400:kworker.0 00000100:00100000:1.0:1784093551.594701:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024170368:12345-0@lo:400:kworker.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093551.594716:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1784093551.594774:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024170368:0@lo:400:kworker.0 00010000:00010000:2.0:1784093552.106181:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093553.641660:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024170624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093553.641726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093553.641800:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024170624 00000100:00100000:2.0:1784093553.641809:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024170624 00000100:00100000:2.0:1784093553.642005:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784093553.642015:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024170624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093553.642047:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093553.642099:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024170624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093553.642107:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784093553.642149:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024170624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093555.177817:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093556.088596:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013604096 00000100:00100000:2.0:1784093556.088603:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013604096 00000100:00100000:1.0:1784093556.088646:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 263 00000100:00100000:2.0:1784093556.088652:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 444 00000100:00100000:1.0:1784093556.088658:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013604224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093556.088666:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013604096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093556.088688:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013604224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093556.088697:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 263 00000100:00100000:2.0:1784093556.088711:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013604096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093556.088718:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 444 00000100:00080000:1.0:1784093556.088771:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093556.088775:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093556.088777:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784093556.201782:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093556.637069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093556.642034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093556.647145:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013604736 00000100:00100000:1.0:1784093556.647156:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013604736 00000100:00100000:1.0:1784093556.647278:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 141 00000100:00100000:1.0:1784093556.647290:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:32837:x1870757013604736:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093556.647703:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:32837:x1870757013604736:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 414us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093556.647717:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 141 00000100:00100000:1.0:1784093556.649282:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093556.649349:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013604864 00000100:00100000:2.0:1784093556.649358:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013604864 00000100:00100000:2.0:1784093556.649418:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 287 00000100:00100000:2.0:1784093556.649463:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:32837:x1870757013604864:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093556.649831:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:32837:x1870757013604864:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 371us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093556.649851:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 287 00000100:00100000:2.0:1784093556.652173:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013604992 00000100:00100000:2.0:1784093556.652182:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013604992 00000100:00100000:2.0:1784093556.652225:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 288 00000100:00100000:2.0:1784093556.652238:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:32837:x1870757013604992:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093556.652334:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:32837:x1870757013604992:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 100us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093556.652341:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 288 00000100:00100000:1.0:1784093556.655630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093556.669784:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013605504 00000100:00100000:1.0:1784093556.669793:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013605504 00000100:00100000:1.0:1784093556.669856:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 290 00000100:00100000:1.0:1784093556.669969:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:32838:x1870757013605504:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093556.669991:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093556.670013:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c8fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf539b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093556.670079:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c8fda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093556.670093:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c8fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093556.670103:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c8fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093556.670285:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 7680 00000004:00200000:1.0:1784093556.670290:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093556.670367:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c8fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093556.670400:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c8fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf539b expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093556.670471:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c8fda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf539b expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093556.670487:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907202e6b400) 00010000:00010000:1.0:1784093556.670490:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093556.670493:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093556.670563:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:32838:x1870757013605504:12345-192.168.204.57@tcp:101:rm.0 Request processed in 697us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093556.670571:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 290 00000100:00100000:1.0:1784093556.672240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093556.672293:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013605760 00000100:00100000:2.0:1784093556.672301:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013605760 00000100:00100000:2.0:1784093556.672344:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 291 00000100:00100000:2.0:1784093556.672354:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:32838:x1870757013605760:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093556.672368:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093556.672383:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c8fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf53a2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093556.672591:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 7680 00010000:00010000:2.0:1784093556.672780:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c8fe1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53a2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093556.672793:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093556.672796:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784093556.672805:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c8fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53a2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093556.672819:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093556.672874:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:32838:x1870757013605760:12345-192.168.204.57@tcp:101:rm.0 Request processed in 521us (637us total) trans 4294967417 rc 301/301 00000100:00100000:2.0:1784093556.672881:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 291 00000100:00100000:2.0:1784093556.675116:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093556.675172:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013605888 00000100:00100000:1.0:1784093556.675184:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013605888 00000100:00100000:1.0:1784093556.675242:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 32 00000100:00100000:1.0:1784093556.675252:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:32838:x1870757013605888:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784093556.677962:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:32838:x1870757013605888:12345-192.168.204.57@tcp:37:rm.0 Request processed in 2702us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093556.677976:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 32 00000100:00100000:2.0:1784093556.680489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093556.680610:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013606144 00000100:00100000:1.0:1784093556.680620:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013606144 00000100:00100000:1.0:1784093556.680683:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 33 00000100:00100000:1.0:1784093556.680694:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:32838:x1870757013606144:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:1.0:1784093556.681902:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:32838:x1870757013606144:12345-192.168.204.57@tcp:35:rm.0 Request processed in 1206us (1418us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1784093556.681912:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 33 00000100:00100000:2.0:1784093556.683549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093556.713766:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024171136:0@lo:400:kworker.0 00000100:00100000:1.0:1784093556.715070:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024171520 00000100:00100000:1.0:1784093556.715075:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024171520 00000100:00100000:1.0:1784093556.715102:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1784093556.715109:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024171520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093556.715150:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093556.715198:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024171520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093556.715204:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784093556.715302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784093556.715402:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093556.715520:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024171136:0@lo:400:kworker.0 00000100:00100000:2.0:1784093558.068774:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784093558.068787:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024171648 00000100:00100000:2.0:1784093558.068793:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024171648 00000100:00100000:2.0:1784093558.068915:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784093558.068925:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103889450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:53767:x1870757024171648:12345-0@lo:104: 00010000:00010000:2.0:1784093558.068938:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093558.069005:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093558.069012:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103889450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:53767:x1870757024171648:12345-0@lo:104: Request processed in 89us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093558.069018:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00010000:1.0:1784093558.069037:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093558.069045:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069055:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093558.069059:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069067:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093558.069075:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093558.069081:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093558.069115:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069124:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093558.069150:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069158:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214c8f5c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c8f63 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069197:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093558.069199:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093558.069202:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093558.069238:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024171776 00000100:00100000:1.0:1784093558.069243:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024171776 00010000:00010000:1.0:1784093558.069263:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f63 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c8f5c expref: 19 pid: 5772 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093558.069296:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1784093558.069304:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024171776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093558.069314:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093558.069321:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f63 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c8f5c expref: 19 pid: 5772 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069333:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c8f5c expref: 19 pid: 5772 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069347:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214c8f63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c8f5c expref: 19 pid: 5772 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069358:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069366:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069379:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069386:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069412:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069419:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069442:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093558.069447:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069455:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069471:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68400/0x9ce98053214c9004 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093558.069481:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093558.069522:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024171776:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093558.069531:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784093558.069554:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024171776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093558.250185:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093558.762609:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093558.762708:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024171904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093558.763007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093558.763370:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024171904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093559.146039:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024172032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093559.146056:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9012 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9019 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.146067:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9012 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9019 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093559.146087:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093559.146092:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9012 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9019 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.146100:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9012 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9019 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.273870:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093559.296735:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:2.0:1784093559.843167:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093559.847110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093559.850748:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013607040 00000100:00100000:2.0:1784093559.850758:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013607040 00000100:00100000:2.0:1784093559.850823:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 34 00000100:00100000:2.0:1784093559.850834:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:32951:x1870757013607040:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784093559.853925:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:32951:x1870757013607040:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3086us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093559.853935:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 34 00000100:00100000:1.0:1784093559.855901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093559.855951:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013607296 00000100:00100000:2.0:1784093559.855960:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013607296 00000100:00100000:2.0:1784093559.856002:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 35 00000100:00100000:2.0:1784093559.856011:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:32951:x1870757013607296:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784093559.856417:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:32951:x1870757013607296:12345-192.168.204.57@tcp:35:rm.0 Request processed in 406us (521us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1784093559.856458:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 35 00000100:00100000:1.0:1784093559.857885:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013607552 00000100:00100000:1.0:1784093559.857900:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013607552 00000100:00100000:1.0:1784093559.857934:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 296 00000100:00100000:1.0:1784093559.857941:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:32951:x1870757013607552:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093559.857978:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093559.858004:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53b0 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858022:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907202e6b400) 00010000:00010000:1.0:1784093559.858040:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53a9 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858050:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093559.858056:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093559.858082:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858095:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858105:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858116:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858124:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858130:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858475:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858485:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.858493:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093559.859258:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 7680 00010000:00010000:1.0:1784093559.859274:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859282:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859288:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859292:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093559.859295:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859300:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859307:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff907202d46200) 00010000:00010000:1.0:1784093559.859310:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093559.859312:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859323:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9066 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859336:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859340:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859343:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859346:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093559.859348:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859351:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859355:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202d46a00) 00010000:00010000:1.0:1784093559.859356:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093559.859358:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093559.859363:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9058 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093559.859373:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d1fa1367 reply state 00000000d164ed3b transno 4294967421 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093559.859381:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093559.859471:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:32951:x1870757013607552:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1529us (1655us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1784093559.859479:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 296 00010000:00010000:2.0:1784093559.860816:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.860827:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.860832:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.860837:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093559.860841:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.860848:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.860861:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202d46900) 00010000:00010000:2.0:1784093559.860863:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093559.860867:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.860872:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c905f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093559.885541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093559.885595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093559.885646:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013607808 00000100:00100000:2.0:1784093559.885652:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013607808 00000100:00100000:2.0:1784093559.885698:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 299 00000100:00100000:2.0:1784093559.885708:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:2353:x1870757013607808:12345-192.168.204.57@tcp:41:mkdir.0 00000004:00000024:2.0:1784093559.885752:0:5779:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784093559.885909:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013607808:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 202us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093559.885918:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 299 00000100:00100000:2.0:1784093559.910460:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013608192 00000100:00100000:2.0:1784093559.910470:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013608192 00000100:00100000:2.0:1784093559.910531:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:2.0:1784093559.910542:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:32959:x1870757013608192:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093559.910566:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093559.910590:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf53c5 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.910657:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.910672:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.910683:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093559.910742:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093559.910747:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093559.910769:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.910805:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53c5 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.910841:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53c5 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.910850:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093559.910853:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093559.910856:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41000, rc 0) 00000100:00100000:2.0:1784093559.910924:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:32959:x1870757013608192:12345-192.168.204.57@tcp:101:chown.0 Request processed in 384us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093559.910932:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:1.0:1784093559.912863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093559.916546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000001:00080000:1.0:1784093559.946317:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000001:00080000:1.0:1784093559.946338:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967423 is committed 00010000:00010000:2.0:1784093559.946642:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.946653:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.946660:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.946666:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093559.946670:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.946677:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.946696:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce800) 00010000:00010000:2.0:1784093559.946699:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093559.946704:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093559.946718:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c90b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093560.346857:0:54012:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc91c36100 20000000:00000080:2.0:1784093560.346874:0:54012:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237553400 uarg=0000000000000000 00010000:00010000:2.0:1784093560.347318:0:54012:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784093560.347351:0:54012:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093560.347354:0:54012:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093560.347364:0:54012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53c5 expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.347384:0:54012:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784093560.347399:0:54012:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093560.347413:0:54012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214c90ba lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.347459:0:54012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77600/0x9ce98053214c9019 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9012 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.347468:0:54012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41e00/0x9ce98053214c90ba lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.347503:0:54012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77600/0x9ce98053214c9019 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9012 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.347517:0:54012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77600/0x9ce98053214c9019 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9012 expref: 18 pid: 5770 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093560.347532:0:54012:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:54012:1870757024172160:0@lo:104: 00000100:00100000:2.0:1784093560.347598:0:54012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093560.347704:0:54012:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e35c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093560.347749:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024172160 00000100:00100000:1.0:1784093560.347756:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024172160 00000100:00100000:1.0:1784093560.347862:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784093560.347873:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:54012:x1870757024172160:12345-0@lo:104: 00010000:00010000:1.0:1784093560.347887:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9012 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9019 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.347998:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093560.348005:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:54012:x1870757024172160:12345-0@lo:104: Request processed in 135us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093560.348013:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784093560.348091:0:54012:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:54012:1870757024172160:0@lo:104: 00010000:00010000:2.0:1784093560.348109:0:54012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41e00/0x9ce98053214c90ba lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.348526:0:54012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41e00/0x9ce98053214c90ba lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.348536:0:54012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214c90ba lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093560.348552:0:54012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214c90ba lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093560.733574:0:54060:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd3c31e70 20000000:00000080:1.0:1784093560.733591:0:54060:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907206bb1000 uarg=0000000000000000 00010000:00010000:1.0:1784093560.734017:0:54060:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093560.734032:0:54060:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093560.734049:0:54060:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093560.734069:0:54060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734086:0:54060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734105:0:54060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734113:0:54060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734121:0:54060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734129:0:54060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734136:0:54060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093560.734140:0:54060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734148:0:54060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734160:0:54060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734168:0:54060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093560.734173:0:54060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214c90c1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093561.209122:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093561.209149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093561.209183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093561.209211:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013608832 00000100:00100000:2.0:1784093561.209218:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013608832 00000100:00100000:1.0:1784093561.209232:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093561.209259:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013608960 00000100:00100000:1.0:1784093561.209263:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013608960 00000100:00100000:2.0:1784093561.209279:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 448 00000100:00100000:2.0:1784093561.209302:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013608832:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093561.209348:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 267 00000100:00100000:1.0:1784093561.209361:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013609088:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093561.209399:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013608832:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093561.209413:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 448 00000100:00080000:2.0:1784093561.209469:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093561.209475:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093561.209480:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093561.209486:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013609088:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093561.209513:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 267 00010000:00010000:1.0:1784093561.322093:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093561.833593:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024172416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093561.833669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093561.833842:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024172544 00000100:00100000:2.0:1784093561.833848:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024172544 00000100:00100000:2.0:1784093561.833903:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1784093561.833913:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024172544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093561.833969:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024172544:12345-0@lo:400:kworker.0 Request processed in 57us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093561.833978:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00080000:2.0:1784093561.834025:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093561.834067:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024172416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093561.834311:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784093561.834314:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024172928:0@lo:400:kworker.0 00000100:00100000:1.0:1784093561.834322:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024173056:0@lo:400:kworker.0 00000100:00100000:1.0:1784093561.834360:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093561.834366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093561.834401:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093561.834410:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024172800:0@lo:400:kworker.0 00000100:00100000:1.0:1784093561.834411:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024172928 00000100:00100000:1.0:1784093561.834415:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024172928 00000100:00100000:1.0:1784093561.834470:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784093561.834478:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024172928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093561.834479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093561.834519:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024172928:0@lo:400:kworker.0 00000100:00100000:2.0:1784093561.834542:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024172800 00000100:00100000:2.0:1784093561.834545:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024172800 00000100:00100000:2.0:1784093561.834571:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1784093561.834576:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024172800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093561.835480:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024172928:12345-0@lo:400:kworker.0 Request processed in 1002us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093561.835489:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784093561.835538:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024172800:12345-0@lo:400:kworker.0 Request processed in 960us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093561.835544:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 10000000:01000000:2.0:1784093562.346829:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093562.346836:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093562.346841:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093562.346880:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093562.346892:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093562.346912:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093562.346938:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024173184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093562.347005:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093562.347063:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1900 going to sleep for 11 seconds 00000100:00100000:1.0:1784093562.347128:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173184 00000100:00100000:1.0:1784093562.347136:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173184 00000100:00100000:1.0:1784093562.347215:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1784093562.347224:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024173184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093562.347238:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093562.347251:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c90c8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.347283:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c90c8 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.347293:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c90c8 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.347303:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093562.347349:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024173184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093562.347358:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1784093562.766324:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173312 00000100:00100000:2.0:1784093562.766332:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173312 00000100:00100000:2.0:1784093562.766410:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784093562.766437:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:54303:x1870757024173312:12345-0@lo:104: 00010000:00010000:2.0:1784093562.766452:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093562.766573:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093562.766580:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:54303:x1870757024173312:12345-0@lo:104: Request processed in 163us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093562.766587:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:1.0:1784093562.766596:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093562.766604:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.766614:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093562.766618:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.766628:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093562.766635:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093562.766641:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093562.766672:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.766679:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093562.766706:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.766713:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214c90c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c90cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.766741:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093562.766743:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093562.766745:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093562.766765:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024173440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093562.766794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093562.766838:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173440 00000100:00100000:1.0:1784093562.766843:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173440 00010000:00010000:1.0:1784093562.766863:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c90c8 expref: 19 pid: 5770 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093562.766953:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784093562.766962:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024173440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093562.766972:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093562.766977:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c90c8 expref: 19 pid: 5770 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.766987:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c90c8 expref: 19 pid: 5770 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767000:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12200/0x9ce98053214c90cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c90c8 expref: 19 pid: 5770 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767012:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767027:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767036:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767041:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767045:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767049:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767052:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093562.767056:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767063:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767077:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77e00/0x9ce98053214c90d6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093562.767087:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093562.767124:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024173440:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093562.767140:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784093562.767157:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024173440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093563.882693:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173568 00000100:00100000:2.0:1784093563.882720:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173568 00000100:00100000:2.0:1784093563.882776:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784093563.882783:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024173568:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784093563.882799:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1784093563.882820:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093563.882875:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024173568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093563.882883:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784093564.080529:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784093564.081306:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1784093564.105608:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967424 is committed 00010000:00010000:2.0:1784093564.106142:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.106152:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.106160:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.106166:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093564.106171:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.106179:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.106194:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce000) 00010000:00010000:2.0:1784093564.106197:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093564.106202:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.106209:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9107 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.393803:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093564.470040:0:54499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2df6f6c0 20000000:00000080:1.0:1784093564.470057:0:54499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907206bb0400 uarg=0000000000000000 00010000:00010000:1.0:1784093564.470547:0:54499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093564.470574:0:54499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b300) 00010000:00010000:1.0:1784093564.470577:0:54499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093564.470585:0:54499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c90e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53d3 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470600:0:54499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093564.470611:0:54499:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093564.470622:0:54499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470632:0:54499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470638:0:54499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470642:0:54499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470646:0:54499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470651:0:54499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470654:0:54499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093564.470663:0:54499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470669:0:54499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470674:0:54499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470679:0:54499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.470683:0:54499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12000/0x9ce98053214c910e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093564.585492:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093564.585499:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093564.585503:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093564.585542:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.585550:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.585558:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093564.585577:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024173696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093564.585630:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093564.585676:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093564.585738:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173696 00000100:00100000:2.0:1784093564.585746:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173696 00000100:00100000:2.0:1784093564.585798:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1784093564.585806:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024173696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093564.585819:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093564.585833:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9115 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.585870:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9115 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.585880:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9115 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093564.585890:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784093564.585936:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024173696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093564.585943:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1784093564.585986:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024173696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093564.586003:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c911c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.586009:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c911c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093564.586023:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093564.586026:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c911c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093564.586031:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c911c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093565.724635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093565.724714:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013610112 00000100:00100000:1.0:1784093565.724724:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013610112 00000100:00100000:1.0:1784093565.724816:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 307 00000100:00100000:1.0:1784093565.724834:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:33212:x1870757013610112:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093565.724854:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093565.724880:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c913f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf53e8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.725285:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.725300:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.725312:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.725334:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.725341:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.725348:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093565.726347:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb:0x0], index 0: 0 00010000:00010000:1.0:1784093565.726735:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9154 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726747:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726754:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726791:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726799:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726806:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726812:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093565.726817:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726837:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726849:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce900) 00010000:00010000:1.0:1784093565.726852:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093565.726856:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726862:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9146 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093565.726876:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000045c5fc42 reply state 00000000eb6332c1 transno 4294967425 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093565.726885:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093565.726916:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c913f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53e8 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726933:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53e8 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.726940:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff907202d46000) 00010000:00010000:1.0:1784093565.726943:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093565.726946:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093565.727012:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:33212:x1870757013610112:12345-192.168.204.57@tcp:101:touch.0 Request processed in 2183us (2385us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1784093565.727020:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 307 00010000:00010000:2.0:1784093565.728650:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.728674:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.728682:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.728689:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093565.728694:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.728701:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.728718:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907202d46e00) 00010000:00010000:2.0:1784093565.728722:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093565.728727:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.728743:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c914d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093565.729718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093565.729750:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013610368 00000100:00100000:1.0:1784093565.729766:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013610368 00000100:00100000:1.0:1784093565.729814:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 308 00000100:00100000:1.0:1784093565.729823:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:33212:x1870757013610368:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:1.0:1784093565.729873:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093565.729890:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9154 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53e8 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.729900:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff907202d46000) 00010000:00010000:1.0:1784093565.729906:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093565.729957:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.729969:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.729979:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093565.730096:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000032a4596e reply state 000000006cdebab1 transno 4294967426 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093565.730104:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093565.730175:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:33212:x1870757013610368:12345-192.168.204.57@tcp:36:touch.0 Request processed in 355us (462us total) trans 4294967426 rc 0/0 00000100:00100000:1.0:1784093565.730180:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 308 00010000:00010000:2.0:1784093565.731126:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731134:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731138:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731142:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093565.731144:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731149:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731156:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff907202d46300) 00010000:00010000:2.0:1784093565.731159:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093565.731161:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731167:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9162 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093565.731521:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093565.731603:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013610496 00000100:00100000:1.0:1784093565.731611:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013610496 00000100:00100000:2.0:1784093565.731837:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 309 00000100:00100000:2.0:1784093565.731848:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:33212:x1870757013610496:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093565.731875:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093565.731893:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf53ef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731936:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53ef expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731949:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53ef expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.731967:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093565.731970:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784093565.731973:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784093565.732015:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:33212:x1870757013610496:12345-192.168.204.57@tcp:101:touch.0 Request processed in 169us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093565.732021:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 309 00000100:00100000:2.0:1784093565.734317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784093565.734468:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093565.734493:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 144 00000100:00100000:2.0:1784093565.734504:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013610624:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:2.0:1784093565.734809:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013610624:12345-192.168.204.57@tcp:2:touch.0 Request processed in 306us (496us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784093565.734817:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 144 00000100:00100000:2.0:1784093565.736092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093565.736152:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013610880 00000100:00100000:1.0:1784093565.736158:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013610880 00000100:00100000:1.0:1784093565.736233:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 36 00000100:00100000:1.0:1784093565.736242:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:33212:x1870757013610880:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:1.0:1784093565.736534:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:33212:x1870757013610880:12345-192.168.204.57@tcp:35:touch.0 Request processed in 293us (448us total) trans 4294967427 rc 0/0 00000100:00100000:1.0:1784093565.736543:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 36 00000100:00100000:1.0:1784093565.756544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093565.761549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093565.761632:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013611392 00000100:00100000:1.0:1784093565.761646:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013611392 00000100:00100000:1.0:1784093565.761712:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 311 00000100:00100000:1.0:1784093565.761725:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:33216:x1870757013611392:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093565.761790:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093565.761822:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9185 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53f6 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761844:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53ef expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761853:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff90721a781000) 00010000:00010000:1.0:1784093565.761862:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093565.761883:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761894:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761902:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761931:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761937:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.761944:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762071:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762077:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762083:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093565.762848:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8896 00000004:00080000:1.0:1784093565.762861:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726840438538ns, next at 727840435113ns, rc = 0 00010000:00010000:1.0:1784093565.762918:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c91a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762927:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c91a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762932:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c91a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762938:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c91a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762953:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c91a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762958:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c91a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.762981:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093565.763007:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763015:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763025:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763037:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093565.763043:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763054:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763070:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1a:0x0].0x0 (ffff907202d46900) 00010000:00010000:1.0:1784093565.763074:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093565.763079:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763094:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c91a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763112:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763125:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763131:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763136:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093565.763140:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763146:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763160:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce900) 00010000:00010000:1.0:1784093565.763165:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093565.763170:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093565.763187:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214c9193 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093565.763208:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000780fcd0d reply state 0000000004fb4034 transno 4294967428 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093565.763220:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093565.763320:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:33216:x1870757013611392:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1596us (1775us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1784093565.763329:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 311 00010000:00010000:2.0:1784093565.764287:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.764322:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.764330:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.764337:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093565.764341:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.764350:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.764365:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907202d46000) 00010000:00010000:2.0:1784093565.764368:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093565.764373:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093565.764379:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c919a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093566.329569:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093566.329599:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093566.329706:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013611520 00000100:00100000:1.0:1784093566.329712:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013611520 00000100:00100000:1.0:1784093566.329757:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 541 00000100:00100000:1.0:1784093566.329767:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013611520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093566.329951:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013611520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 184us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093566.329958:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 541 00000100:00100000:1.0:1784093566.330606:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093566.330636:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093566.330698:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013611648 00000100:00100000:2.0:1784093566.330703:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013611648 00000100:00080000:1.0:1784093566.330731:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093566.330737:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093566.330751:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013611904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093566.330800:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013611904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093566.330809:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 270 00000100:00100000:2.0:1784093566.330824:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 452 00000100:00100000:2.0:1784093566.330834:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:2354:x1870757013611648:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093566.330936:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:2354:x1870757013611648:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093566.330954:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 452 00010000:00010000:2.0:1784093566.441549:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093566.480262:0:54742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc232bd650 20000000:00000080:2.0:1784093566.480278:0:54742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df7400 uarg=0000000000000000 00010000:00010000:2.0:1784093566.480595:0:54742:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784093566.480628:0:54742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce900) 00010000:00010000:2.0:1784093566.480632:0:54742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093566.480644:0:54742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53e1 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.480678:0:54742:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784093566.480700:0:54742:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093566.480714:0:54742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.480726:0:54742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9115 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.480735:0:54742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.480771:0:54742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9115 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.480785:0:54742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9115 expref: 18 pid: 5772 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093566.480799:0:54742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:54742:1870757024173824:0@lo:104: 00000100:00100000:2.0:1784093566.480870:0:54742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093566.480921:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173824 00000100:00100000:2.0:1784093566.480925:0:54742:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1480 going to sleep for 11 seconds 00000100:00100000:1.0:1784093566.480931:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173824 00000100:00100000:1.0:1784093566.480977:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1784093566.480987:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:54742:x1870757024173824:12345-0@lo:104: 00010000:00010000:1.0:1784093566.481009:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9115 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c911c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093566.481080:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093566.481087:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:54742:x1870757024173824:12345-0@lo:104: Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093566.481094:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784093566.481103:0:54742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:54742:1870757024173824:0@lo:104: 00010000:00010000:2.0:1784093566.481123:0:54742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093566.481734:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024173952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093566.481770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093566.481878:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024173952 00000100:00100000:2.0:1784093566.481884:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024173952 00010000:00010000:2.0:1784093566.481904:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9115 expref: 19 pid: 5772 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093566.481936:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1784093566.481944:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024173952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093566.481953:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093566.481958:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9115 expref: 19 pid: 5772 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.481968:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9115 expref: 19 pid: 5772 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.481978:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40000/0x9ce98053214c911c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9115 expref: 19 pid: 5772 timeout: 877 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.481990:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.481998:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482010:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482032:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482040:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482047:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482052:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093566.482056:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482064:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482080:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093566.482091:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093566.482102:0:54742:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093566.482112:0:54742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093566.482129:0:54742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214c91af lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093566.482135:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024173952:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093566.482142:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784093566.482207:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024173952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093566.953844:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024174080:0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.953959:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024174336:0@lo:400:kworker.0 00000100:00100000:1.0:1784093566.954028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093566.954058:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093566.954090:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024174464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093566.954121:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174080 00000100:00100000:2.0:1784093566.954131:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174080 00000100:00100000:0.0:1784093566.954139:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174208 00000100:00100000:0.0:1784093566.954144:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174208 00000100:00100000:2.0:1784093566.954181:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1784093566.954183:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174336 00000100:00100000:0.0:1784093566.954187:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174336 00000100:00100000:2.0:1784093566.954208:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024174080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954221:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1784093566.954230:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024174208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093566.954266:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024174080:12345-0@lo:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093566.954281:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024174208:12345-0@lo:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093566.954287:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1784093566.954295:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1784093566.954297:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024174080:0@lo:400:kworker.0 00000100:00100000:1.0:1784093566.954310:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024174592:0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1784093566.954330:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024174336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093566.954344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093566.954360:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174592 00000100:00100000:2.0:1784093566.954365:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174592 00000100:00100000:0.0:1784093566.954378:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024174336:12345-0@lo:400:kworker.0 Request processed in 49us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093566.954386:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1784093566.954393:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1784093566.954403:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024174592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954418:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174464 00000100:00080000:1.0:1784093566.954446:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093566.954452:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174464 00000100:00100000:2.0:1784093566.954473:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024174592:12345-0@lo:400:kworker.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093566.954481:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1784093566.954496:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174720 00000100:00100000:1.0:1784093566.954501:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024174592:0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954508:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174720 00000100:00080000:2.0:1784093566.954512:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093566.954528:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1784093566.954534:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093566.954544:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024174464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954556:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784093566.954564:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024174720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954607:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024174720:12345-0@lo:400:kworker.0 Request processed in 44us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093566.954614:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784093566.954669:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024174464:12345-0@lo:400:kworker.0 Request processed in 132us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093566.954669:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024174336:0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954681:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024174848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093566.954683:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784093566.954707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093566.954752:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024174848 00000100:00100000:0.0:1784093566.954757:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024174848 00000100:00100000:2.0:1784093566.954758:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024174720:0@lo:400:kworker.0 00000100:00100000:1.0:1784093566.954759:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024174464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093566.954792:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784093566.954920:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024174848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093566.954943:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093566.954977:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024174848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093566.954982:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784093566.955702:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024174848:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1784093567.657489:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093567.657496:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093567.657506:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093567.657545:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.657557:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.657568:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093567.657593:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024174976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093567.657683:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093567.657778:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784093567.658095:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024174976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093567.658116:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.658126:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093567.658147:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093567.658153:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.658161:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093567.687924:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093567.691183:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093567.691258:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013612288 00000100:00100000:2.0:1784093567.691268:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013612288 00000100:00100000:2.0:1784093567.691325:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 313 00000100:00100000:2.0:1784093567.691334:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:33303:x1870757013612288:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093567.691382:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093567.691409:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c91cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5404 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.691442:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9138) 00010000:00010000:2.0:1784093567.691447:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784093567.691460:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093567.691493:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.691506:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.691524:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093567.711405:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967428 is committed 00000004:00080000:1.0:1784093567.711506:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 23 committed 00000001:00080000:1.0:1784093567.711535:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967429 is committed 00000100:00100000:1.0:1784093567.711667:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024175104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784093567.711716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784093567.711925:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.711939:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.711946:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.711952:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093567.711956:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.711964:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.711977:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093567.711980:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093567.711984:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.711990:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c91d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093567.712021:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024175104 00000100:00100000:2.0:1784093567.712028:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024175104 00000100:00100000:2.0:1784093567.712069:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784093567.712079:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024175104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784093567.712116:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:11 count 1 00010000:00010000:2.0:1784093567.712201:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c91d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.712283:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.712292:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093567.712296:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093567.712301:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c91d9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.712327:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093567.712342:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 6 pid: 53396 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093567.712354:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024175232:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093567.712398:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784093567.714650:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024175232:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093567.714651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:2.0:1784093567.714680:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c91d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093567.714696:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013612416 00000100:00100000:1.0:1784093567.714703:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013612416 00010000:00010000:1.0:1784093567.714743:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 7 pid: 53396 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093567.714769:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 195 00000100:00100000:1.0:1784093567.714778:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013612416:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093567.714791:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093567.714796:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 7 pid: 53396 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.714809:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 7 pid: 53396 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.714829:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214c918c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf53fd expref: 7 pid: 53396 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.714842:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093567.714845:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093567.714850:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c91d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093567.714872:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c91d9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784093567.714885:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784093567.714907:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093567.714982:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013612416:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 201us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093567.714994:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 195 00000004:00080000:1.0:1784093567.715611:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d705f80/2, rc 0, transno 4294967318 00000100:00100000:1.0:1784093567.715621:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024175104:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1784093568.054864:0:54937:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf13f3210 20000000:00000080:2.0:1784093568.054880:0:54937:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df4400 uarg=0000000000000000 00010000:00010000:2.0:1784093568.055303:0:54937:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093568.055317:0:54937:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093568.055329:0:54937:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093568.055347:0:54937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093568.055363:0:54937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093568.055371:0:54937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093568.055411:0:54937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093568.055464:0:54937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 18 pid: 5770 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093568.055479:0:54937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:54937:1870757024175360:0@lo:104: 00000100:00100000:2.0:1784093568.055542:0:54937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093568.055587:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024175360 00000100:00100000:2.0:1784093568.055595:0:54937:0:(client.c:2702:ptlrpc_set_wait()) set ffff907201254600 going to sleep for 11 seconds 00000100:00100000:0.0:1784093568.055595:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024175360 00000100:00100000:0.0:1784093568.055651:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784093568.055661:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:54937:x1870757024175360:12345-0@lo:104: 00010000:00010000:0.0:1784093568.055674:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093568.055746:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093568.055760:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:54937:x1870757024175360:12345-0@lo:104: Request processed in 101us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093568.055771:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00010000:1.0:1784093568.055786:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093568.055795:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.055803:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093568.055807:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.055814:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093568.055821:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093568.055826:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093568.055865:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.055884:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093568.055916:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.055923:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c91b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c91bd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093568.055936:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024175488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093568.055940:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093568.055942:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093568.055944:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093568.055977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093568.056046:0:54937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:54937:1870757024175360:0@lo:104: 00010000:00010000:2.0:1784093568.056064:0:54937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093568.056113:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024175488 00000100:00100000:1.0:1784093568.056118:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024175488 00010000:00010000:1.0:1784093568.056138:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 19 pid: 5770 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093568.056171:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784093568.056178:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024175488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093568.056190:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093568.056195:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 19 pid: 5770 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056205:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 19 pid: 5770 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056218:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c91bd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c91b6 expref: 19 pid: 5770 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056229:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056248:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056260:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056266:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056273:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056279:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056284:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093568.056288:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056294:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056314:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093568.056331:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093568.056340:0:54937:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093568.056351:0:54937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093568.056365:0:54937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214c91e0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093568.056381:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024175488:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093568.056389:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784093568.056497:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024175488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093568.491076:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093568.514740:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1784093568.514758:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:1.0:1784093569.001681:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024175616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093569.001748:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093569.001799:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024175616 00000100:00100000:2.0:1784093569.001807:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024175616 00000100:00100000:2.0:1784093569.001935:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784093569.001947:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024175616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093569.001981:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093569.002045:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024175616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093569.002053:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784093569.315653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093569.315758:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013612544 00000100:00100000:2.0:1784093569.315766:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013612544 00000100:00100000:2.0:1784093569.315896:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 314 00000100:00100000:2.0:1784093569.315906:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:33379:x1870757013612544:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093569.315925:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093569.315943:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c91e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf540b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.315992:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316003:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316012:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316030:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316035:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316039:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316392:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c91fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316399:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c91fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316403:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c91fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093569.316524:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:2.0:1784093569.316528:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093569.316661:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c91fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316674:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316680:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316686:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316703:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093569.316707:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316714:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316726:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784093569.316729:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.316734:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316740:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c91ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316755:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316761:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316768:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316773:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093569.316777:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316784:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316805:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781800) 00010000:00010000:2.0:1784093569.316807:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.316811:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316817:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c91f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316855:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c91e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf540b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316880:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c91fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf540b expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.316887:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093569.316890:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093569.316892:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784093569.316959:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:33379:x1870757013612544:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1052us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093569.316969:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 314 00000100:00100000:0.0:1784093569.318629:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093569.321299:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013612928 00000100:00100000:2.0:1784093569.321308:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013612928 00000100:00100000:2.0:1784093569.321355:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 316 00000100:00100000:2.0:1784093569.321368:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:33379:x1870757013612928:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093569.321384:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093569.321400:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5419 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321676:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321689:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321698:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321713:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321719:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321725:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321922:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321930:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321936:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321942:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093569.321946:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321961:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321970:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093569.321973:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.321976:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321981:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c921f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321991:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.321996:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322001:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322005:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093569.322007:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322012:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322018:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff90721a781700) 00010000:00010000:2.0:1784093569.322020:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.322022:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322051:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9226 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322091:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9218 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5419 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322101:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093569.322103:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.322106:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5419 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.322114:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784093569.322172:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:33379:x1870757013612928:12345-192.168.204.57@tcp:101:touch.0 Request processed in 808us (924us total) trans 0 rc 301/301 00000100:00100000:2.0:1784093569.322179:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 316 00000100:00100000:0.0:1784093569.324371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093569.324591:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013613056 00000100:00100000:2.0:1784093569.324608:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013613056 00000100:00100000:2.0:1784093569.324693:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 317 00000100:00100000:2.0:1784093569.324703:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:33379:x1870757013613056:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093569.324721:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093569.324739:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c922d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5420 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324798:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324812:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324835:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324847:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324853:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324857:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324983:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324988:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324992:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.324995:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093569.324998:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325002:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325010:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093569.325013:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.325015:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325023:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325030:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325034:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325037:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325040:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093569.325042:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325045:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325049:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff90721a781800) 00010000:00010000:2.0:1784093569.325050:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.325052:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325055:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c923b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325075:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c922d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5420 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325088:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093569.325090:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093569.325092:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c922d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5420 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093569.325098:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093569.325173:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:33379:x1870757013613056:12345-192.168.204.57@tcp:101:touch.0 Request processed in 472us (807us total) trans 0 rc 301/301 00000100:00100000:2.0:1784093569.325178:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 317 00000020:00000080:1.0:1784093570.084323:0:55182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf9511e00 20000000:00000080:1.0:1784093570.084337:0:55182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907202c2d400 uarg=0000000000000000 00010000:00010000:1.0:1784093570.084560:0:55182:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093570.084600:0:55182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781d00) 00010000:00010000:1.0:1784093570.084604:0:55182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093570.084612:0:55182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c91fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf540b expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084630:0:55182:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093570.084640:0:55182:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093570.084652:0:55182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084662:0:55182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084669:0:55182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084674:0:55182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084677:0:55182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084681:0:55182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084690:0:55182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093570.084694:0:55182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084699:0:55182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084705:0:55182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084710:0:55182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093570.084713:0:55182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214c9242 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093570.090591:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093570.090598:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093570.090602:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093570.090659:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76e00/0x9ce98053214c9249 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093570.090672:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76e00/0x9ce98053214c9249 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093570.090683:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76e00/0x9ce98053214c9249 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093570.090710:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024175744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093570.090788:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093570.090835:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093570.091151:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024175744 00000100:00100000:2.0:1784093570.091160:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024175744 00000100:00100000:2.0:1784093570.091231:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1784093570.091241:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024175744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093570.091255:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093570.091269:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9249 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093570.091294:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9249 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093570.091307:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9249 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093570.091317:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784093570.091369:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024175744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093570.091387:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1784093571.372651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:2.0:1784093571.373339:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093571.375723:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013613440 00000100:00100000:2.0:1784093571.375731:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013613440 00000100:00100000:2.0:1784093571.375775:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 319 00000100:00100000:2.0:1784093571.375781:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:33465:x1870757013613440:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093571.375814:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093571.375831:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c925e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5427 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093571.375842:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c91fc) 00010000:00010000:2.0:1784093571.375844:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784093571.375851:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093571.375867:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093571.375875:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093571.375882:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093571.376241:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d46cf9b7 reply state 0000000006e629b6 transno 4294967430 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214c9265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093571.376249:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784093571.376311:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000100:00100000:2.0:1784093571.376370:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:33465:x1870757013613440:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 587us (695us total) trans 4294967430 rc 0/0 00000100:00100000:2.0:1784093571.376388:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 319 00000100:00100000:1.0:1784093571.449264:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013613568 00000100:00100000:1.0:1784093571.449275:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013613568 00000100:00100000:1.0:1784093571.449339:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00100000:1.0:1784093571.449351:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013613568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093571.449458:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013613568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 109us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093571.449464:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00100000:0.0:1784093571.449975:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013613696 00000100:00100000:0.0:1784093571.449981:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013613696 00000100:00100000:0.0:1784093571.450034:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 273 00000100:00100000:0.0:1784093571.450043:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013613696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093571.450085:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013613696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093571.450092:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 273 00000100:00080000:2.0:1784093571.450173:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093571.450235:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:2.0:1784093571.450654:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093571.561734:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093571.743791:0:55379:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6f377ac0 20000000:00000080:0.0:1784093571.743806:0:55379:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062cc00 uarg=0000000000000000 00010000:00010000:0.0:1784093571.744010:0:55379:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093571.744024:0:55379:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093571.744037:0:55379:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093571.744054:0:55379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744070:0:55379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9249 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744078:0:55379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744114:0:55379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9249 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744128:0:55379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9249 expref: 18 pid: 5771 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093571.744143:0:55379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:55379:1870757024175872:0@lo:104: 00000100:00100000:0.0:1784093571.744192:0:55379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093571.744245:0:55379:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784093571.744261:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024175872 00000100:00100000:1.0:1784093571.744268:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024175872 00000100:00100000:1.0:1784093571.744324:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784093571.744342:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:55379:x1870757024175872:12345-0@lo:104: 00010000:00010000:1.0:1784093571.744354:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76e00/0x9ce98053214c9249 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9250 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093571.744450:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093571.744458:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:55379:x1870757024175872:12345-0@lo:104: Request processed in 117us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093571.744466:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784093571.744470:0:55379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:55379:1870757024175872:0@lo:104: 00010000:00010000:0.0:1784093571.744490:0:55379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093571.744631:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024176000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093571.744669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093571.744758:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024176000 00000100:00100000:0.0:1784093571.744763:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024176000 00010000:00010000:0.0:1784093571.744785:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9249 expref: 19 pid: 5771 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093571.744854:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784093571.744862:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024176000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093571.744872:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093571.744878:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9249 expref: 19 pid: 5771 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744888:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9249 expref: 19 pid: 5771 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744899:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214c9250 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9249 expref: 19 pid: 5771 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744912:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744917:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744926:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744930:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744935:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744939:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744950:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093571.744952:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744957:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744971:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093571.744978:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784093571.745005:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024176000:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093571.745011:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00010000:1.0:1784093571.745012:0:55379:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093571.745034:0:55379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093571.745042:0:55379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214c926c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 55379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093572.073756:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024176128:0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.073866:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024176384:0@lo:400:kworker.0 00000100:00100000:0.0:1784093572.073867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093572.073913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093572.073947:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024176896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093572.073983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093572.073990:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024176640:0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.074013:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784093572.074022:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024176256:0@lo:400:kworker.0 00000100:00100000:0.0:1784093572.074038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093572.074063:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024176384 00000100:00100000:2.0:1784093572.074068:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024176384 00000100:00100000:0.0:1784093572.074103:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024176128 00000100:00100000:0.0:1784093572.074108:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024176128 00000100:00100000:2.0:1784093572.074115:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024176640 00000100:00100000:2.0:1784093572.074121:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024176640 00000100:00100000:2.0:1784093572.074155:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1784093572.074163:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1784093572.074168:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024176384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093572.074184:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.074220:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024176384:12345-0@lo:400:kworker.0 Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093572.074233:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1784093572.074247:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024176128:12345-0@lo:400:kworker.0 Request processed in 63us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093572.074253:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1784093572.074261:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1784093572.074265:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024176640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.074315:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024176640:12345-0@lo:400:kworker.0 Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093572.074317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093572.074331:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1784093572.074349:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024176768:0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.074356:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024176256 00000100:00100000:2.0:1784093572.074361:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024176256 00000100:00100000:0.0:1784093572.074398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093572.074448:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024176768 00000100:00100000:2.0:1784093572.074452:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024176768 00000100:00100000:0.0:1784093572.074461:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024176384:0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.074483:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784093572.074486:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024176896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093572.074495:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024176768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093572.074520:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024176256:0@lo:400:kworker.0 00000100:00100000:0.0:1784093572.074541:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024176768:0@lo:400:kworker.0 00000100:00100000:2.0:1784093572.074542:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024176768:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093572.074576:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784093572.074595:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024176128:0@lo:400:kworker.0 00000100:00100000:0.0:1784093572.074609:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024176640:0@lo:400:kworker.0 00000100:00100000:0.0:1784093573.009949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:0.0:1784093573.010084:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093573.011476:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013614080 00000100:00100000:2.0:1784093573.011481:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013614080 00000100:00100000:2.0:1784093573.011557:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 147 00000100:00100000:2.0:1784093573.011568:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614080:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784093573.011575:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093573.011835:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614080:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 270us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093573.011839:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 147 00000100:00100000:0.0:1784093573.012829:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093573.012871:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013614208 00000100:00100000:2.0:1784093573.012877:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013614208 00000100:00080000:0.0:1784093573.012919:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093573.012931:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 148 00000100:00100000:2.0:1784093573.012951:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614208:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093573.013132:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614208:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 194us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093573.013137:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 148 00000100:00100000:0.0:1784093573.014469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093573.017967:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093573.018017:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013614464 00000100:00100000:2.0:1784093573.018027:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013614464 00000100:00100000:2.0:1784093573.018078:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 322 00000100:00100000:2.0:1784093573.018089:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:33550:x1870757013614464:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093573.018192:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:33550:x1870757013614464:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093573.018200:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 322 00000100:00100000:0.0:1784093573.020235:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093573.020325:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013614592 00000100:00100000:2.0:1784093573.020334:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013614592 00000100:00100000:2.0:1784093573.020375:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 149 00000100:00100000:2.0:1784093573.020382:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614592:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093573.020751:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614592:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 368us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093573.020759:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 149 00000100:00100000:0.0:1784093573.022769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093573.022814:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013614720 00000100:00100000:2.0:1784093573.022824:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013614720 00000100:00100000:2.0:1784093573.022872:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 150 00000100:00100000:2.0:1784093573.022882:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614720:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093573.023200:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:33550:x1870757013614720:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 319us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093573.023208:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 150 00000100:00100000:0.0:1784093573.024363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093573.052506:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093573.052614:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013614976 00000100:00100000:2.0:1784093573.052624:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013614976 00000100:00100000:2.0:1784093573.052718:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 324 00000100:00100000:2.0:1784093573.052729:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:33554:x1870757013614976:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784093573.052749:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093573.052772:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c9273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf542e expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.052834:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.052862:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.052876:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.052888:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.052895:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.052901:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053340:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9288 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053349:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053357:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093573.053415:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:2.0:1784093573.053419:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093573.053504:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9288 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053518:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053544:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053551:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053558:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093573.053562:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053569:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053581:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093573.053584:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093573.053588:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053595:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c927a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053608:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053613:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053619:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053625:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093573.053633:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053639:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053646:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781a00) 00010000:00010000:2.0:1784093573.053648:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093573.053651:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053656:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053685:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c9273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf542e expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053700:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9288 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf542e expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.053706:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784093573.053709:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093573.053711:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784093573.053775:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:33554:x1870757013614976:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1048us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093573.053783:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 324 00000100:00100000:0.0:1784093573.057026:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093573.057095:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013615232 00000100:00100000:2.0:1784093573.057109:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013615232 00000100:00100000:2.0:1784093573.057181:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 325 00000100:00100000:2.0:1784093573.057191:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:33554:x1870757013615232:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784093573.057244:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093573.057276:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c928f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5435 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.057719:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.057738:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.057751:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.057767:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.057774:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.057781:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093573.058729:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb:0x0], index 1: 0 00010000:00010000:2.0:1784093573.058995:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c92a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059006:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c92a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059016:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c92a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059074:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059081:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059088:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059095:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093573.059100:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059109:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059123:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784093573.059126:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093573.059130:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059134:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9296 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093573.059149:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000daf2b319 reply state 00000000db68edc9 transno 4294967431 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093573.059156:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093573.059186:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c928f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5435 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059206:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c92a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5435 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.059214:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1c:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784093573.059216:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093573.059219:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093573.059315:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:33554:x1870757013615232:12345-192.168.204.57@tcp:101:dd.0 Request processed in 2124us (2298us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1784093573.059325:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 325 00010000:00010000:2.0:1784093573.060939:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.060953:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.060958:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.060963:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093573.060966:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.060971:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.060980:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff90721a781300) 00010000:00010000:2.0:1784093573.060982:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093573.060985:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093573.060996:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c929d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093573.063945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093573.075735:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013615488 00000100:00100000:1.0:1784093573.075749:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013615488 00002000:00100000:1.0:1784093573.075818:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->1048575) req@ffff9071026bc380 x1870757013615488/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:649/0 lens 488/0 e 0 to 0 dl 1784093584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093573.075830:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9071026bc380 with x1870757013615488 ext(0->1048575) 00002000:00010000:1.0:1784093573.075837:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9071026bc380 00000100:00100000:1.0:1784093573.075993:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 6 00000100:00100000:1.0:1784093573.076005:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013615488:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784093573.087412:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013615488:12345-192.168.204.57@tcp:4:dd.0 Request processed in 11401us (11822us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784093573.087441:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 6 00002000:00100000:1.0:1784093573.087462:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->1048575) req@ffff9071026bc380 x1870757013615488/t4294967317(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:649/0 lens 488/448 e 0 to 0 dl 1784093584 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093573.087473:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9071026bc380 with x1870757013615488 ext(0->1048575) 00002000:00010000:1.0:1784093573.087480:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9071026bc380 00000100:00100000:0.0:1784093573.089778:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013615616 00000100:00100000:0.0:1784093573.089788:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013615616 00000100:00100000:0.0:1784093573.089845:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 326 00000100:00100000:0.0:1784093573.089855:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:33554:x1870757013615616:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:1.0:1784093573.109204:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000100:00100000:2.0:1784093573.112069:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013615744 00000100:00100000:2.0:1784093573.112079:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013615744 00000100:00100000:2.0:1784093573.112129:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 152 00000100:00100000:2.0:1784093573.112139:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013615744:12345-192.168.204.57@tcp:16:dd.0 00000001:00080000:2.0:1784093573.126980:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:0.0:1784093573.129662:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093573.129733:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013616000 00000100:00100000:1.0:1784093573.129743:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013616000 00000100:00100000:1.0:1784093573.129799:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 37 00000100:00100000:1.0:1784093573.129810:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:33554:x1870757013616000:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:1.0:1784093573.130413:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:33554:x1870757013616000:12345-192.168.204.57@tcp:35:dd.0 Request processed in 604us (756us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1784093573.130456:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 37 10000000:01000000:0.0:1784093573.225553:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093573.225560:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093573.225565:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093573.225611:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214c92b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093573.225623:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214c92b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093573.225633:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214c92b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093573.225658:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024177024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093573.225727:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093573.225794:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784093573.225953:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024177024 00000100:00100000:1.0:1784093573.225961:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024177024 00000100:00100000:1.0:1784093573.226011:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1784093573.226021:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024177024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093573.226035:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093573.226047:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c92b9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093573.226068:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093573.226078:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093573.226086:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093573.226148:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024177024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093573.226154:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000001:00080000:1.0:1784093573.663082:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000100:00100000:2.0:1784093574.122217:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024177152 00000100:00100000:2.0:1784093574.122226:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024177152 00000100:00080000:0.0:1784093574.122279:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093574.122294:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784093574.122303:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024177152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093574.122335:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093574.122396:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024177152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093574.122404:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000004:00080000:2.0:1784093574.197918:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 24 committed 00000004:00080000:2.0:1784093574.198648:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00010000:00010000:1.0:1784093574.634533:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093574.848625:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093574.848729:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013616128 00000100:00100000:0.0:1784093574.848740:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013616128 00000100:00100000:0.0:1784093574.848836:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 327 00000100:00100000:0.0:1784093574.848848:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:33746:x1870757013616128:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093574.848972:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:33746:x1870757013616128:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 126us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093574.848980:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 327 00000100:00100000:2.0:1784093574.851324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093574.853048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093574.854752:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013616512 00000100:00100000:0.0:1784093574.854759:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013616512 00000100:00100000:0.0:1784093574.854886:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 328 00000100:00100000:0.0:1784093574.854895:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:33746:x1870757013616512:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093574.855206:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:33746:x1870757013616512:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 312us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093574.855213:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 328 00000100:00100000:0.0:1784093574.858970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093574.863258:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093574.867570:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013616896 00000100:00100000:0.0:1784093574.867579:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013616896 00000100:00100000:0.0:1784093574.867630:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 156 00000100:00100000:0.0:1784093574.867640:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:33746:x1870757013616896:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093574.868090:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:33746:x1870757013616896:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 450us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093574.868097:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 156 00000100:00100000:0.0:1784093574.871057:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093574.871579:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013617024 00000100:00100000:1.0:1784093574.871589:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013617024 00000100:00100000:1.0:1784093574.871634:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:1.0:1784093574.871645:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:33746:x1870757013617024:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093574.873111:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:33746:x1870757013617024:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 1463us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093574.873122:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:1.0:1784093574.897507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093574.897674:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013617280 00000100:00100000:0.0:1784093574.897688:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013617280 00000100:00100000:0.0:1784093574.897792:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 331 00000100:00100000:0.0:1784093574.897804:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:33750:x1870757013617280:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093574.897878:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093574.897914:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c92a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5435 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.897943:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1c:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093574.897957:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093574.898105:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898129:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898155:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898205:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898214:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898222:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898653:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898663:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.898671:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093574.899515:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8896 00000004:00080000:0.0:1784093574.899526:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 735977103887ns, next at 736977101821ns, rc = 0 00010000:00010000:0.0:1784093574.899633:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c92dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899644:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c92dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899652:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c92dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899669:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c92dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899675:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c92dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899681:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c92dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899709:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093574.899732:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899739:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899746:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899752:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093574.899756:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899764:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899776:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1c:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784093574.899779:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093574.899783:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899799:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c92d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899815:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899821:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899827:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899832:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093574.899834:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899840:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899849:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781600) 00010000:00010000:0.0:1784093574.899851:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093574.899854:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093574.899859:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c92c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093574.899867:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000093534ef reply state 000000001143327b transno 4294967433 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093574.899877:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093574.899977:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:33750:x1870757013617280:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2172us (2495us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1784093574.899986:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 331 00010000:00010000:2.0:1784093574.901389:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093574.901406:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093574.901412:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093574.901464:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093574.901468:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093574.901475:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093574.901485:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907202e6b200) 00010000:00010000:2.0:1784093574.901488:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093574.901504:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093574.901510:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c92ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093575.817211:0:55770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 736894786781ns, next at 727840435113ns, rc = 0 00000004:00080000:1.0:1784093575.817321:0:55770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 736894898096ns, next at 736977101821ns, rc = 0 00000100:00100000:2.0:1784093575.835520:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024177280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784093575.835576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784093575.835793:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093575.838033:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093575.838171:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013617408 00000100:00100000:1.0:1784093575.838237:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013617408 00010000:00010000:1.0:1784093575.838365:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c92b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf543c expref: 6 pid: 53396 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784093575.838402:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093575.838404:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 198 00000100:00100000:1.0:1784093575.838417:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013617408:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093575.838461:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093575.838468:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c92b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf543c expref: 6 pid: 53396 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093575.838512:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c92b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf543c expref: 6 pid: 53396 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093575.838551:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214c92b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf543c expref: 6 pid: 53396 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093575.838568:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093575.838572:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093575.838578:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093575.838587:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093575.838615:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093575.838676:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013617408:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 258us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093575.838694:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 198 00000004:00080000:2.0:1784093575.839596:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237376300/2, rc 0, transno 4294967318 00000100:00100000:2.0:1784093575.839664:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024177280:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1784093575.839760:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093575.839768:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093575.839776:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093575.839780:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093575.839789:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093575.839802:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093575.839809:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214c92e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093575.839825:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093575.839826:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093575.839828:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093576.569736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093576.569781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093576.569810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093576.569856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093576.569865:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013617536 00000100:00100000:0.0:1784093576.569871:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013617536 00000100:00100000:1.0:1784093576.569886:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013617920 00000100:00100000:1.0:1784093576.569892:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013617920 00000100:00100000:2.0:1784093576.569920:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013617664 00000100:00100000:2.0:1784093576.569926:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013617664 00000100:00100000:0.0:1784093576.569931:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:1.0:1784093576.569943:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 278 00000100:00100000:0.0:1784093576.569949:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013617536:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093576.569961:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013617920:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093576.569972:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:2.0:1784093576.569985:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013617664:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093576.570029:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013617536:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093576.570040:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:2.0:1784093576.570052:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013617664:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093576.570052:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013617920:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093576.570069:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:1.0:1784093576.570074:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 278 00010000:00010000:1.0:1784093576.682061:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093577.193655:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024177664:0@lo:400:kworker.0 00000100:00100000:1.0:1784093577.193710:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024177920:0@lo:400:kworker.0 00000100:00100000:2.0:1784093577.193752:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093577.193760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093577.193837:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024178176:0@lo:400:kworker.0 00000100:00100000:1.0:1784093577.193837:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093577.193839:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024177664 00000100:00100000:0.0:1784093577.193848:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024177664 00000100:00100000:1.0:1784093577.193850:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024178304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093577.193877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093577.193892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093577.193911:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1784093577.193926:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024177664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093577.193937:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024177536 00000100:00100000:2.0:1784093577.193942:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024177536 00000100:00100000:1.0:1784093577.193948:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024178048 00000100:00100000:1.0:1784093577.193954:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024178048 00000100:00100000:2.0:1784093577.193979:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1784093577.193990:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024177536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093577.193996:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024177664:12345-0@lo:400:kworker.0 Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093577.194007:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1784093577.194016:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1784093577.194021:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024178048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093577.194043:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024177536:12345-0@lo:400:kworker.0 Request processed in 54us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093577.194052:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1784093577.194076:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024177664:0@lo:400:kworker.0 00000100:00100000:1.0:1784093577.194077:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024178048:12345-0@lo:400:kworker.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093577.194091:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1784093577.194093:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024177920 00000100:00100000:2.0:1784093577.194099:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024177920 00000100:00100000:2.0:1784093577.194131:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024178176 00000100:00100000:2.0:1784093577.194134:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024178176 00000100:00080000:0.0:1784093577.194134:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093577.194142:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093577.194143:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00080000:0.0:1784093577.194148:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093577.194157:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024177920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093577.194170:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784093577.194182:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024178304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093577.194201:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024177920:12345-0@lo:400:kworker.0 Request processed in 47us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093577.194208:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024177920:0@lo:400:kworker.0 00000100:00100000:0.0:1784093577.194273:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024177792 00000100:00100000:0.0:1784093577.194285:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024177792 00000100:00100000:0.0:1784093577.194321:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1784093577.194329:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024177792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093577.194357:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024177792:12345-0@lo:400:kworker.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093577.194362:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1784093577.194710:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784093577.194716:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024178176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093577.194765:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024178176:12345-0@lo:400:kworker.0 Request processed in 54us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093577.194772:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784093577.194804:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024178176:0@lo:400:kworker.0 00000100:00100000:1.0:1784093579.242731:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024178432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093579.242800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093579.242905:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024178432 00000100:00100000:2.0:1784093579.242913:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024178432 00000100:00100000:2.0:1784093579.242970:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784093579.242978:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024178432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093579.243008:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093579.243050:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024178432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093579.243054:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1784093579.243615:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024178432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093579.753591:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784093580.279706:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00010000:00010000:1.0:1784093580.778319:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093581.689238:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618048 00000100:00100000:1.0:1784093581.689250:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618048 00000100:00100000:0.0:1784093581.689250:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618304 00000100:00100000:0.0:1784093581.689257:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618304 00000100:00100000:1.0:1784093581.689310:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 550 00000100:00100000:0.0:1784093581.689311:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:1.0:1784093581.689327:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013618048:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093581.689327:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013618304:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093581.689410:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013618304:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093581.689419:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:2.0:1784093581.689507:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618176 00000100:00100000:2.0:1784093581.689512:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618176 00000100:00100000:2.0:1784093581.689554:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:2.0:1784093581.689563:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013618176:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784093581.689660:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093581.689670:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093581.689700:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013618048:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 377us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093581.689709:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 550 00000100:00100000:2.0:1784093581.690321:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013618176:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 756us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093581.690330:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:0.0:1784093581.690536:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618432 00000100:00100000:0.0:1784093581.690542:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618432 00000100:00100000:0.0:1784093581.690591:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 282 00000100:00100000:0.0:1784093581.690599:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013618432:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093581.690646:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013618432:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093581.690653:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 282 00000100:00100000:2.0:1784093582.314516:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024178816:0@lo:400:kworker.0 00000100:00100000:0.0:1784093582.314564:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024179072:0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.314591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093582.314591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093582.314623:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024178944:0@lo:400:kworker.0 00000100:00100000:1.0:1784093582.315894:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093582.315902:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024179328:0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.315938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093582.315960:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179072 00000100:00100000:2.0:1784093582.315968:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093582.315968:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179072 00000100:00100000:2.0:1784093582.315975:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024179200:0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.316000:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093582.316027:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179328 00000100:00100000:2.0:1784093582.316044:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024178816 00000100:00100000:2.0:1784093582.316048:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024178816 00000100:00100000:2.0:1784093582.316080:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024178944 00000100:00100000:2.0:1784093582.316083:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024178944 00000100:00100000:1.0:1784093582.316093:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179328 00000100:00100000:2.0:1784093582.316111:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179200 00000100:00100000:2.0:1784093582.316116:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179200 00000100:00100000:1.0:1784093582.316139:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1784093582.316145:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1784093582.316153:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024179072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.316158:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093582.316178:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1784093582.316189:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024178944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093582.316235:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024179072:12345-0@lo:400:kworker.0 Request processed in 84us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093582.316243:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024178944:12345-0@lo:400:kworker.0 Request processed in 54us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093582.316249:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784093582.316257:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1784093582.316273:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784093582.316281:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024179328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093582.316325:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024179328:12345-0@lo:400:kworker.0 Request processed in 44us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093582.316336:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024178816:12345-0@lo:400:kworker.0 Request processed in 180us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093582.316340:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784093582.316361:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1784093582.316383:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1784093582.316402:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024179200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.316471:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024179200:12345-0@lo:400:kworker.0 Request processed in 72us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093582.316480:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:2.0:1784093582.316539:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024179200:0@lo:400:kworker.0 00000100:00100000:1.0:1784093582.316539:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024179072:0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.316560:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1784093582.316566:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237376300, transno 4294967318 00000100:00100000:2.0:1784093582.316580:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024179328:0@lo:400:kworker.0 00000100:00100000:1.0:1784093582.316589:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024178944:0@lo:400:kworker.0 00000100:00100000:2.0:1784093582.316600:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024178816:0@lo:400:kworker.0 00010000:00010000:0.0:1784093583.849584:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093584.361773:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024179456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093584.361868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093584.362027:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179456 00000100:00100000:2.0:1784093584.362034:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179456 00000100:00100000:2.0:1784093584.362098:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784093584.362108:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024179456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093584.362151:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093584.362200:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024179456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093584.362205:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784093584.362613:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024179456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093584.873719:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093586.808874:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093586.808910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093586.808945:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618688 00000100:00100000:1.0:1784093586.808956:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618688 00000100:00100000:2.0:1784093586.808976:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618944 00000100:00100000:2.0:1784093586.808983:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618944 00000100:00100000:2.0:1784093586.809041:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 285 00000100:00100000:1.0:1784093586.809041:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 467 00000100:00100000:1.0:1784093586.809059:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013618688:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093586.809060:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013618944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093586.809062:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093586.809099:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093586.809138:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013618944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093586.809143:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013618688:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093586.809151:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 285 00000100:00100000:1.0:1784093586.809158:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 467 00000100:00100000:2.0:1784093586.809186:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013618816 00000100:00100000:2.0:1784093586.809190:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013618816 00000100:00080000:1.0:1784093586.809224:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093586.809231:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 286 00000100:00100000:2.0:1784093586.809239:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013618816:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093586.809290:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013618816:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093586.809296:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 286 00000100:00100000:1.0:1784093587.433758:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024179968:0@lo:400:kworker.0 00000100:00100000:0.0:1784093587.433759:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024179584:0@lo:400:kworker.0 00000100:00100000:0.0:1784093587.433987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093587.434024:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024179840:0@lo:400:kworker.0 00000100:00100000:1.0:1784093587.434032:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093587.434073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093587.434099:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024180352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093587.434106:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024180096:0@lo:400:kworker.0 00000100:00100000:2.0:1784093587.434123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093587.434123:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179968 00000100:00100000:1.0:1784093587.434133:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179968 00000100:00100000:0.0:1784093587.434160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093587.434178:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179712 00000100:00100000:2.0:1784093587.434182:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179712 00000100:00100000:2.0:1784093587.434224:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179840 00000100:00100000:1.0:1784093587.434226:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784093587.434228:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179840 00000100:00100000:0.0:1784093587.434241:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024179584 00000100:00100000:1.0:1784093587.434242:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024179968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093587.434252:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024179584 00000100:00100000:2.0:1784093587.434275:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024180096 00000100:00100000:2.0:1784093587.434279:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024180096 00000100:00100000:2.0:1784093587.434322:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1784093587.434333:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093587.434349:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1784093587.434354:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024179968:12345-0@lo:400:kworker.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093587.434369:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024179584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093587.434379:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024179712:12345-0@lo:400:kworker.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093587.434386:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1784093587.434401:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1784093587.434411:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024179840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093587.434488:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024179584:12345-0@lo:400:kworker.0 Request processed in 126us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093587.434498:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024179840:12345-0@lo:400:kworker.0 Request processed in 87us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093587.434501:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1784093587.434515:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1784093587.434536:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784093587.434555:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1784093587.434565:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024180096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093587.434586:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093587.434597:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093587.434603:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093587.434617:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024179584:0@lo:400:kworker.0 00000100:00100000:2.0:1784093587.434618:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024180096:12345-0@lo:400:kworker.0 Request processed in 52us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093587.434628:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1784093587.434639:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024179968:0@lo:400:kworker.0 00000100:00100000:2.0:1784093587.434662:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024179840:0@lo:400:kworker.0 00000100:00100000:2.0:1784093587.434676:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024180352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093587.434736:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024180096:0@lo:400:kworker.0 00010000:00010000:0.0:1784093587.945526:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093588.969758:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093589.481755:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093589.481781:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093589.481850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784093589.481964:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093589.482128:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093591.928724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093591.928767:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093591.928785:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013619200 00000100:00100000:0.0:1784093591.928796:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013619200 00000100:00100000:1.0:1784093591.928825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093591.928856:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013619456 00000100:00100000:2.0:1784093591.928862:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013619456 00000100:00100000:1.0:1784093591.928862:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093591.928886:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:1.0:1784093591.928895:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013619328 00000100:00100000:0.0:1784093591.928899:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013619200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093591.928901:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013619328 00000100:00100000:2.0:1784093591.928916:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 289 00000100:00100000:2.0:1784093591.928928:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013619456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093591.928943:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 290 00000100:00100000:1.0:1784093591.928956:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013619328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093591.928980:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013619456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093591.928981:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013619200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093591.928994:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:1.0:1784093591.928995:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013619328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093591.928998:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 289 00000100:00100000:1.0:1784093591.929010:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 290 00010000:00010000:0.0:1784093592.042390:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093592.553652:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024180736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093592.553727:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024180608:0@lo:400:kworker.0 00000100:00100000:0.0:1784093592.553727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093592.553793:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024181120:0@lo:400:kworker.0 00000100:00100000:1.0:1784093592.553830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093592.553885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024180864 00000100:00100000:2.0:1784093592.553894:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024180864 00000100:00100000:2.0:1784093592.553945:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1784093592.553951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093592.553998:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093592.554107:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024180864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093592.554169:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024180992:0@lo:400:kworker.0 00000100:00100000:1.0:1784093592.554171:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024181248:0@lo:400:kworker.0 00000100:00100000:0.0:1784093592.554212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093592.554223:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024181120 00000100:00100000:1.0:1784093592.554227:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024181120 00000100:00100000:0.0:1784093592.554262:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024180608 00000100:00100000:1.0:1784093592.554268:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024181376 00000100:00100000:0.0:1784093592.554268:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024180608 00000100:00100000:1.0:1784093592.554273:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024181376 00000100:00100000:1.0:1784093592.554303:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1784093592.554311:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1784093592.554314:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024181120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093592.554325:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024180608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093592.554368:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024181120:12345-0@lo:400:kworker.0 Request processed in 55us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093592.554375:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024180608:12345-0@lo:400:kworker.0 Request processed in 54us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093592.554379:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1784093592.554385:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1784093592.554402:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1784093592.554411:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024181376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093592.554454:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024180736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093592.554465:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024181120:0@lo:400:kworker.0 00000100:00100000:1.0:1784093592.554477:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024181376:12345-0@lo:400:kworker.0 Request processed in 67us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093592.554482:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784093592.554503:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093592.554523:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024180992 00000100:00100000:1.0:1784093592.554527:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024180992 00000100:00100000:0.0:1784093592.554530:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024180608:0@lo:400:kworker.0 00000100:00100000:1.0:1784093592.554550:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024181248 00000100:00100000:1.0:1784093592.554553:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024181248 00000100:00100000:0.0:1784093592.554564:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1784093592.554583:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024180992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093592.554621:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024180864:12345-0@lo:400:kworker.0 Request processed in 665us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093592.554650:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024180992:12345-0@lo:400:kworker.0 Request processed in 69us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093592.554659:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1784093592.554665:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1784093592.554675:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024181248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093592.554697:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024180992:0@lo:400:kworker.0 00000100:00100000:1.0:1784093592.554714:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024181248:12345-0@lo:400:kworker.0 Request processed in 41us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093592.554719:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1784093592.554725:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024181248:0@lo:400:kworker.0 00000100:00100000:2.0:1784093592.554938:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00010000:00010000:2.0:1784093593.065765:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093593.682897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:0.0:1784093593.683937:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093593.687018:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093593.687124:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013619712 00000100:00100000:2.0:1784093593.687152:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013619712 00000100:00100000:2.0:1784093593.687340:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 158 00000100:00100000:2.0:1784093593.687371:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013619712:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784093593.687945:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093593.688066:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013619712:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 696us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093593.688075:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 158 00000100:00100000:1.0:1784093593.689900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093593.689999:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013619840 00000100:00100000:2.0:1784093593.690011:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013619840 00000100:00100000:2.0:1784093593.690151:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 159 00000100:00100000:2.0:1784093593.690162:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013619840:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784093593.690404:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093593.690871:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013619840:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 710us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093593.690880:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 159 00000100:00100000:1.0:1784093593.695204:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093593.695478:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013619968 00000100:00100000:0.0:1784093593.695493:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013619968 00000100:00100000:0.0:1784093593.695566:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 333 00000100:00100000:0.0:1784093593.695577:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:34088:x1870757013619968:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093593.696159:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:34088:x1870757013619968:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 582us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093593.696168:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 333 00000100:00100000:0.0:1784093593.698735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093593.698814:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013620096 00000100:00100000:2.0:1784093593.698825:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013620096 00000100:00100000:2.0:1784093593.698926:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 334 00000100:00100000:2.0:1784093593.698937:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34088:x1870757013620096:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093593.699055:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34088:x1870757013620096:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 120us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093593.699063:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 334 00000100:00100000:1.0:1784093593.700475:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013620224 00000100:00100000:1.0:1784093593.700484:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013620224 00000100:00100000:1.0:1784093593.700540:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 160 00000100:00100000:1.0:1784093593.700552:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013620224:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093593.700944:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013620224:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 394us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093593.700960:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 160 00000100:00100000:0.0:1784093593.703809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093593.704131:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013620352 00000100:00100000:2.0:1784093593.704150:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013620352 00000100:00100000:2.0:1784093593.704200:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 161 00000100:00100000:2.0:1784093593.704211:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013620352:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093593.704524:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34088:x1870757013620352:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 315us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093593.704531:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 161 00000100:00100000:0.0:1784093593.705824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093594.602389:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093594.602411:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024181504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093594.602495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784093594.602597:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093594.602809:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024181504:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784093594.668627:0:56180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcefaa2ff0 20000000:00000080:0.0:1784093594.668645:0:56180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb15800 uarg=0000000000000000 00010000:00010000:0.0:1784093594.669075:0:56180:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093594.669150:0:56180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781600) 00010000:00010000:0.0:1784093594.669153:0:56180:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093594.669162:0:56180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9288 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf542e expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093594.669254:0:56180:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093594.669271:0:56180:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093594.669285:0:56180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093594.669297:0:56180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093594.669305:0:56180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093594.669339:0:56180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093594.669351:0:56180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 18 pid: 5770 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093594.669363:0:56180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56180:1870757024181632:0@lo:104: 00000100:00100000:0.0:1784093594.669418:0:56180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093594.669611:0:56180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071034846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093594.669926:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024181632 00000100:00100000:1.0:1784093594.669932:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024181632 00000100:00100000:1.0:1784093594.669970:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784093594.669979:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:56180:x1870757024181632:12345-0@lo:104: 00010000:00010000:1.0:1784093594.669991:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214c92b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c92c0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093594.670061:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093594.670067:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:56180:x1870757024181632:12345-0@lo:104: Request processed in 89us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093594.670085:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784093594.670098:0:56180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56180:1870757024181632:0@lo:104: 00010000:00010000:0.0:1784093594.670134:0:56180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093594.670312:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024181760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784093594.670339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093594.670443:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024181760 00000100:00100000:2.0:1784093594.670448:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024181760 00010000:00010000:2.0:1784093594.670468:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 19 pid: 5770 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093594.670489:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1784093594.670496:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024181760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093594.670506:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093594.670510:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 19 pid: 5770 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670520:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 19 pid: 5770 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670532:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214c92c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c92b9 expref: 19 pid: 5770 timeout: 905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670542:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670547:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670556:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670560:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670565:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670576:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670580:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093594.670582:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670588:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670600:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214c92ea lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093594.670609:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093594.670647:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024181760:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093594.670653:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784093594.670826:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024181760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093595.114496:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093596.038928:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013620608 00000100:00100000:0.0:1784093596.038939:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013620608 00000100:00080000:2.0:1784093596.038999:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093596.039013:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 336 00000100:00100000:0.0:1784093596.039038:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34174:x1870757013620608:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093596.039060:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093596.039125:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c92f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5443 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.039191:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214c92f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.039205:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214c92f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.039219:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214c92f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093596.039471:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:0.0:1784093596.039476:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093596.039564:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214c92f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.039590:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c92f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5443 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.039622:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214c92f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5443 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.039631:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784093596.039634:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093596.039637:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784093596.039705:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:34174:x1870757013620608:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 670us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093596.039712:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 336 00000100:00100000:1.0:1784093596.042919:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093596.042972:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013620864 00000100:00100000:1.0:1784093596.042995:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013620864 00000100:00100000:1.0:1784093596.043051:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 337 00000100:00100000:1.0:1784093596.043064:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34174:x1870757013620864:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093596.043123:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093596.043150:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214c92f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5443 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093596.043169:0:5809:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9288) 00010000:00010000:1.0:1784093596.043174:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6b100) 00010000:00010000:1.0:1784093596.043190:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093596.043216:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093596.043229:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093596.043240:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093596.058320:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00010000:0.0:1784093596.058376:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c7c82d75 reply state 0000000065cbbddc transno 4294967434 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093596.058390:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093596.058558:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00010000:00080000:0.0:1784093596.058646:0:5809:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093596.058663:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34174:x1870757013620864:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 15600us (15748us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1784093596.058673:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 337 00010000:00010000:2.0:1784093596.058753:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.058763:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.058771:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.058777:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093596.058782:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.058797:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.058812:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202d46900) 00010000:00010000:2.0:1784093596.058815:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093596.058820:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.058827:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c92ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.138510:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093596.420066:0:56377:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff3766d8a0 20000000:00000080:2.0:1784093596.420082:0:56377:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103cc00 uarg=0000000000000000 00010000:00010000:2.0:1784093596.420597:0:56377:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093596.420612:0:56377:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093596.420624:0:56377:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093596.420642:0:56377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420657:0:56377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420667:0:56377:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420673:0:56377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420679:0:56377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420693:0:56377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420700:0:56377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093596.420705:0:56377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420712:0:56377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420724:0:56377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420732:0:56377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093596.420738:0:56377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40a00/0x9ce98053214c9306 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093596.522477:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093596.522483:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093596.522488:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093596.522529:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.522544:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.522556:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093596.522588:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024181888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093596.522656:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093596.522705:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024181888 00000100:00100000:0.0:1784093596.522710:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071034849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093596.522713:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024181888 00000100:00100000:1.0:1784093596.522778:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1784093596.522857:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024181888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093596.522882:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093596.522895:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214c9314 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c930d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093596.522919:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214c9314 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c930d expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093596.522928:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13000/0x9ce98053214c9314 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c930d expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093596.522937:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093596.522997:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024181888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093596.523004:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1784093596.523029:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024181888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093596.523042:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.523050:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093596.523064:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093596.523068:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093596.523073:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093597.048804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.048869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.048924:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.048966:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.049009:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013621376 00000100:00100000:1.0:1784093597.049020:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013621376 00000100:00100000:0.0:1784093597.049027:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013621120 00000100:00100000:0.0:1784093597.049033:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013621120 00000100:00100000:1.0:1784093597.049108:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013621248 00000100:00100000:1.0:1784093597.049113:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013621248 00000100:00100000:1.0:1784093597.049156:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 293 00000100:00100000:1.0:1784093597.049173:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013621376:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093597.049198:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 475 00000100:00100000:0.0:1784093597.049215:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013621120:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093597.049244:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013621376:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093597.049253:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 293 00000100:00100000:0.0:1784093597.049268:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013621120:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 59us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093597.049277:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 294 00000100:00100000:0.0:1784093597.049282:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 475 00000100:00100000:1.0:1784093597.049302:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013621248:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784093597.049338:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093597.049344:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013621248:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (376us total) trans 0 rc 0/0 00000100:00080000:0.0:1784093597.049345:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093597.049352:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 294 00000100:00100000:0.0:1784093597.632399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093597.632451:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013621504 00000100:00100000:0.0:1784093597.632461:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013621504 00000100:00100000:0.0:1784093597.632510:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 338 00000100:00100000:0.0:1784093597.632519:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34250:x1870757013621504:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093597.632537:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093597.632558:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c931b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf544a expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.632614:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.632628:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.632641:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.632691:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.632699:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.632705:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633092:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9330 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633101:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633114:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093597.633189:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:0.0:1784093597.633193:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093597.633266:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633278:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633285:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633292:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633298:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093597.633302:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633310:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633322:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784093597.633325:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093597.633329:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633335:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633354:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633360:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633366:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633372:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093597.633375:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633381:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633389:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6be00) 00010000:00010000:0.0:1784093597.633391:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093597.633394:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633400:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633443:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c931b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf544a expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633460:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9330 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf544a expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.633478:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784093597.633480:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093597.633483:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093597.633538:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:34250:x1870757013621504:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1019us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093597.633545:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 338 00000100:00100000:0.0:1784093597.635676:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013621760 00000100:00100000:0.0:1784093597.635685:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013621760 00000100:00100000:0.0:1784093597.636086:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 339 00000100:00100000:0.0:1784093597.636096:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34250:x1870757013621760:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093597.636114:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093597.636130:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9337 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5451 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.636395:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.636408:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.636436:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.636452:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.636459:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.636473:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784093597.637194:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc:0x0], index 0: 0 00010000:00010000:0.0:1784093597.637491:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c934c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637502:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c934c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637510:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c934c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637543:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637549:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637557:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637563:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093597.637567:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637574:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637585:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784093597.637587:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093597.637598:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637604:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c933e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093597.637615:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000044654df1 reply state 00000000e522ad4b transno 4294967435 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093597.637624:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093597.637653:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9337 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5451 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637665:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c934c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5451 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.637673:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093597.637675:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093597.637678:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784093597.637743:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:34250:x1870757013621760:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1648us (2178us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1784093597.637750:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 339 00000100:00100000:0.0:1784093597.639722:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093597.639762:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013622016 00000100:00100000:0.0:1784093597.639771:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013622016 00010000:00010000:2.0:1784093597.639790:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.639802:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.639809:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.639816:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093597.639821:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093597.639823:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 340 00000100:00100000:0.0:1784093597.639836:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:34250:x1870757013622016:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:2.0:1784093597.639837:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.639856:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907202e6b000) 00010000:00010000:2.0:1784093597.639859:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093597.639864:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.639870:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9345 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.639888:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093597.639910:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c934c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5451 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.639933:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093597.639944:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093597.639981:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.639992:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.640001:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093597.640131:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000085ac7aa0 reply state 00000000798a98fb transno 4294967436 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093597.640141:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093597.640219:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:34250:x1870757013622016:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 386us (501us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1784093597.640227:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 340 00010000:00010000:2.0:1784093597.641129:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.641140:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.641147:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.641154:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093597.641159:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.641166:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.641179:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff907202e6b600) 00010000:00010000:2.0:1784093597.641182:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093597.641185:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.641204:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c935a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093597.641986:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.642072:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013622144 00000100:00100000:1.0:1784093597.642081:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013622144 00000100:00100000:1.0:1784093597.642143:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 341 00000100:00100000:1.0:1784093597.642152:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:34250:x1870757013622144:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784093597.642167:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093597.642179:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5458 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093597.642214:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5458 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093597.642223:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5458 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093597.642240:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff907202d46400) 00010000:00010000:1.0:1784093597.642243:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093597.642245:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093597.642291:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:34250:x1870757013622144:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093597.642298:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 341 00000100:00100000:0.0:1784093597.643745:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093597.643851:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013622272 00000100:00100000:2.0:1784093597.643858:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013622272 00000100:00100000:2.0:1784093597.643927:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 162 00000100:00100000:2.0:1784093597.643936:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013622272:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:2.0:1784093597.644276:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013622272:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 342us (534us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1784093597.644296:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 162 00000100:00100000:2.0:1784093597.645305:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.645358:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013622528 00000100:00100000:1.0:1784093597.645366:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013622528 00000100:00100000:1.0:1784093597.645404:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 38 00000100:00100000:1.0:1784093597.645449:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:34250:x1870757013622528:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:1.0:1784093597.645739:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:34250:x1870757013622528:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 319us (436us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1784093597.645747:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 38 00000100:00100000:0.0:1784093597.666640:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013622656 00000100:00100000:0.0:1784093597.666651:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013622656 00000100:00100000:0.0:1784093597.666708:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 342 00000100:00100000:0.0:1784093597.666718:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:34254:x1870757013622656:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:0.0:1784093597.666741:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093597.666762:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9368 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf545f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.666855:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.666870:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.666892:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.666910:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.666917:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.666923:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667023:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667032:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667040:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093597.667083:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1d:0x0]: returning size 0 00000004:00200000:0.0:1784093597.667088:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093597.667108:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667130:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667139:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667145:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667152:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667158:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093597.667162:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667170:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667182:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784093597.667185:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093597.667189:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667195:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c936f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667207:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667212:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667224:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667230:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093597.667233:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667240:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667248:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907202e6b300) 00010000:00010000:0.0:1784093597.667251:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093597.667253:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667259:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667289:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9368 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf545f expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667302:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf545f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093597.667309:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff907202d46400) 00010000:00010000:0.0:1784093597.667311:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093597.667314:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784093597.667378:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:34254:x1870757013622656:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 660us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093597.667396:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 342 00000100:00100000:0.0:1784093597.669102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093597.669172:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013622784 00000100:00100000:1.0:1784093597.669180:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013622784 00000100:00100000:1.0:1784093597.669229:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 163 00000100:00100000:1.0:1784093597.669237:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013622784:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784093597.669252:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093597.669267:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5466 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093597.669292:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x6a571b9d, atime: 0x6a571b9d, ctime: 0x6a571b9d, blocks: 0x1 00010000:00010000:1.0:1784093597.669307:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=758s v=(0 0) 00010000:00010000:1.0:1784093597.669312:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093597.669320:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093597.669336:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093597.669348:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784093597.669467:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013622784:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 230us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093597.669474:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 163 00000100:00100000:2.0:1784093597.672365:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093597.672540:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013623040 00000100:00100000:0.0:1784093597.672550:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013623040 00000100:00100000:2.0:1784093597.672640:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 343 00000100:00100000:2.0:1784093597.672651:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:34254:x1870757013623040:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784093597.672704:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093597.672728:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c937d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf545f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672746:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5458 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672753:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff907202d46400) 00010000:00010000:2.0:1784093597.672760:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093597.672776:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672798:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672806:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672816:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672820:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672824:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672922:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672929:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.672936:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784093597.673572:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8960 00000004:00080000:2.0:1784093597.673579:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 758751157061ns, next at 759751155459ns, rc = 0 00010000:00010000:2.0:1784093597.673620:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c93a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673627:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c93a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673640:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c93a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673645:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c93a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673649:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c93a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673652:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c93a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673667:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093597.673680:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673684:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673687:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673692:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093597.673695:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673700:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673710:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093597.673713:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093597.673721:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673729:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214c9399 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673746:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673751:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673755:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673773:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093597.673775:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673780:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673791:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:2.0:1784093597.673798:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093597.673801:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093597.673808:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c938b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093597.673820:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000012bd932 reply state 00000000c3540f2e transno 4294967438 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093597.673838:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093597.673908:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:34254:x1870757013623040:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1257us (1548us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1784093597.673915:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 343 00000100:00100000:0.0:1784093597.674603:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024182016:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.674664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093597.674723:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024182528:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.674754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093597.674795:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182528 00000100:00100000:0.0:1784093597.674796:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784093597.674803:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182528 00000100:00100000:0.0:1784093597.674806:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024182144:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.674832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093597.674848:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024182656:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.674879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093597.674893:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182144 00000100:00100000:2.0:1784093597.674898:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182144 00000100:00100000:0.0:1784093597.674921:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182656 00000100:00100000:2.0:1784093597.674926:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1784093597.674929:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182656 00000100:00100000:1.0:1784093597.674935:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024182272:0@lo:400:kworker.0 00000100:00100000:2.0:1784093597.674938:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024182528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093597.674973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093597.674999:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024182784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093597.675010:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024182528:12345-0@lo:400:kworker.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093597.675017:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1784093597.675028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093597.675031:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182272 00000100:00100000:2.0:1784093597.675036:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182272 00000100:00100000:1.0:1784093597.675048:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784093597.675053:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024182400:0@lo:400:kworker.0 00000100:00100000:1.0:1784093597.675095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093597.675127:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182016 00000100:00100000:1.0:1784093597.675131:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182016 00000100:00100000:1.0:1784093597.675159:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1784093597.675167:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024182016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093597.675198:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024182016:12345-0@lo:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093597.675205:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1784093597.675234:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182784 00000100:00100000:1.0:1784093597.675238:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182784 00000100:00100000:1.0:1784093597.675340:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784093597.675347:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024182784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093597.675372:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093597.675443:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024182784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093597.675451:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784093597.675474:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182400 00000100:00100000:1.0:1784093597.675478:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182400 00000100:00100000:0.0:1784093597.675878:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1784093597.675887:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024182656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.675926:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024182656:12345-0@lo:400:kworker.0 Request processed in 40us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093597.675933:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1784093597.676039:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024182656:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.676058:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024182528:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.676081:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024182016:0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.676125:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1784093597.676140:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024182144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093597.676185:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024182144:12345-0@lo:400:kworker.0 Request processed in 47us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093597.676192:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1784093597.676252:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024182784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093597.676651:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1784093597.676662:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024182272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093597.676682:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1784093597.676694:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024182400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093597.676709:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024182272:12345-0@lo:400:kworker.0 Request processed in 49us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093597.676717:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1784093597.676746:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024182400:12345-0@lo:400:kworker.0 Request processed in 55us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093597.676754:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024182400:0@lo:400:kworker.0 00000100:00100000:1.0:1784093597.676757:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784093597.676776:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024182272:0@lo:400:kworker.0 00010000:00010000:0.0:1784093598.185544:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093598.372633:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784093598.372646:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024182912 00000100:00100000:0.0:1784093598.372653:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024182912 00000100:00100000:0.0:1784093598.372701:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784093598.372712:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237552c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:56620:x1870757024182912:12345-0@lo:104: 00010000:00010000:0.0:1784093598.372726:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093598.372823:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093598.372829:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237552c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:56620:x1870757024182912:12345-0@lo:104: Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093598.372837:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00010000:2.0:1784093598.372848:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093598.372856:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093598.372882:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093598.372887:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093598.372897:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093598.372903:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093598.372909:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093598.372947:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093598.372959:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093598.372989:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093598.372996:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c930d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9314 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093598.373016:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024183040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093598.373017:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093598.373020:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093598.373024:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093598.373064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093598.373319:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024183040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093598.373350:0:56620:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69800/0x9ce98053214c93a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093598.373359:0:56620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214c93a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093598.373366:0:56620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214c93a7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093599.584132:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:2.0:1784093599.584242:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093599.586123:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013623424 00000100:00100000:2.0:1784093599.586136:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013623424 00000100:00100000:2.0:1784093599.586183:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 345 00000100:00100000:2.0:1784093599.586194:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:34342:x1870757013623424:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093599.586229:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093599.586249:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c93b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf546d expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.586263:0:5809:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9330) 00010000:00010000:2.0:1784093599.586267:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907204fce600) 00010000:00010000:2.0:1784093599.586276:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093599.586297:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.586306:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.586315:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093599.610240:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000576d42e9 reply state 0000000017bb8c7d transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093599.610262:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093599.610512:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000100:00100000:2.0:1784093599.610590:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024183168 00000100:00100000:2.0:1784093599.610599:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024183168 00010000:00080000:0.0:1784093599.610654:0:5809:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784093599.610665:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784093599.610684:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024183168:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784093599.610687:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34342:x1870757013623424:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 24484us (24650us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1784093599.610701:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 345 00002000:00080000:2.0:1784093599.610716:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:12 count 1 00010000:00010000:2.0:1784093599.610742:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.610764:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.610767:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.610809:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.610813:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093599.610831:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093599.610833:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.610841:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.610845:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093599.610856:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.610869:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.610877:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.610889:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 6 pid: 6574 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.610903:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781700) 00010000:00010000:0.0:1784093599.610907:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093599.610914:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093599.610921:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024183296:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093599.610923:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c93bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093599.610985:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4480 going to sleep for 11 seconds 00000100:00080000:2.0:1784093599.611001:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093599.612709:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024183296:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093599.612803:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093599.612952:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013623552 00000100:00100000:0.0:1784093599.612959:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013623552 00010000:00010000:0.0:1784093599.613011:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 7 pid: 6574 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784093599.613039:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093599.613061:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 201 00000100:00100000:0.0:1784093599.613069:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013623552:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784093599.613083:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093599.613106:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 7 pid: 6574 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.613116:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 7 pid: 6574 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.613137:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006177025/0x9ce98053214c9384 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5466 expref: 7 pid: 6574 timeout: 860 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.613149:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093599.613152:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093599.613157:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.613164:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093599.613188:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093599.613216:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.613228:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093599.613236:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013623552:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 168us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093599.613244:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 201 00010000:00010000:2.0:1784093599.613258:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.613267:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0c6db70/0x9ce98053214c93c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093599.613294:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784093599.614103:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024183168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3423us (3550us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784093599.614115:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000004:00080000:1.0:1784093599.614163:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723749c380/2, rc 0, transno 4294967320 00000100:00100000:1.0:1784093599.614173:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024183168:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784093599.721662:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024183424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093599.721729:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093599.722318:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024183424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093600.041582:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093600.041605:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093600.041632:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024183552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093600.041699:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093600.041755:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784093600.041781:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024183552 00000100:00100000:3.0:1784093600.041788:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024183552 00000100:00100000:3.0:1784093600.041844:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1784093600.041854:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024183552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093600.041867:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093600.041881:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c93d1 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093600.041904:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093600.041915:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093600.041925:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784093600.041968:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024183552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093600.041976:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1784093600.042036:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024183552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093600.042052:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093600.042068:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093600.042089:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093600.042094:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093600.042102:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093600.233549:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093600.759843:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1784093600.759858:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:1.0:1784093601.153557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093601.153662:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013623680 00000100:00100000:0.0:1784093601.153671:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013623680 00000100:00080000:1.0:1784093601.153726:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093601.153757:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 346 00000100:00100000:0.0:1784093601.153770:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:34418:x1870757013623680:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093601.153795:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093601.153827:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c93df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5474 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.153888:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.153899:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.153909:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.153919:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.153923:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.153927:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154489:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c93f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154511:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c93f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154519:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c93f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093601.154617:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:0.0:1784093601.154622:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093601.154742:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c93f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154768:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154775:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154782:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154788:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093601.154793:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154800:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154816:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784093601.154819:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093601.154824:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154831:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c93e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154842:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154849:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154855:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154867:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093601.154870:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154876:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154885:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6be00) 00010000:00010000:0.0:1784093601.154887:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093601.154890:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154896:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c93ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154928:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c93df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5474 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154943:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c93f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5474 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.154951:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784093601.154954:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093601.154956:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784093601.155027:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:34418:x1870757013623680:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1259us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093601.155036:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 346 00010000:00010000:2.0:1784093601.257595:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093601.800839:0:57060:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2955f370 20000000:00000080:0.0:1784093601.800858:0:57060:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101e39400 uarg=0000000000000000 00010000:00010000:0.0:1784093601.801070:0:57060:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093601.801100:0:57060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784093601.801103:0:57060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093601.801110:0:57060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c93f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5474 expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.801129:0:57060:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093601.801144:0:57060:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093601.801158:0:57060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.801170:0:57060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.801178:0:57060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.801212:0:57060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.801225:0:57060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 18 pid: 5771 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093601.801240:0:57060:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57060:1870757024183680:0@lo:104: 00000100:00100000:0.0:1784093601.801295:0:57060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093601.801391:0:57060:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8840 going to sleep for 11 seconds 00000100:00100000:1.0:1784093601.801457:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024183680 00000100:00100000:1.0:1784093601.801465:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024183680 00000100:00100000:1.0:1784093601.801567:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784093601.801576:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:57060:x1870757024183680:12345-0@lo:104: 00010000:00010000:1.0:1784093601.801592:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.801646:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093601.801652:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:57060:x1870757024183680:12345-0@lo:104: Request processed in 78us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093601.801659:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784093601.801669:0:57060:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57060:1870757024183680:0@lo:104: 00010000:00010000:3.0:1784093601.801678:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093601.801687:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093601.801697:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093601.801701:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.801702:0:57060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093601.801721:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093601.801730:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093601.801747:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093601.801797:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093601.801805:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093601.801859:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093601.801868:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c93d1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c93d8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093601.801881:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024183808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093601.801883:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093601.801887:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093601.801891:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093601.801921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093601.802056:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024183808 00000100:00100000:3.0:1784093601.802060:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024183808 00010000:00010000:3.0:1784093601.802080:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 19 pid: 5771 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093601.802173:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784093601.802184:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024183808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093601.802195:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093601.802200:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 19 pid: 5771 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802211:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 19 pid: 5771 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802223:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69000/0x9ce98053214c93d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c93d1 expref: 19 pid: 5771 timeout: 912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802234:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802242:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802254:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802262:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802278:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802285:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802291:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093601.802294:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802302:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802318:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093601.802327:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093601.802341:0:57060:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.802349:0:57060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093601.802353:0:57060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214c93fb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093601.802371:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024183808:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093601.802379:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784093601.802402:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024183808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093602.168123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093602.168165:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093602.168197:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013623936 00000100:00100000:1.0:1784093602.168200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093602.168209:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013623936 00000100:00100000:2.0:1784093602.168229:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013623808 00000100:00100000:2.0:1784093602.168235:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013623808 00000100:00100000:1.0:1784093602.168248:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093602.168276:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 479 00000100:00100000:2.0:1784093602.168279:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:1.0:1784093602.168286:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624064 00000100:00100000:1.0:1784093602.168293:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624064 00000100:00100000:0.0:1784093602.168295:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013623936:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093602.168298:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013623808:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093602.168333:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624192 00000100:00100000:1.0:1784093602.168337:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624192 00000100:00100000:1.0:1784093602.168360:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 297 00000100:00100000:2.0:1784093602.168378:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013623808:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093602.168379:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013623936:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093602.168380:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013624064:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093602.168402:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:0.0:1784093602.168402:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 479 00000100:00100000:1.0:1784093602.168442:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013624064:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093602.168452:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 297 00000100:00100000:0.0:1784093602.168461:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 298 00000100:00100000:0.0:1784093602.168471:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013624192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:1.0:1784093602.168478:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093602.168484:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093602.168505:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013624192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093602.168513:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 298 00010000:00010000:2.0:1784093602.281571:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093602.793847:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024183936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093602.793920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093602.794027:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024183936 00000100:00100000:1.0:1784093602.794035:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024183936 00000100:00100000:3.0:1784093602.794104:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024184064:0@lo:400:kworker.0 00000100:00100000:1.0:1784093602.794110:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784093602.794123:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024183936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093602.794141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1784093602.794162:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093602.794167:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024184576:0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.794201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093602.794220:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024183936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093602.794229:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1784093602.794232:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093602.794239:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024184192:0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.794262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093602.794266:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184064 00000100:00100000:1.0:1784093602.794272:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184064 00000100:00100000:1.0:1784093602.794304:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784093602.794309:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184576 00000100:00100000:1.0:1784093602.794315:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024184064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.794316:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184576 00000100:00100000:3.0:1784093602.794354:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184192 00000100:00100000:3.0:1784093602.794359:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184192 00000100:00100000:1.0:1784093602.794367:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024184064:12345-0@lo:400:kworker.0 Request processed in 56us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093602.794375:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784093602.794391:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1784093602.794401:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024184576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093602.794412:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024184448:0@lo:400:kworker.0 00000100:00080000:2.0:1784093602.794451:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093602.794457:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093602.794473:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024184320:0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.794479:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024184576:12345-0@lo:400:kworker.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093602.794487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093602.794497:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1784093602.794511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093602.794514:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1784093602.794523:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024184192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093602.794543:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024183936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093602.794555:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184448 00000100:00100000:3.0:1784093602.794560:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024184192:12345-0@lo:400:kworker.0 Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093602.794566:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184448 00000100:00100000:3.0:1784093602.794567:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1784093602.794583:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184320 00000100:00100000:3.0:1784093602.794586:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184320 00000100:00100000:3.0:1784093602.794609:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1784093602.794609:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1784093602.794609:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024184192:0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.794622:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024184320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093602.794622:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024184448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093602.794629:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024184064:0@lo:400:kworker.0 00000100:00100000:1.0:1784093602.794644:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024184576:0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.794667:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024184320:12345-0@lo:400:kworker.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093602.794667:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024184448:12345-0@lo:400:kworker.0 Request processed in 49us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093602.794675:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1784093602.794675:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1784093602.794693:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093602.794696:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093602.794717:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024184320:0@lo:400:kworker.0 00000100:00100000:1.0:1784093602.794742:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967320 gen 2 00000004:00080000:1.0:1784093602.794749:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723749c380, transno 4294967320 00000100:00100000:1.0:1784093602.794769:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024184448:0@lo:400:kworker.0 00000100:00100000:3.0:1784093602.948032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093602.948093:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624320 00000100:00100000:1.0:1784093602.948104:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624320 00000100:00100000:1.0:1784093602.948176:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:1.0:1784093602.948189:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34504:x1870757013624320:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093602.948210:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093602.948232:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf547b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.948294:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9409 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.948309:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.948322:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093602.948571:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:1.0:1784093602.948576:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093602.948664:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.948703:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf547b expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.948725:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf547b expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.948735:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202d46300) 00010000:00010000:1.0:1784093602.948738:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093602.948742:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093602.948806:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34504:x1870757013624320:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 620us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093602.948814:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:2.0:1784093602.951554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093602.951691:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624576 00000100:00100000:1.0:1784093602.951703:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624576 00000100:00100000:1.0:1784093602.951760:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 348 00000100:00100000:1.0:1784093602.951771:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:34504:x1870757013624576:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093602.951821:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093602.951845:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf547b expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.951864:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c93f4) 00010000:00010000:1.0:1784093602.951869:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202d46300) 00010000:00010000:1.0:1784093602.951881:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093602.951902:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.951912:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093602.951933:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093602.952398:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ab05da8f reply state 000000002e2762f9 transno 4294967440 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093602.952409:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093602.952594:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000100:00100000:1.0:1784093602.952698:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:34504:x1870757013624576:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 930us (1157us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1784093602.952707:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 348 00010000:00010000:0.0:1784093602.953954:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093602.953993:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093602.954014:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093602.954022:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093602.954029:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093602.954039:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093602.954058:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202d46200) 00010000:00010000:0.0:1784093602.954061:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093602.954074:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093602.954080:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9410 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093603.282350:0:57255:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcef8cc480 20000000:00000080:2.0:1784093603.282367:0:57255:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907204c9d400 uarg=0000000000000000 00010000:00010000:2.0:1784093603.282614:0:57255:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093603.282629:0:57255:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093603.282641:0:57255:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093603.282659:0:57255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282674:0:57255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282683:0:57255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282690:0:57255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282708:0:57255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282714:0:57255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282720:0:57255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093603.282724:0:57255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282733:0:57255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282745:0:57255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282753:0:57255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.282759:0:57255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214c9417 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093603.305697:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093603.753475:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093603.753483:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093603.753487:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093603.753542:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093603.753554:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093603.753564:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093603.753589:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024184704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093603.753663:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093603.753707:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184704 00000100:00100000:2.0:1784093603.753714:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184704 00000100:00100000:3.0:1784093603.753719:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093603.753767:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1784093603.753779:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024184704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093603.753793:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093603.753814:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c941e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.753848:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c941e expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.753857:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c941e expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093603.753866:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784093603.753910:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024184704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093603.753918:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1784093603.753941:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024184704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093603.753967:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093603.753975:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093603.753996:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093603.754010:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093603.754018:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.329659:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093604.444398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093604.444467:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624704 00000100:00100000:3.0:1784093604.444476:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624704 00000100:00100000:3.0:1784093604.444537:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 349 00000100:00100000:3.0:1784093604.444545:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013624704:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00080000:2.0:1784093604.444547:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093604.444638:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013624704:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.444644:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 349 00000100:00100000:1.0:1784093604.445474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.446006:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624832 00000100:00100000:2.0:1784093604.446014:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624832 00000100:00080000:0.0:1784093604.446050:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093604.446064:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 165 00000100:00100000:2.0:1784093604.446074:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013624832:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093604.446383:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013624832:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 310us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093604.446391:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 165 00000100:00100000:0.0:1784093604.448101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.448141:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013624960 00000100:00100000:2.0:1784093604.448148:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013624960 00000100:00100000:2.0:1784093604.448202:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 166 00000100:00100000:2.0:1784093604.448211:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013624960:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:0.0:1784093604.448213:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093604.448489:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013624960:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 278us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093604.448509:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 166 00000100:00100000:1.0:1784093604.449328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093604.449373:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625088 00000100:00100000:3.0:1784093604.449380:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625088 00000100:00100000:3.0:1784093604.449436:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 350 00000100:00100000:3.0:1784093604.449446:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013625088:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093604.449764:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013625088:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 318us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.449773:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 350 00000100:00100000:1.0:1784093604.451708:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093604.451781:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625216 00000100:00100000:3.0:1784093604.451794:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625216 00000100:00100000:3.0:1784093604.451851:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 351 00000100:00100000:3.0:1784093604.451863:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013625216:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093604.451980:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013625216:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 120us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.451989:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 351 00000100:00100000:0.0:1784093604.453274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093604.453329:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625344 00000100:00100000:1.0:1784093604.453338:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625344 00000100:00100000:1.0:1784093604.453398:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 167 00000100:00100000:1.0:1784093604.453407:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013625344:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093604.453742:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013625344:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 335us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093604.453750:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 167 00000100:00100000:1.0:1784093604.454640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.454722:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625472 00000100:00100000:2.0:1784093604.454733:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625472 00000100:00100000:2.0:1784093604.454898:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 168 00000100:00100000:2.0:1784093604.454910:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013625472:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093604.455290:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34588:x1870757013625472:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 383us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093604.455299:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 168 00000100:00100000:2.0:1784093604.456402:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093604.456479:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625600 00000100:00100000:3.0:1784093604.456487:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625600 00000100:00100000:3.0:1784093604.456537:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 352 00000100:00100000:3.0:1784093604.456547:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013625600:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093604.457050:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:34588:x1870757013625600:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 503us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.457058:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 352 00000100:00100000:3.0:1784093604.480644:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.480742:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625728 00000100:00100000:2.0:1784093604.480756:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625728 00000100:00100000:2.0:1784093604.480821:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 353 00000100:00100000:2.0:1784093604.480831:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34592:x1870757013625728:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784093604.480849:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093604.480870:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c942c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5482 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.480949:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.480963:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.480976:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.480990:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481013:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481021:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481543:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481553:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481560:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093604.481650:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:2.0:1784093604.481654:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093604.481739:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481751:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481758:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481765:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481771:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093604.481774:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481789:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481801:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093604.481804:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093604.481808:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481814:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481825:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481831:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481837:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481843:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093604.481846:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481851:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481859:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781d00) 00010000:00010000:2.0:1784093604.481861:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093604.481863:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481881:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c943a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481915:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c942c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5482 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481949:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5482 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.481957:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784093604.481960:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093604.481963:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784093604.482025:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:34592:x1870757013625728:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1196us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093604.482032:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 353 00000100:00100000:1.0:1784093604.483594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093604.483644:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013625984 00000100:00100000:3.0:1784093604.483653:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013625984 00000100:00100000:3.0:1784093604.483694:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 354 00000100:00100000:3.0:1784093604.483704:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:34592:x1870757013625984:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784093604.483720:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093604.483734:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9448 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5489 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484011:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484021:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484027:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484035:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484040:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484044:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093604.484722:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc:0x0], index 1: 0 00010000:00010000:3.0:1784093604.484895:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c945d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484902:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c945d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484907:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c945d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484947:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484965:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484972:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484977:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093604.484982:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484989:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.484999:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781700) 00010000:00010000:3.0:1784093604.485002:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093604.485006:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.485012:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c944f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093604.485023:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a9e70eeb reply state 0000000090dd1f13 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093604.485029:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784093604.485049:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9448 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5489 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.485058:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c945d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5489 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093604.485072:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784093604.485074:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093604.485076:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093604.485127:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:34592:x1870757013625984:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1425us (1538us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1784093604.485134:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 354 00010000:00010000:2.0:1784093604.486131:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.486154:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.486162:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.486168:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093604.486172:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.486178:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.486197:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907204fceb00) 00010000:00010000:2.0:1784093604.486207:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093604.486213:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.486220:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9456 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093604.489480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.489975:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013626112 00000100:00100000:2.0:1784093604.489984:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013626112 00000100:00100000:2.0:1784093604.490031:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 169 00000100:00100000:2.0:1784093604.490040:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:34592:x1870757013626112:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784093604.490057:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093604.490077:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5490 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093604.490104:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784093604.490124:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1784093604.490129:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093604.490139:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.490155:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093604.490169:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093604.490223:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34592:x1870757013626112:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 184us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093604.490243:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 169 00000100:00100000:3.0:1784093604.500591:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.500668:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013626240 00000100:00100000:2.0:1784093604.500678:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013626240 00002000:00100000:2.0:1784093604.500730:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff907230ce4000 x1870757013626240/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:680/0 lens 488/0 e 0 to 0 dl 1784093615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093604.500741:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230ce4000 with x1870757013626240 ext(0->1048575) 00002000:00010000:2.0:1784093604.500746:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230ce4000 00000100:00100000:2.0:1784093604.500786:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 7 00000100:00100000:2.0:1784093604.500796:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013626240:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:2.0:1784093604.511941:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013626240:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 11124us (11340us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1784093604.511956:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 7 00002000:00100000:2.0:1784093604.511970:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff907230ce4000 x1870757013626240/t4294967319(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:680/0 lens 488/448 e 0 to 0 dl 1784093615 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093604.511981:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230ce4000 with x1870757013626240 ext(0->1048575) 00002000:00010000:2.0:1784093604.511989:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230ce4000 00000100:00100000:3.0:1784093604.513490:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093604.513668:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013626368 00000100:00100000:0.0:1784093604.513677:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013626368 00000100:00100000:0.0:1784093604.513730:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 355 00000100:00100000:0.0:1784093604.513739:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:34592:x1870757013626368:12345-192.168.204.57@tcp:44:dd.60003 00000100:00100000:3.0:1784093604.528815:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:34592:x1870757013626368:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 15066us (15318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.528829:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 355 00000001:00080000:2.0:1784093604.528873:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000001:00080000:2.0:1784093604.528892:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000100:00100000:1.0:1784093604.530829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093604.530985:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013626496 00000100:00100000:2.0:1784093604.530996:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013626496 00000100:00100000:2.0:1784093604.531053:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 170 00000100:00100000:2.0:1784093604.531064:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013626496:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:2.0:1784093604.550215:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:3.0:1784093604.550476:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013626496:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 19402us (19646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.550490:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 170 00000100:00100000:0.0:1784093604.552302:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093604.552375:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013626752 00000100:00100000:1.0:1784093604.552389:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013626752 00000100:00100000:1.0:1784093604.552500:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 39 00000100:00100000:1.0:1784093604.552511:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:34592:x1870757013626752:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093604.553137:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:34592:x1870757013626752:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 626us (844us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1784093604.553147:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 39 00000100:00100000:1.0:1784093604.841664:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024184832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093604.841732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093604.841819:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184832 00000100:00100000:3.0:1784093604.841830:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184832 00000100:00100000:3.0:1784093604.841895:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784093604.841906:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024184832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093604.841954:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093604.842007:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024184832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093604.842017:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1784093604.842052:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024184832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784093604.842624:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784093605.066264:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00010000:00010000:1.0:1784093605.353622:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784093605.564951:0:57499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766642526880ns, next at 759751155459ns, rc = 0 00000004:00080000:0.0:1784093605.565044:0:57499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766642620916ns, next at 736977101821ns, rc = 0 00000004:00080000:2.0:1784093605.566673:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 27 committed 00000004:00080000:2.0:1784093605.567697:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000100:00100000:3.0:1784093606.129107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093606.130037:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013626880 00000100:00100000:0.0:1784093606.130049:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013626880 00000100:00080000:1.0:1784093606.130225:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093606.130296:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 356 00000100:00100000:0.0:1784093606.130310:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013626880:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093606.130436:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013626880:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 114us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093606.130446:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 356 00000100:00100000:2.0:1784093606.132008:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093606.132055:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627008 00000100:00100000:1.0:1784093606.132062:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627008 00000100:00100000:1.0:1784093606.132109:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 171 00000100:00080000:0.0:1784093606.132109:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093606.132120:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34785:x1870757013627008:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093606.132515:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:34785:x1870757013627008:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 394us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093606.132523:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 171 00000100:00100000:0.0:1784093606.133941:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093606.134016:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627136 00000100:00100000:2.0:1784093606.134024:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627136 00000100:00100000:2.0:1784093606.134110:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 172 00000100:00100000:2.0:1784093606.134120:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34785:x1870757013627136:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093606.134409:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:34785:x1870757013627136:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 290us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093606.134416:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 172 00000100:00080000:0.0:1784093606.134498:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093606.136195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093606.136264:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627264 00000100:00100000:3.0:1784093606.136272:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627264 00000100:00100000:3.0:1784093606.136326:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 357 00000100:00100000:3.0:1784093606.136334:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013627264:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093606.136802:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013627264:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 468us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093606.136810:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 357 00000100:00100000:1.0:1784093606.138867:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093606.138999:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627392 00000100:00100000:3.0:1784093606.139008:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627392 00000100:00100000:3.0:1784093606.139090:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 358 00000100:00100000:3.0:1784093606.139100:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013627392:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093606.139196:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013627392:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 96us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093606.139204:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 358 00000100:00100000:1.0:1784093606.145046:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093606.145092:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627520 00000100:00100000:3.0:1784093606.145113:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627520 00000100:00100000:3.0:1784093606.145174:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 173 00000100:00100000:3.0:1784093606.145186:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:34785:x1870757013627520:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093606.145674:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:34785:x1870757013627520:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 489us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093606.145683:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 173 00000100:00100000:3.0:1784093606.147518:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093606.147559:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627648 00000100:00100000:1.0:1784093606.147568:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627648 00000100:00100000:1.0:1784093606.147613:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 174 00000100:00100000:1.0:1784093606.147623:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:34785:x1870757013627648:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093606.148023:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:34785:x1870757013627648:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 400us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093606.148042:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 174 00000100:00100000:1.0:1784093606.149971:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093606.150025:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013627776 00000100:00100000:0.0:1784093606.150034:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013627776 00000100:00100000:0.0:1784093606.150083:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 359 00000100:00100000:0.0:1784093606.150095:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013627776:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093606.150587:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:34785:x1870757013627776:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 493us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093606.150596:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 359 00000100:00100000:0.0:1784093606.180675:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093606.180729:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628032 00000100:00100000:3.0:1784093606.180741:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628032 00000100:00100000:3.0:1784093606.180806:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 360 00000100:00100000:3.0:1784093606.180816:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:34789:x1870757013628032:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:3.0:1784093606.180875:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093606.180935:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c945d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5489 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.180948:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784093606.180959:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093606.180992:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181004:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181012:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181023:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181027:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181031:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181451:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181476:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.181483:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093606.182394:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off8960 00000004:00080000:3.0:1784093606.182414:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767259991720ns, next at 768259989613ns, rc = 0 00010000:00010000:3.0:1784093606.182536:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182545:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182553:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182559:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182564:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182568:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182588:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093606.182616:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182622:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182628:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182636:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093606.182642:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182658:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093606.182663:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182686:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182687:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093606.182695:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093606.182701:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182712:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093606.182715:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9480 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182720:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182735:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182739:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182747:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182752:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182757:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093606.182759:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093606.182764:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784093606.182766:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182773:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182777:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182794:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093606.182800:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781700) 00010000:00010000:3.0:1784093606.182805:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093606.182810:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182824:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093606.182827:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9472 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182829:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1784093606.182845:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ecc837d1 reply state 00000000704adc40 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.182854:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093606.182860:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093606.182984:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:34789:x1870757013628032:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 2165us (2314us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1784093606.182993:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 360 00010000:00010000:2.0:1784093606.187111:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.187124:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.187129:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.187133:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093606.187136:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.187141:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.187154:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x93c5647 (ffff907204fce200) 00010000:00010000:2.0:1784093606.187156:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093606.187159:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093606.187163:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x19:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093606.377568:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784093607.053747:0:57646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768131322426ns, next at 759751155459ns, rc = 0 00000004:00080000:3.0:1784093607.053917:0:57646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768131493963ns, next at 768259989613ns, rc = 0 00000004:00080000:2.0:1784093607.069283:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 29 committed 00000004:00080000:2.0:1784093607.069324:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000001:00080000:2.0:1784093607.069342:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000004:00080000:2.0:1784093607.069347:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00000100:00100000:2.0:1784093607.069577:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024184960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784093607.069648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093607.069737:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024184960 00000100:00100000:0.0:1784093607.069754:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024184960 00000100:00100000:0.0:1784093607.069844:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784093607.069856:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024184960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784093607.069920:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:12 count 1 00010000:00010000:0.0:1784093607.069952:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.069979:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784093607.070009:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784093607.070089:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1784093607.070095:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784093607.070101:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.070141:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.070158:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 5 pid: 8031 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093607.070174:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024185088:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093607.070314:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784093607.074243:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024185088:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093607.074279:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093607.075777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093607.075905:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628160 00000100:00100000:3.0:1784093607.075922:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628160 00010000:00010000:3.0:1784093607.075971:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 6 pid: 8031 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093607.076021:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 203 00000100:00100000:3.0:1784093607.076031:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013628160:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093607.076047:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093607.076054:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 6 pid: 8031 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093607.076068:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 6 pid: 8031 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093607.076114:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214c946b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5490 expref: 6 pid: 8031 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093607.076131:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093607.076135:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093607.076141:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093607.076150:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093607.076193:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093607.076255:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013628160:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 224us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093607.076264:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 203 00010000:00010000:0.0:1784093607.076301:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.076321:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.076333:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.076343:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093607.076364:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093607.076410:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093607.076419:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093607.076463:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093607.076468:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093607.076479:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093607.076493:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093607.076501:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214c948e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093607.076526:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093607.076528:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093607.076530:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093607.077048:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024184960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7194us (7400us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1784093607.077058:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000004:00080000:2.0:1784093607.077095:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237377800/2, rc 0, transno 4294967320 00000100:00100000:2.0:1784093607.077113:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024184960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784093607.289839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093607.289970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093607.290006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093607.290049:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628288 00000100:00100000:1.0:1784093607.290055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093607.290062:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628288 00000100:00100000:0.0:1784093607.290078:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628672 00000100:00100000:0.0:1784093607.290084:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628672 00000100:00100000:1.0:1784093607.290089:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628544 00000100:00100000:1.0:1784093607.290095:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628544 00000100:00100000:2.0:1784093607.290132:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:0.0:1784093607.290137:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:2.0:1784093607.290146:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013628288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093607.290148:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 301 00000100:00100000:0.0:1784093607.290151:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013628672:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093607.290163:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013628544:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093607.290247:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013628544:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093607.290251:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013628672:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093607.290253:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013628288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093607.290265:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 301 00000100:00100000:0.0:1784093607.290271:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:2.0:1784093607.290288:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:3.0:1784093607.290375:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628416 00000100:00100000:3.0:1784093607.290380:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628416 00000100:00100000:1.0:1784093607.290467:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 483 00000100:00100000:1.0:1784093607.290479:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013628416:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093607.290533:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013628416:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 57us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093607.290540:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 483 00010000:00010000:1.0:1784093607.402891:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093607.913701:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024185216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093607.913750:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024185472:0@lo:400:kworker.0 00000100:00100000:1.0:1784093607.913795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093607.913796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093607.913880:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024185728:0@lo:400:kworker.0 00000100:00100000:1.0:1784093607.913882:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784093607.913893:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024185344:0@lo:400:kworker.0 00000100:00100000:2.0:1784093607.913918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093607.913932:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093607.913943:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093607.913952:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024185600:0@lo:400:kworker.0 00000100:00100000:2.0:1784093607.913983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093607.913988:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024185856:0@lo:400:kworker.0 00000100:00100000:3.0:1784093607.913998:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185216 00000100:00100000:3.0:1784093607.914007:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185216 00000100:00100000:2.0:1784093607.914015:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185472 00000100:00100000:2.0:1784093607.914018:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185472 00000100:00100000:1.0:1784093607.914022:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093607.914052:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185600 00000100:00100000:3.0:1784093607.914055:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1784093607.914055:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185600 00000100:00100000:3.0:1784093607.914064:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024185216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093607.914064:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185344 00000100:00100000:1.0:1784093607.914070:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185344 00000100:00100000:2.0:1784093607.914084:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185856 00000100:00100000:2.0:1784093607.914088:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185856 00002000:00000024:3.0:1784093607.914103:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1784093607.914119:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1784093607.914119:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1784093607.914129:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024185472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093607.914136:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024185344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093607.914156:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024185216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093607.914164:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1784093607.914170:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024185472:12345-0@lo:400:kworker.0 Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093607.914176:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1784093607.914194:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1784093607.914195:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024185344:12345-0@lo:400:kworker.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093607.914203:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024185600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093607.914208:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1784093607.914242:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024185600:12345-0@lo:400:kworker.0 Request processed in 41us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093607.914305:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1784093607.914307:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185728 00000100:00100000:0.0:1784093607.914312:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185728 00000100:00100000:3.0:1784093607.914324:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024185856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093607.914366:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024185856:12345-0@lo:400:kworker.0 Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093607.914367:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784093607.914381:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1784093607.914382:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024185728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093607.914448:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00080000:3.0:1784093607.914449:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093607.914454:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093607.914460:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024185728:12345-0@lo:400:kworker.0 Request processed in 81us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093607.914475:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784093607.914491:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024185600:0@lo:400:kworker.0 00000100:00100000:2.0:1784093607.914491:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024185344:0@lo:400:kworker.0 00000100:00100000:3.0:1784093607.914505:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024185728:0@lo:400:kworker.0 00000100:00100000:2.0:1784093607.914512:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024185856:0@lo:400:kworker.0 00000100:00100000:2.0:1784093607.914520:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024185472:0@lo:400:kworker.0 00000100:00100000:3.0:1784093607.914521:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024185216:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784093608.426049:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093609.450225:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093609.961776:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024185984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093609.961866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093609.962016:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024185984 00000100:00100000:0.0:1784093609.962027:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024185984 00000100:00080000:3.0:1784093609.962082:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093609.962108:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1784093609.962118:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024185984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093609.962157:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093609.962211:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024185984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093609.962219:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1784093609.962342:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024185984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093610.473535:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093611.497815:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093611.526668:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1784093612.410272:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093612.410333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093612.410366:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093612.410395:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628928 00000100:00100000:3.0:1784093612.410410:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628928 00000100:00100000:0.0:1784093612.410410:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093612.410476:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629184 00000100:00100000:0.0:1784093612.410481:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629184 00000100:00100000:2.0:1784093612.410482:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013628800 00000100:00100000:2.0:1784093612.410490:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013628800 00000100:00100000:3.0:1784093612.410527:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 487 00000100:00100000:0.0:1784093612.410533:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629056 00000100:00100000:2.0:1784093612.410540:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 565 00000100:00100000:0.0:1784093612.410540:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629056 00000100:00100000:3.0:1784093612.410544:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013628928:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093612.410555:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013628800:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093612.410576:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 303 00000100:00100000:0.0:1784093612.410587:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013629184:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093612.410648:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013628928:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093612.410658:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 487 00000100:00100000:1.0:1784093612.410680:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 304 00000100:00080000:3.0:1784093612.410686:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093612.410692:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093612.410693:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013629056:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093612.410696:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093612.411866:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013628800:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1310us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093612.411878:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 565 00000100:00100000:0.0:1784093612.413258:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013629184:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 2663us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093612.413274:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 303 00000100:00100000:1.0:1784093612.414136:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013629056:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 3435us (3715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093612.414151:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 304 00010000:00010000:2.0:1784093612.521639:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093613.033659:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024186368:0@lo:400:kworker.0 00000100:00100000:3.0:1784093613.033660:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024186240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093613.033675:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024186112:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.033803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093613.033804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093613.033822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093613.033894:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024186624:0@lo:400:kworker.0 00000100:00100000:2.0:1784093613.033900:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024186880:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.033928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093613.033968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093613.033969:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093613.033979:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024186752:0@lo:400:kworker.0 00000100:00100000:2.0:1784093613.034004:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093613.034013:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024186496:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093613.034056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093613.034094:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186112 00000100:00100000:0.0:1784093613.034103:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186112 00000100:00100000:3.0:1784093613.034111:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186368 00000100:00100000:3.0:1784093613.034124:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186368 00000100:00100000:2.0:1784093613.034124:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186752 00000100:00100000:2.0:1784093613.034135:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186752 00000100:00100000:0.0:1784093613.034170:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1784093613.034182:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024186112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093613.034202:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186496 00000100:00100000:2.0:1784093613.034214:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1784093613.034227:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024186368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034236:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024186112:12345-0@lo:400:kworker.0 Request processed in 58us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093613.034242:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186496 00000100:00100000:0.0:1784093613.034246:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1784093613.034292:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186624 00000100:00100000:0.0:1784093613.034297:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186624 00000100:00100000:3.0:1784093613.034313:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1784093613.034322:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024186368:12345-0@lo:400:kworker.0 Request processed in 97us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093613.034330:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186880 00000100:00100000:3.0:1784093613.034332:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024186752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034335:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186880 00000100:00100000:2.0:1784093613.034340:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1784093613.034356:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784093613.034364:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024186624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093613.034371:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1784093613.034384:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024186496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093613.034490:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024186752:12345-0@lo:400:kworker.0 Request processed in 164us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093613.034513:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1784093613.034514:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024186496:12345-0@lo:400:kworker.0 Request processed in 129us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093613.034514:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024186624:12345-0@lo:400:kworker.0 Request processed in 135us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093613.034536:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1784093613.034537:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784093613.034570:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1784093613.034580:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024186880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093613.034617:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024186496:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034623:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024186880:12345-0@lo:400:kworker.0 Request processed in 44us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093613.034632:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784093613.034635:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967320 gen 2 00000004:00080000:2.0:1784093613.034643:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237377800, transno 4294967320 00000100:00100000:2.0:1784093613.034659:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024186880:0@lo:400:kworker.0 00000100:00100000:2.0:1784093613.034682:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024186368:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034707:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024186752:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034735:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024186112:0@lo:400:kworker.0 00000100:00100000:0.0:1784093613.034746:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024186624:0@lo:400:kworker.0 00000100:00080000:0.0:1784093613.034805:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093613.034811:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093613.034814:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093613.034859:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024186240 00000100:00100000:3.0:1784093613.034867:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024186240 00000100:00100000:3.0:1784093613.034917:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784093613.034925:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024186240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093613.034964:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093613.035028:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024186240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093613.035035:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784093613.035106:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024186240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784093613.545624:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093614.572189:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093615.081685:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024187008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093615.081766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093615.082282:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187008 00000100:00100000:1.0:1784093615.082292:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187008 00000100:00100000:1.0:1784093615.082352:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784093615.082360:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024187008:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784093615.082361:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784093615.082396:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093615.082471:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024187008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093615.082477:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1784093615.082516:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024187008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093615.593946:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093616.617770:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093617.531851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093617.531902:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093617.531941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093617.531980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093617.532014:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629696 00000100:00100000:2.0:1784093617.532023:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629696 00000100:00100000:2.0:1784093617.532079:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629568 00000100:00100000:2.0:1784093617.532082:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629568 00000100:00100000:2.0:1784093617.532104:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 307 00000100:00100000:2.0:1784093617.532113:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013629696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093617.532193:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013629696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093617.532201:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 307 00000100:00100000:2.0:1784093617.532218:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 308 00000100:00100000:2.0:1784093617.532224:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013629568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093617.532247:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013629568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093617.532253:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 308 00000100:00080000:2.0:1784093617.532299:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093617.532304:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093617.532396:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629440 00000100:00100000:3.0:1784093617.532402:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629440 00000100:00100000:1.0:1784093617.532415:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629312 00000100:00100000:1.0:1784093617.532453:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629312 00000100:00100000:3.0:1784093617.532489:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:1.0:1784093617.532495:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 567 00000100:00100000:3.0:1784093617.532501:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013629440:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093617.532508:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013629312:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784093617.532570:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093617.532612:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013629440:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 114us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093617.532619:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:1.0:1784093617.535618:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013629312:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 3102us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093617.535632:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 567 00010000:00010000:0.0:1784093617.641824:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093618.153626:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024187136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093618.153714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093618.153791:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024187648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093618.153794:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024187264:0@lo:400:kworker.0 00000100:00100000:3.0:1784093618.153807:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024187392:0@lo:400:kworker.0 00000100:00100000:2.0:1784093618.153808:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024187520:0@lo:400:kworker.0 00000100:00100000:0.0:1784093618.153828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093618.153884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093618.153913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093618.153928:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187648 00000100:00100000:1.0:1784093618.153929:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024187776:0@lo:400:kworker.0 00000100:00100000:0.0:1784093618.153937:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187648 00000100:00100000:1.0:1784093618.153962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093618.153966:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187136 00000100:00100000:3.0:1784093618.153982:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187136 00000100:00100000:0.0:1784093618.154008:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1784093618.154009:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187392 00000100:00100000:1.0:1784093618.154015:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187392 00000100:00100000:0.0:1784093618.154023:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024187648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093618.154029:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784093618.154040:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024187136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093618.154051:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187776 00000100:00100000:1.0:1784093618.154055:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187776 00002000:00000024:3.0:1784093618.154070:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093618.154086:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024187648:12345-0@lo:400:kworker.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093618.154094:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784093618.154112:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024187136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093618.154121:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784093618.154138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093618.154138:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187264 00000100:00100000:0.0:1784093618.154145:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187264 00000100:00080000:3.0:1784093618.154153:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093618.154160:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093618.154163:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187520 00000100:00080000:3.0:1784093618.154164:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093618.154168:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187520 00000100:00100000:0.0:1784093618.154186:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1784093618.154193:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1784093618.154198:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024187264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093618.154210:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1784093618.154210:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024187392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093618.154225:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024187776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093618.154249:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1784093618.154259:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024187520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093618.154288:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024187392:12345-0@lo:400:kworker.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093618.154293:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024187264:12345-0@lo:400:kworker.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093618.154302:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1784093618.154306:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1784093618.154322:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024187520:12345-0@lo:400:kworker.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093618.154329:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1784093618.154355:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024187392:0@lo:400:kworker.0 00000100:00080000:1.0:1784093618.154358:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093618.154362:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024187648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093618.154385:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024187520:0@lo:400:kworker.0 00000100:00100000:3.0:1784093618.154398:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024187776:12345-0@lo:400:kworker.0 Request processed in 176us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093618.154399:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024187136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093618.154413:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1784093618.154415:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024187264:0@lo:400:kworker.0 00000100:00100000:1.0:1784093618.154452:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024187776:0@lo:400:kworker.0 00010000:00010000:2.0:1784093618.665642:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093619.690023:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093620.201873:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093620.201924:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024187904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093620.202022:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093620.202086:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024187904 00000100:00100000:3.0:1784093620.202097:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024187904 00000100:00080000:2.0:1784093620.202156:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093620.202180:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1784093620.202192:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024187904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093620.202248:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093620.202313:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024187904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093620.202323:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1784093620.202373:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024187904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093620.713740:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093621.737658:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093622.649226:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093622.649278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093622.649302:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629824 00000100:00100000:2.0:1784093622.649315:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093622.649371:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629824 00000100:00100000:2.0:1784093622.649384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093622.649416:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013629952 00000100:00100000:0.0:1784093622.649416:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630080 00000100:00100000:0.0:1784093622.649458:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630080 00000100:00100000:2.0:1784093622.649465:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630208 00000100:00100000:3.0:1784093622.649471:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013629952 00000100:00100000:2.0:1784093622.649473:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630208 00000100:00100000:1.0:1784093622.649518:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 569 00000100:00100000:1.0:1784093622.649537:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013629824:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093622.649538:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 310 00000100:00100000:2.0:1784093622.649552:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 311 00000100:00100000:0.0:1784093622.649555:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013630080:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093622.649571:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 495 00000100:00100000:2.0:1784093622.649573:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013630208:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093622.649606:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013629952:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093622.649846:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013629824:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 315us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093622.649855:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 569 00000100:00100000:0.0:1784093622.650066:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013630080:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 516us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093622.650074:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 310 00000100:00100000:2.0:1784093622.650092:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013630208:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 527us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093622.650101:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 311 00000100:00080000:0.0:1784093622.650136:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093622.650143:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093622.650148:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093622.650170:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013629952:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 582us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093622.650180:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 495 00010000:00010000:2.0:1784093622.761674:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093623.273848:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024188160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093623.273880:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024188032:0@lo:400:kworker.0 00000100:00100000:0.0:1784093623.273937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093623.273951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093623.274054:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188032 00000100:00100000:1.0:1784093623.274062:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188032 00000100:00100000:3.0:1784093623.274066:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188160 00000100:00100000:3.0:1784093623.274076:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188160 00000100:00100000:1.0:1784093623.274116:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1784093623.274126:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024188032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093623.274150:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1784093623.274165:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024188160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093623.274207:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024188032:12345-0@lo:400:kworker.0 Request processed in 81us (254us total) trans 0 rc 0/0 00002000:00000024:3.0:1784093623.274208:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093623.274226:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1784093623.274289:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024188544:0@lo:400:kworker.0 00000100:00100000:3.0:1784093623.274297:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024188160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093623.274308:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784093623.274308:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024188288:0@lo:400:kworker.0 00000100:00100000:1.0:1784093623.274332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784093623.274343:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093623.274366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093623.274377:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024188416:0@lo:400:kworker.0 00000100:00100000:1.0:1784093623.274391:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024188032:0@lo:400:kworker.0 00000100:00100000:2.0:1784093623.274407:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093623.274456:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024188672:0@lo:400:kworker.0 00000100:00100000:3.0:1784093623.274459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093623.274493:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188288 00000100:00100000:1.0:1784093623.274499:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188288 00000100:00100000:1.0:1784093623.274538:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188416 00000100:00100000:0.0:1784093623.274554:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024188160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093623.274555:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188416 00000100:00100000:2.0:1784093623.274605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093623.274622:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188672 00000100:00100000:1.0:1784093623.274628:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188672 00000100:00100000:1.0:1784093623.274654:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1784093623.274662:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1784093623.274665:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024188288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093623.274673:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024188416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093623.274759:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024188288:12345-0@lo:400:kworker.0 Request processed in 98us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093623.274766:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1784093623.274781:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1784093623.274788:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024188672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093623.274828:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024188416:12345-0@lo:400:kworker.0 Request processed in 156us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093623.274829:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024188672:12345-0@lo:400:kworker.0 Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093623.274844:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1784093623.274851:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1784093623.274885:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024188672:0@lo:400:kworker.0 00000100:00100000:2.0:1784093623.274904:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024188288:0@lo:400:kworker.0 00000100:00100000:1.0:1784093623.274929:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188544 00000100:00100000:1.0:1784093623.274934:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188544 00000100:00080000:2.0:1784093623.274942:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093623.274949:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093623.274981:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1784093623.274990:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024188544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093623.275053:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024188544:12345-0@lo:400:kworker.0 Request processed in 62us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093623.275056:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024188416:0@lo:400:kworker.0 00000100:00100000:1.0:1784093623.275077:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784093623.275180:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024188544:0@lo:400:kworker.0 00000100:00100000:2.0:1784093623.406914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093623.407008:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630336 00000100:00100000:0.0:1784093623.407022:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630336 00000100:00100000:0.0:1784093623.407105:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 361 00000100:00100000:0.0:1784093623.407119:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013630336:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093623.407277:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013630336:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093623.407286:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 361 00000100:00100000:1.0:1784093623.409603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093623.409693:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630464 00000100:00100000:2.0:1784093623.409708:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630464 00000100:00100000:2.0:1784093623.409783:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 176 00000100:00100000:2.0:1784093623.409818:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013630464:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093623.410404:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013630464:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 588us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093623.410414:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 176 00000100:00100000:2.0:1784093623.412740:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093623.412803:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630592 00000100:00100000:0.0:1784093623.412817:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630592 00000100:00100000:0.0:1784093623.412880:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 177 00000100:00100000:0.0:1784093623.412891:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013630592:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093623.413265:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013630592:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 376us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093623.413273:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 177 00000100:00100000:3.0:1784093623.414836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093623.416348:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630720 00000100:00100000:1.0:1784093623.416366:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630720 00000100:00100000:1.0:1784093623.416510:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:1.0:1784093623.416522:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013630720:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093623.417100:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013630720:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 579us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093623.417124:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:1.0:1784093623.422603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093623.422693:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630848 00000100:00100000:0.0:1784093623.422707:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630848 00000100:00100000:0.0:1784093623.422789:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 363 00000100:00100000:0.0:1784093623.422799:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013630848:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093623.422924:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013630848:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 126us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093623.422930:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 363 00000100:00100000:2.0:1784093623.424351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093623.424481:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013630976 00000100:00100000:1.0:1784093623.424489:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013630976 00000100:00100000:1.0:1784093623.424541:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 178 00000100:00100000:1.0:1784093623.424549:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013630976:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093623.424913:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013630976:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 364us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093623.424919:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 178 00000100:00100000:3.0:1784093623.425981:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093623.426032:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013631104 00000100:00100000:2.0:1784093623.426038:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013631104 00000100:00100000:2.0:1784093623.426070:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 179 00000100:00100000:2.0:1784093623.426076:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013631104:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093623.426257:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:35086:x1870757013631104:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 181us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093623.426263:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 179 00000100:00100000:2.0:1784093623.427611:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093623.427672:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013631232 00000100:00100000:0.0:1784093623.427678:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013631232 00000100:00100000:0.0:1784093623.427719:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 364 00000100:00100000:0.0:1784093623.427728:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013631232:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093623.428072:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35086:x1870757013631232:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 343us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093623.428080:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 364 00000100:00100000:0.0:1784093623.439616:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093623.439699:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013631360 00000100:00100000:1.0:1784093623.439709:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013631360 00000100:00100000:1.0:1784093623.439822:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 365 00000100:00100000:1.0:1784093623.439831:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:35087:x1870757013631360:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093623.439849:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093623.439866:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5497 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093623.439921:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c949c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093623.439931:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c949c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093623.439941:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c949c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093623.440120:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:1.0:1784093623.440126:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093623.440180:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c949c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093623.440200:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5497 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093623.440218:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c949c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5497 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093623.440227:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781700) 00010000:00010000:1.0:1784093623.440230:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093623.440234:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784093623.440290:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:35087:x1870757013631360:12345-192.168.204.57@tcp:101:rm.0 Request processed in 459us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093623.440296:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 365 00000100:00100000:3.0:1784093623.442378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093623.442468:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013631616 00000100:00100000:0.0:1784093623.442480:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013631616 00000100:00100000:0.0:1784093623.442532:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 366 00000100:00100000:0.0:1784093623.442540:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:35087:x1870757013631616:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093623.442562:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093623.442599:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c94a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf549e expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093623.442877:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00010000:00010000:0.0:1784093623.443079:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c94a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf549e expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.443092:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784093623.443094:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784093623.443097:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c94a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf549e expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.443113:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784093623.443183:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:35087:x1870757013631616:12345-192.168.204.57@tcp:101:rm.0 Request processed in 644us (818us total) trans 4294967444 rc 301/301 00000100:00100000:0.0:1784093623.443188:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 366 00000100:00100000:3.0:1784093623.445443:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093623.445943:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013631744 00000100:00100000:1.0:1784093623.445953:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013631744 00000100:00100000:1.0:1784093623.446010:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 40 00000100:00100000:1.0:1784093623.446021:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:35087:x1870757013631744:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784093623.448779:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:35087:x1870757013631744:12345-192.168.204.57@tcp:37:rm.0 Request processed in 2753us (3355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093623.448791:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 40 00000100:00100000:3.0:1784093623.450645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093623.450802:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632000 00000100:00100000:2.0:1784093623.450811:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632000 00000100:00100000:2.0:1784093623.450865:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 41 00000100:00100000:2.0:1784093623.450875:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:35087:x1870757013632000:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784093623.451364:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:35087:x1870757013632000:12345-192.168.204.57@tcp:35:rm.0 Request processed in 490us (722us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1784093623.451372:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 41 00000100:00100000:3.0:1784093623.452827:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093623.452875:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632256 00000100:00100000:0.0:1784093623.452881:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632256 00000100:00100000:0.0:1784093623.452913:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 367 00000100:00100000:0.0:1784093623.452919:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:35087:x1870757013632256:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093623.452957:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784093623.452983:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c949c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5497 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453024:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5482 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453036:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c90e4) 00010000:00010000:0.0:1784093623.453040:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff90721a781700) 00010000:00010000:0.0:1784093623.453053:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093623.453077:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453089:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453097:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453109:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453115:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453121:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453407:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453416:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453468:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453607:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453615:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453621:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453627:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093623.453632:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453639:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453648:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093623.453650:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093623.453653:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453657:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453670:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453673:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453682:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453685:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093623.453687:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453690:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453694:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784093623.453696:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093623.453697:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453701:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453707:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453710:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453713:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453716:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093623.453718:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453727:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453732:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6b400) 00010000:00010000:0.0:1784093623.453733:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093623.453734:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093623.453737:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c94b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093623.453797:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:35087:x1870757013632256:12345-192.168.204.57@tcp:36:rm.0 Request processed in 877us (973us total) trans 0 rc -13/-13 00000100:00100000:0.0:1784093623.453805:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 367 00010000:00010000:1.0:1784093623.785620:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093624.000695:0:57957:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed1575f40 20000000:00000080:3.0:1784093624.000715:0:57957:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720b846c00 uarg=0000000000000000 00010000:00010000:3.0:1784093624.001195:0:57957:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093624.001210:0:57957:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093624.001223:0:57957:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093624.001245:0:57957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.001263:0:57957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c941e expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.001271:0:57957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.001310:0:57957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c941e expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.001324:0:57957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c941e expref: 18 pid: 5771 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093624.001338:0:57957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57957:1870757024188800:0@lo:104: 00000100:00100000:3.0:1784093624.001406:0:57957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093624.001519:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188800 00000100:00100000:2.0:1784093624.001526:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188800 00000100:00100000:2.0:1784093624.001590:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784093624.001600:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:57957:x1870757024188800:12345-0@lo:104: 00010000:00010000:2.0:1784093624.001621:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093624.001637:0:57957:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839a80 going to sleep for 11 seconds 00010000:00010000:2.0:1784093624.001682:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093624.001689:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:57957:x1870757024188800:12345-0@lo:104: Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093624.001695:0:57957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:57957:1870757024188800:0@lo:104: 00000100:00100000:2.0:1784093624.001698:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00010000:3.0:1784093624.001722:0:57957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.001773:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093624.001780:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.001789:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093624.001792:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.001801:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093624.001809:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093624.001815:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093624.001851:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.001858:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093624.001897:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.001905:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214c941e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9425 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.001918:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093624.001920:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093624.001922:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093624.001976:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024188928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093624.002008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093624.002060:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024188928 00000100:00100000:3.0:1784093624.002066:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024188928 00010000:00010000:3.0:1784093624.002086:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c941e expref: 19 pid: 5771 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093624.002119:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784093624.002127:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024188928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093624.002138:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093624.002150:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c941e expref: 19 pid: 5771 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002161:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c941e expref: 19 pid: 5771 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002174:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214c9425 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c941e expref: 19 pid: 5771 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002186:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002202:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002215:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002222:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002229:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002235:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002241:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093624.002245:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002252:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002276:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093624.002286:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093624.002301:0:57957:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.002310:0:57957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093624.002317:0:57957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214c94c6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093624.002328:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024188928:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093624.002337:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784093624.002935:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024188928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093624.809582:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093625.321658:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024189056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093625.321723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093625.321767:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189056 00000100:00100000:1.0:1784093625.321775:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189056 00000100:00080000:2.0:1784093625.321822:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093625.321843:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784093625.321865:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024189056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093625.321912:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093625.321980:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024189056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093625.321989:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784093625.322085:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024189056:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1784093625.322470:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093625.322475:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093625.322478:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093625.322509:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093625.322530:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093625.322552:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093625.322578:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024189184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093625.322618:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093625.322659:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093625.322675:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189184 00000100:00100000:1.0:1784093625.322681:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189184 00000100:00100000:1.0:1784093625.322718:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1784093625.322726:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024189184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093625.322736:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093625.322755:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c94cd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093625.322788:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c94cd expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093625.322798:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c94cd expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093625.322806:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784093625.322843:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024189184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093625.322850:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1784093625.322868:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d01f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024189184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093625.322887:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093625.322897:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093625.322913:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093625.322919:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093625.322927:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093625.833613:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093626.173998:0:58248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff514dc580 20000000:00000080:2.0:1784093626.174015:0:58248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e145000 uarg=0000000000000000 00010000:00010000:2.0:1784093626.174230:0:58248:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093626.174248:0:58248:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093626.174262:0:58248:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093626.174280:0:58248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093626.174296:0:58248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c94cd expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093626.174305:0:58248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093626.174342:0:58248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c94cd expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093626.174367:0:58248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c94cd expref: 18 pid: 5772 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093626.174382:0:58248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58248:1870757024189312:0@lo:104: 00000100:00100000:2.0:1784093626.174514:0:58248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093626.174571:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189312 00000100:00100000:0.0:1784093626.174579:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189312 00000100:00100000:2.0:1784093626.174610:0:58248:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28780 going to sleep for 11 seconds 00000100:00100000:0.0:1784093626.174629:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784093626.174640:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:58248:x1870757024189312:12345-0@lo:104: 00010000:00010000:0.0:1784093626.174660:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.174731:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093626.174739:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:58248:x1870757024189312:12345-0@lo:104: Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093626.174747:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1784093626.174756:0:58248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58248:1870757024189312:0@lo:104: 00010000:00010000:2.0:1784093626.174778:0:58248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.174883:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093626.174889:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.174895:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093626.174898:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.174903:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093626.174908:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093626.174911:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093626.174937:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.174943:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093626.174971:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.174989:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214c94cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c94d4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175005:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093626.175006:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093626.175008:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093626.175016:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093626.175027:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024189440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093626.175056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093626.175087:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189440 00000100:00100000:3.0:1784093626.175091:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189440 00010000:00010000:3.0:1784093626.175110:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c94cd expref: 19 pid: 5772 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093626.175135:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784093626.175143:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024189440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093626.175153:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093626.175159:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c94cd expref: 19 pid: 5772 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175169:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c94cd expref: 19 pid: 5772 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175181:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214c94d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c94cd expref: 19 pid: 5772 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175192:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175211:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175222:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175228:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175235:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175241:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175247:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093626.175251:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175257:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175276:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093626.175285:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093626.175304:0:58248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093626.175316:0:58248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093626.175317:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024189440:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (258us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093626.175333:0:58248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41000/0x9ce98053214c94db lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093626.175334:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784093626.175369:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024189440:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784093626.529150:0:58296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe437a0a40 20000000:00000080:0.0:1784093626.529166:0:58296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3bc000 uarg=0000000000000000 00010000:00010000:0.0:1784093626.529368:0:58296:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093626.529378:0:58296:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093626.529387:0:58296:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093626.529402:0:58296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529413:0:58296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529496:0:58296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529504:0:58296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529511:0:58296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529529:0:58296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529537:0:58296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093626.529546:0:58296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529555:0:58296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529568:0:58296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529580:0:58296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093626.529587:0:58296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77800/0x9ce98053214c94e2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093626.859609:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093627.771042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093627.771089:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632384 00000100:00100000:1.0:1784093627.771099:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632384 00000100:00100000:0.0:1784093627.771100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.771147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093627.771156:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:2.0:1784093627.771161:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632512 00000100:00100000:2.0:1784093627.771167:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632512 00000100:00100000:1.0:1784093627.771171:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013632384:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093627.771187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.771224:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632640 00000100:00100000:0.0:1784093627.771229:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632640 00000100:00100000:2.0:1784093627.771239:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:2.0:1784093627.771251:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013632512:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093627.771265:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013632384:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.771268:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632768 00000100:00100000:0.0:1784093627.771273:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632768 00000100:00100000:1.0:1784093627.771284:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:2.0:1784093627.771293:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013632512:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093627.771301:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:0.0:1784093627.771328:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 313 00000100:00080000:2.0:1784093627.771334:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093627.771340:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093627.771346:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093627.771346:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013632640:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093627.771381:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013632640:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.771389:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 313 00000100:00100000:0.0:1784093627.771402:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 314 00000100:00100000:0.0:1784093627.771409:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013632768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093627.771475:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013632768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.771485:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 314 00000100:00100000:3.0:1784093627.806605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.806647:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013632896 00000100:00100000:0.0:1784093627.806655:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013632896 00000100:00100000:0.0:1784093627.806708:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 368 00000100:00100000:0.0:1784093627.806727:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:35272:x1870757013632896:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093627.806747:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093627.806767:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54a5 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.806824:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.806837:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.806848:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093627.807013:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784093627.807016:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093627.807080:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.807098:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c94e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54a5 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.807109:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54a5 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.807120:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093627.807123:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093627.807125:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784093627.807173:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:35272:x1870757013632896:12345-192.168.204.57@tcp:101:rm.0 Request processed in 456us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.807180:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 368 00000100:00100000:1.0:1784093627.809569:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.809611:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013633024 00000100:00100000:0.0:1784093627.809620:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013633024 00000100:00100000:0.0:1784093627.809665:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 369 00000100:00100000:0.0:1784093627.809674:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:35272:x1870757013633024:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093627.809690:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093627.809706:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c94f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54ac expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.809757:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.809770:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.809781:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.809795:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.809802:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.809823:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810110:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c950c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810119:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c950c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810126:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c950c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093627.810204:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00000004:00200000:0.0:1784093627.810208:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093627.810270:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c950c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810296:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810303:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810310:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810316:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093627.810320:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810328:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810343:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093627.810346:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093627.810350:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810356:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c94fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810367:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810374:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810380:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810385:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093627.810387:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810392:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810398:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6b100) 00010000:00010000:0.0:1784093627.810400:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093627.810403:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810408:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810469:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c94f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54ac expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810482:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c950c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54ac expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.810490:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784093627.810509:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093627.810512:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784093627.810564:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:35272:x1870757013633024:12345-192.168.204.57@tcp:101:rm.0 Request processed in 892us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.810571:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 369 00000100:00100000:2.0:1784093627.813639:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093627.813847:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013633280 00000100:00100000:3.0:1784093627.813857:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013633280 00000100:00100000:3.0:1784093627.813937:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:3.0:1784093627.813944:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:35272:x1870757013633280:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093627.813964:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093627.813984:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54b3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093627.814199:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00010000:00010000:3.0:1784093627.814342:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9513 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54b3 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.814356:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:3.0:1784093627.814359:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784093627.814364:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54b3 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.814378:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093627.814607:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:35272:x1870757013633280:12345-192.168.204.57@tcp:101:rm.0 Request processed in 661us (977us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1784093627.814615:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:3.0:1784093627.816779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093627.816870:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013633408 00000100:00100000:2.0:1784093627.816882:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013633408 00000100:00100000:2.0:1784093627.816942:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 42 00000100:00100000:2.0:1784093627.816953:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:35272:x1870757013633408:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784093627.820588:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:35272:x1870757013633408:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3628us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093627.820602:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 42 00000100:00100000:0.0:1784093627.825403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093627.825463:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013633664 00000100:00100000:1.0:1784093627.825473:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013633664 00000100:00100000:1.0:1784093627.825537:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 43 00000100:00100000:1.0:1784093627.825545:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:35272:x1870757013633664:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:1.0:1784093627.825940:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:35272:x1870757013633664:12345-192.168.204.57@tcp:35:rm.0 Request processed in 394us (549us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1784093627.825949:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 43 00000100:00100000:3.0:1784093627.827588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.827726:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013633920 00000100:00100000:0.0:1784093627.827736:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013633920 00000100:00100000:0.0:1784093627.827846:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 371 00000100:00100000:0.0:1784093627.827854:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:35272:x1870757013633920:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093627.827899:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093627.827924:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c950c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54ac expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.827941:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784093627.827956:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c94f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54a5 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.827966:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093627.827986:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093627.828010:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828022:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828032:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828043:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828051:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828057:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828400:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828410:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.828417:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093627.829359:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x19:0x0]: returning size 7680 00010000:00010000:0.0:1784093627.829377:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829382:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829392:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829396:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093627.829398:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829404:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829411:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093627.829413:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093627.829416:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829446:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c952f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829461:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829465:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829469:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829472:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093627.829474:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829484:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829490:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784093627.829504:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093627.829507:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.829514:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9521 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093627.829524:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000060d37537 reply state 00000000aa3a1d43 transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093627.829530:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093627.829604:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:35272:x1870757013633920:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1748us (2021us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1784093627.829612:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 371 00010000:00010000:2.0:1784093627.831356:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.831371:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.831377:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.831383:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093627.831386:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.831394:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.831408:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6b800) 00010000:00010000:2.0:1784093627.831412:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093627.831415:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.831521:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9528 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093627.853089:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.853185:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013634048 00000100:00100000:0.0:1784093627.853198:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013634048 00000100:00100000:0.0:1784093627.853274:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 372 00000100:00100000:0.0:1784093627.853286:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:35276:x1870757013634048:12345-192.168.204.57@tcp:101:mkdir.0 00010000:00010000:0.0:1784093627.853335:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093627.853359:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54ba expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.853416:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c953d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.853477:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c953d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.853488:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c953d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093627.853563:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784093627.853566:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093627.853587:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c953d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.853607:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54ba expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.853623:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c953d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54ba expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.853631:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784093627.853634:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093627.853637:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093627.853707:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:35276:x1870757013634048:12345-192.168.204.57@tcp:101:mkdir.0 Request processed in 424us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.853714:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 372 00000100:00100000:3.0:1784093627.856529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093627.856678:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013634176 00000100:00100000:2.0:1784093627.856691:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013634176 00000100:00100000:2.0:1784093627.856761:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 373 00000100:00100000:2.0:1784093627.856773:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:2353:x1870757013634176:12345-192.168.204.57@tcp:41:mkdir.0 00000004:00000024:2.0:1784093627.856832:0:5778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784093627.856992:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:2353:x1870757013634176:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 222us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093627.856999:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 373 00000100:00100000:3.0:1784093627.857195:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.857288:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013634432 00000100:00100000:0.0:1784093627.857292:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013634432 00000100:00100000:0.0:1784093627.857388:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 374 00000100:00100000:0.0:1784093627.857395:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:35276:x1870757013634432:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:0.0:1784093627.857460:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093627.857510:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c953d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54ba expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.857536:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784093627.857550:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093627.857714:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.857728:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.857739:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.857753:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.857759:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.857765:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093627.859000:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 512 00010000:00010000:0.0:1784093627.859021:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.859032:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.859039:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.859072:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093627.859077:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.859084:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.859100:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093627.859104:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093627.859109:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.859115:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9544 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093627.859140:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000fa925aec reply state 00000000d558570d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093627.859148:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093627.859255:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:35276:x1870757013634432:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1856us (2056us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1784093627.859263:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 374 00010000:00010000:2.0:1784093627.860802:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.860819:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.860826:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.860832:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093627.860837:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.860845:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.860861:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6ba00) 00010000:00010000:2.0:1784093627.860874:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093627.860879:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.860886:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c954b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.881797:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093627.889922:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.889976:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013634560 00000100:00100000:0.0:1784093627.889991:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013634560 00000100:00100000:0.0:1784093627.890076:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 375 00000100:00100000:0.0:1784093627.890090:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:35280:x1870757013634560:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784093627.890127:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093627.890179:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54c1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.890279:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9559 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.890297:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.890312:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093627.890569:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784093627.890574:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093627.890662:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.890692:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54c1 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.890712:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54c1 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.890722:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093627.890725:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093627.890729:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093627.890798:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:35280:x1870757013634560:12345-192.168.204.57@tcp:101:chown.0 Request processed in 712us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093627.890806:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 375 00000100:00100000:0.0:1784093627.892723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093627.892786:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013634688 00000100:00100000:2.0:1784093627.892798:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013634688 00000100:00100000:2.0:1784093627.892860:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 376 00000100:00100000:2.0:1784093627.892873:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:35280:x1870757013634688:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093627.892896:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093627.892918:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54c8 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.892983:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893001:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893012:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893026:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893031:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893036:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893441:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893449:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893455:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093627.893595:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:2.0:1784093627.893599:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093627.893726:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893740:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893747:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893753:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893760:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093627.893765:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893773:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893786:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784093627.893795:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093627.893801:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893807:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893828:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893835:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893842:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893847:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093627.893851:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893858:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893868:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781600) 00010000:00010000:2.0:1784093627.893872:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093627.893875:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893881:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c956e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893920:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54c8 expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893951:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54c8 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093627.893959:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784093627.893962:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093627.893964:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784093627.894044:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+13:35280:x1870757013634688:12345-192.168.204.57@tcp:101:chown.0 Request processed in 1173us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093627.894054:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 376 00000100:00100000:2.0:1784093627.897072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093627.897126:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013634944 00000100:00100000:0.0:1784093627.897139:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013634944 00000100:00100000:0.0:1784093627.897200:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 377 00000100:00100000:0.0:1784093627.897211:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+13:35280:x1870757013634944:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:0.0:1784093627.897281:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093627.897313:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54c8 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.897354:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784093627.897366:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093627.897391:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.897403:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093627.897416:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093627.898077:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000612f3aa7 reply state 00000000e6229ea6 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093627.898089:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093627.898165:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000100:00100000:0.0:1784093627.898266:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+14:35280:x1870757013634944:12345-192.168.204.57@tcp:36:chown.0 Request processed in 1057us (1206us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1784093627.898274:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 377 00010000:00010000:3.0:1784093627.900883:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.900902:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.900910:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.900918:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093627.900924:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.900932:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.900951:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b100) 00010000:00010000:3.0:1784093627.900955:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093627.900960:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093627.900967:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c957c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784093627.904946:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 10000000:01000000:3.0:1784093628.073599:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093628.073607:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093628.073612:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093628.073656:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.073668:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.073796:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093628.073826:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024189568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093628.073896:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093628.073950:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093628.074013:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189568 00000100:00100000:1.0:1784093628.074021:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189568 00000100:00100000:1.0:1784093628.074139:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1784093628.074149:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024189568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093628.074164:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093628.074179:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9583 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093628.074202:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9583 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093628.074214:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9583 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093628.074224:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093628.074271:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024189568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093628.074279:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1784093628.074356:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024189568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093628.074372:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.074381:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093628.074400:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093628.074405:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.074412:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093628.273075:0:58495:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea17dca80 20000000:00000080:2.0:1784093628.273101:0:58495:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723752f400 uarg=0000000000000000 00010000:00010000:2.0:1784093628.273718:0:58495:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784093628.273767:0:58495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784093628.273771:0:58495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093628.273785:0:58495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9559 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54c1 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093628.273811:0:58495:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784093628.273829:0:58495:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093628.273847:0:58495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093628.273863:0:58495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9583 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093628.273872:0:58495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093628.273928:0:58495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9583 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093628.273944:0:58495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9583 expref: 18 pid: 5772 timeout: 939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093628.273963:0:58495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aa9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58495:1870757024189696:0@lo:104: 00000100:00100000:2.0:1784093628.274046:0:58495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093628.274121:0:58495:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784093628.274126:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189696 00000100:00100000:1.0:1784093628.274137:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189696 00000100:00100000:1.0:1784093628.274194:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784093628.274207:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:58495:x1870757024189696:12345-0@lo:104: 00010000:00010000:1.0:1784093628.274223:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093628.274307:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093628.274314:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:58495:x1870757024189696:12345-0@lo:104: Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093628.274323:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00010000:3.0:1784093628.274353:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784093628.274364:0:58495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aa9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58495:1870757024189696:0@lo:104: 00010000:00010000:3.0:1784093628.274371:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093628.274382:0:58495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.274418:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093628.274457:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.274503:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093628.274511:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093628.274518:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093628.274577:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.274584:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093628.274615:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.274624:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c9583 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c958a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093628.274641:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024189824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093628.274648:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093628.274652:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093628.274654:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093628.274682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093628.274730:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189824 00000100:00100000:0.0:1784093628.274736:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189824 00010000:00010000:0.0:1784093628.274771:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9583 expref: 19 pid: 5772 timeout: 939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093628.274799:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784093628.274808:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024189824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093628.274821:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093628.274827:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9583 expref: 19 pid: 5772 timeout: 939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274837:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9583 expref: 19 pid: 5772 timeout: 939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274851:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12c00/0x9ce98053214c958a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9583 expref: 19 pid: 5772 timeout: 939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274864:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274872:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274886:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274891:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274896:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274900:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274910:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093628.274914:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274921:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274934:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093628.274944:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093628.274976:0:58495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093628.274978:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024189824:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (296us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093628.274994:0:58495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093628.274995:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00010000:2.0:1784093628.275005:0:58495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214c9591 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093628.275017:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024189824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093628.393545:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093628.393568:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024189952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093628.393668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093628.393720:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024190208:0@lo:400:kworker.0 00000100:00100000:2.0:1784093628.393759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093628.393800:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024190336:0@lo:400:kworker.0 00000100:00100000:0.0:1784093628.393810:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190208 00000100:00100000:0.0:1784093628.393820:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190208 00000100:00100000:1.0:1784093628.393824:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024189952 00000100:00100000:3.0:1784093628.393831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093628.393832:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024189952 00000100:00100000:3.0:1784093628.393856:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093628.393865:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024190464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093628.393890:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1784093628.393891:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1784093628.393908:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093628.393909:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024190208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093628.393910:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024189952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093628.393953:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093628.393956:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024190080:0@lo:400:kworker.0 00000100:00100000:0.0:1784093628.393979:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024190208:12345-0@lo:400:kworker.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093628.393989:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1784093628.394006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093628.394013:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024189952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093628.394059:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024190208:0@lo:400:kworker.0 00000100:00080000:2.0:1784093628.394087:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093628.394092:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093628.394101:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190336 00000100:00100000:2.0:1784093628.394110:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190336 00000100:00100000:2.0:1784093628.394142:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1784093628.394149:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024190336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093628.394179:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024190336:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093628.394185:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784093628.394223:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784093628.394399:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190464 00000100:00100000:0.0:1784093628.394403:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190464 00000100:00100000:0.0:1784093628.394444:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190080 00000100:00100000:0.0:1784093628.394447:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190080 00000100:00100000:0.0:1784093628.394457:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1784093628.394461:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024190464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093628.394505:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024190464:12345-0@lo:400:kworker.0 Request processed in 42us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093628.394514:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1784093628.394524:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1784093628.394530:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024190080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784093628.394530:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093628.394536:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093628.394581:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024190080:12345-0@lo:400:kworker.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093628.394590:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1784093628.394590:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024190464:0@lo:400:kworker.0 00000100:00100000:2.0:1784093628.394610:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024190336:0@lo:400:kworker.0 00000100:00100000:2.0:1784093628.394630:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024189952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093628.394635:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024190080:0@lo:400:kworker.0 00000020:00000080:3.0:1784093628.657985:0:58543:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd470ade60 20000000:00000080:3.0:1784093628.658002:0:58543:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d68c00 uarg=0000000000000000 00010000:00010000:3.0:1784093628.658303:0:58543:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093628.658319:0:58543:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093628.658333:0:58543:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093628.658352:0:58543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658367:0:58543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658378:0:58543:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658385:0:58543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658392:0:58543:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658400:0:58543:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658412:0:58543:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093628.658416:0:58543:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658444:0:58543:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658458:0:58543:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658466:0:58543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.658473:0:58543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214c9598 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093628.905611:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093629.929544:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093629.953043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093629.953129:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635072 00000100:00100000:3.0:1784093629.953138:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635072 00000100:00080000:2.0:1784093629.953215:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093629.953271:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 7 00000100:00100000:0.0:1784093629.953284:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:5558:x1870757013635072:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784093629.953306:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093629.953310:0:5763:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9559) 00010000:00010000:0.0:1784093629.953312:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784093629.953368:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:5558:x1870757013635072:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 88us (334us total) trans 0 rc 116/116 00000100:00100000:0.0:1784093629.953373:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 7 10000000:01000000:3.0:1784093629.995677:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093629.995685:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093629.995690:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093629.995735:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093629.995746:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093629.995756:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093629.995801:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024190592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093629.995866:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093629.996007:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190592 00000100:00100000:1.0:1784093629.996016:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190592 00000100:00100000:1.0:1784093629.996076:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1784093629.996086:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024190592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093629.996100:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093629.996119:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c959f expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093629.996143:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c959f expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093629.996154:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c959f expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093629.996164:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093629.996193:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024190592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093629.996198:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1784093629.996281:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784093629.996303:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024190592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093629.996319:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093629.996332:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093629.996353:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093629.996359:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093629.996366:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093630.441692:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024190720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093630.441772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093630.442008:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190720 00000100:00100000:2.0:1784093630.442017:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190720 00000100:00080000:0.0:1784093630.442098:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093630.442101:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784093630.442117:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024190720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093630.442157:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093630.442213:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024190720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093630.442221:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1784093630.442350:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024190720:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1784093630.705830:0:58786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff3307edd0 20000000:00000080:1.0:1784093630.705850:0:58786:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723d734000 uarg=0000000000000000 00010000:00010000:1.0:1784093630.706087:0:58786:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093630.706101:0:58786:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093630.706114:0:58786:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093630.706130:0:58786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.706146:0:58786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c959f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.706155:0:58786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.706195:0:58786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c959f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.706210:0:58786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c959f expref: 18 pid: 5771 timeout: 941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093630.706233:0:58786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58786:1870757024190848:0@lo:104: 00000100:00100000:1.0:1784093630.706291:0:58786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093630.706351:0:58786:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093630.706375:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190848 00000100:00100000:0.0:1784093630.706384:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190848 00000100:00100000:0.0:1784093630.706455:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1784093630.706469:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:58786:x1870757024190848:12345-0@lo:104: 00010000:00010000:0.0:1784093630.706482:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093630.706537:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093630.706543:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:58786:x1870757024190848:12345-0@lo:104: Request processed in 77us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093630.706548:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00010000:3.0:1784093630.706566:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1784093630.706568:0:58786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58786:1870757024190848:0@lo:104: 00010000:00010000:3.0:1784093630.706575:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706584:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093630.706588:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.706590:0:58786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706613:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093630.706619:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093630.706625:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093630.706654:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706659:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093630.706684:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706691:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214c959f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c95a6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093630.706700:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024190976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093630.706707:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093630.706711:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093630.706713:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093630.706732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093630.706761:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024190976 00000100:00100000:3.0:1784093630.706766:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024190976 00010000:00010000:3.0:1784093630.706787:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c959f expref: 19 pid: 5771 timeout: 941 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093630.706813:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1784093630.706823:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024190976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093630.706833:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093630.706838:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c959f expref: 19 pid: 5771 timeout: 941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706855:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c959f expref: 19 pid: 5771 timeout: 941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706868:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214c95a6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c959f expref: 19 pid: 5771 timeout: 941 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706878:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706886:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706898:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706905:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706911:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706918:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706923:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093630.706927:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706933:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706983:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093630.706991:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093630.707029:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024190976:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093630.707037:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784093630.707058:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024190976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093630.707092:0:58786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.707101:0:58786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093630.707107:0:58786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13800/0x9ce98053214c95ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093630.953567:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093631.976558:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093631.976627:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635200 00000100:00100000:3.0:1784093631.976637:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635200 00000100:00100000:3.0:1784093631.976714:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 378 00000100:00100000:3.0:1784093631.976727:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35456:x1870757013635200:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093631.976757:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093631.976783:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c95b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54cf expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784093631.976786:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784093631.976854:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c95bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093631.976870:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c95bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093631.976883:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c95bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093631.977113:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093631.977118:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093631.977226:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c95bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093631.977263:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c95b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54cf expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093631.977283:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c95bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54cf expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093631.977292:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784093631.977295:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093631.977299:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784093631.977361:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:35456:x1870757013635200:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 636us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093631.977369:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 378 00000100:00100000:1.0:1784093631.978854:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093631.979216:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635328 00000100:00100000:0.0:1784093631.979225:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635328 00000100:00100000:0.0:1784093631.979283:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 379 00000100:00100000:0.0:1784093631.979293:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:35456:x1870757013635328:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093631.979310:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093631.979324:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c95c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54d6 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.979373:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.979386:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.979397:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.980668:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.980685:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.980694:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.980966:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c95d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.980974:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c95d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.980981:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c95d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093631.981070:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:0.0:1784093631.981074:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093631.981136:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c95d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981150:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981157:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981164:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981170:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093631.981174:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981182:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981194:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcef00) 00010000:00010000:0.0:1784093631.981197:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093631.981201:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981207:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c95c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981217:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981231:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981237:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981243:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093631.981246:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981252:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981259:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6b700) 00010000:00010000:0.0:1784093631.981262:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093631.981264:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981270:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c95d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981300:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c95c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54d6 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981313:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c95d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54d6 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093631.981320:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784093631.981322:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093631.981329:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784093631.982815:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:35456:x1870757013635328:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 3522us (3962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093631.982825:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 379 00010000:00010000:1.0:1784093631.982947:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093631.985149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093631.985184:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635584 00000100:00100000:1.0:1784093631.985192:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635584 00000100:00100000:1.0:1784093631.985248:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 380 00000100:00100000:1.0:1784093631.985259:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:35456:x1870757013635584:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093631.985304:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093631.985335:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c95d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54d6 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093631.985350:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b900) 00010000:00010000:1.0:1784093631.985361:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093631.985382:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093631.985395:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093631.985405:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784093632.002018:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000004:00010000:1.0:1784093632.002019:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000003661e021 reply state 000000008172ffd0 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093632.002035:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784093632.002038:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000004:00200000:1.0:1784093632.002155:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00010000:00080000:1.0:1784093632.002259:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784093632.002291:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:35456:x1870757013635584:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 17022us (17133us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1784093632.002299:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 380 00010000:00010000:0.0:1784093632.002460:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093632.002470:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093632.002478:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093632.002484:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093632.002489:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093632.002497:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093632.002513:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46200) 00010000:00010000:0.0:1784093632.002516:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093632.002520:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093632.002527:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c95de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093632.365619:0:58981:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed18749b0 20000000:00000080:3.0:1784093632.365640:0:58981:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d6b400 uarg=0000000000000000 00010000:00010000:3.0:1784093632.366143:0:58981:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093632.366178:0:58981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784093632.366181:0:58981:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093632.366192:0:58981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c95bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54cf expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366216:0:58981:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093632.366231:0:58981:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093632.366251:0:58981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366269:0:58981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366294:0:58981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366301:0:58981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366308:0:58981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366316:0:58981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366323:0:58981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093632.366328:0:58981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366338:0:58981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366349:0:58981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366357:0:58981:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.366363:0:58981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68800/0x9ce98053214c95e5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093632.681491:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093632.681498:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093632.681503:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093632.681552:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.681564:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.681576:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093632.681602:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024191104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093632.681666:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093632.681707:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784093632.681828:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191104 00000100:00100000:3.0:1784093632.681835:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191104 00000100:00100000:3.0:1784093632.681890:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1784093632.681902:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024191104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093632.681916:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093632.681929:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c95ec expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.681953:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c95ec expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.681965:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c95ec expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.681974:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784093632.682015:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024191104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093632.682023:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1784093632.682087:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024191104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093632.682102:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.682111:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093632.682129:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093632.682135:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093632.682143:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093632.888808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093632.888856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093632.888876:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635840 00000100:00100000:2.0:1784093632.888887:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635840 00000100:00100000:3.0:1784093632.888899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093632.888928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093632.888950:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:2.0:1784093632.888963:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013635840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093632.889167:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013635840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 207us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093632.889176:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:0.0:1784093632.891139:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635712 00000100:00100000:0.0:1784093632.891151:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635712 00000100:00100000:0.0:1784093632.891204:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 576 00000100:00100000:0.0:1784093632.891227:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013635712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093632.891302:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013635712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093632.891308:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 576 00000100:00100000:0.0:1784093632.891342:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013636096 00000100:00100000:0.0:1784093632.891344:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013636096 00000100:00100000:0.0:1784093632.891380:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013635968 00000100:00100000:0.0:1784093632.891383:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013635968 00000100:00100000:0.0:1784093632.891452:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 316 00000100:00100000:0.0:1784093632.891462:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013636096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093632.891471:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 317 00000100:00100000:2.0:1784093632.891483:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013635968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093632.891491:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013636096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 32us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093632.891497:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 316 00000100:00080000:0.0:1784093632.891515:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093632.891519:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093632.891524:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013635968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093632.891532:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 317 00010000:00010000:0.0:1784093633.004571:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093633.513592:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093633.513615:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024191232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093633.513681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093633.513746:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191232 00000100:00100000:1.0:1784093633.513754:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191232 00000100:00100000:1.0:1784093633.513864:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784093633.513874:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024191232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784093633.513916:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093633.513959:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024191232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093633.513966:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784093633.514009:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024191232:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093633.514061:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093633.514407:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024191360:0@lo:400:kworker.0 00000100:00100000:1.0:1784093633.514457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093633.514548:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191360 00000100:00100000:0.0:1784093633.514553:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191360 00000100:00100000:0.0:1784093633.514593:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1784093633.514600:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024191360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.514623:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024191488:0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.514681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093633.514705:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093633.514710:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024191616:0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.514735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093633.514755:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024191744:0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.514776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093633.514798:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191744 00000100:00100000:2.0:1784093633.514802:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191744 00000100:00100000:2.0:1784093633.514831:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1784093633.514836:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024191744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.514865:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024191744:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093633.514872:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:2.0:1784093633.514887:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093633.514902:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024191744:0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.514946:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191488 00000100:00100000:2.0:1784093633.514949:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191488 00000100:00100000:2.0:1784093633.514974:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191616 00000100:00100000:2.0:1784093633.514976:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191616 00000100:00100000:2.0:1784093633.514994:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1784093633.514998:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024191488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.515031:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024191488:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093633.515037:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1784093633.515048:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:2.0:1784093633.515054:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024191616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.515083:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024191616:12345-0@lo:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093633.515089:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00080000:2.0:1784093633.515107:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093633.515124:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024191616:0@lo:400:kworker.0 00000100:00100000:2.0:1784093633.515131:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024191488:0@lo:400:kworker.0 00000100:00100000:0.0:1784093633.515479:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024191360:12345-0@lo:400:kworker.0 Request processed in 879us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093633.515487:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1784093633.515597:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093633.515606:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024191872:0@lo:400:kworker.0 00000100:00100000:3.0:1784093633.515635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093633.515662:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024191872 00000100:00100000:3.0:1784093633.515666:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024191872 00000100:00100000:3.0:1784093633.515695:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1784093633.515702:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024191872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093633.515735:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024191872:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093633.515742:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00080000:3.0:1784093633.515762:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093633.515781:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024191872:0@lo:400:kworker.0 00000100:00100000:1.0:1784093633.516185:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024191360:0@lo:400:kworker.0 00000100:00100000:3.0:1784093633.640945:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093633.640992:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013636224 00000100:00100000:3.0:1784093633.641005:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013636224 00000100:00100000:3.0:1784093633.641080:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 381 00000100:00080000:1.0:1784093633.641088:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093633.641095:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:35533:x1870757013636224:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093633.641124:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093633.641148:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c95fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54dd expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641222:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641238:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641255:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641268:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641274:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641280:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641763:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c960f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641779:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.641787:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093633.641950:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093633.641954:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093633.642038:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c960f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642051:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642058:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642064:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642071:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093633.642075:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642083:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642096:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093633.642100:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093633.642104:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642120:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642134:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642140:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642146:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642151:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093633.642154:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642160:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642168:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce600) 00010000:00010000:3.0:1784093633.642171:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093633.642173:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642179:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642209:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c95fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54dd expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642488:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c960f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54dd expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.642503:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093633.642507:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093633.642510:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784093633.642572:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:35533:x1870757013636224:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1481us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093633.642580:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 381 00000100:00100000:3.0:1784093633.644859:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093633.644968:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013636480 00000100:00100000:1.0:1784093633.644979:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013636480 00000100:00100000:1.0:1784093633.645265:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 382 00000100:00100000:1.0:1784093633.645278:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35533:x1870757013636480:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093633.645681:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093633.645701:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9616 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54e4 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.647817:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.647835:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.647846:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.647864:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.647877:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.647884:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093633.649116:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd:0x0], index 0: 0 00010000:00010000:1.0:1784093633.649667:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c962b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649679:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649688:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c962b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649724:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649730:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649737:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649743:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093633.649747:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649755:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649776:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784093633.649779:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093633.649784:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649790:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c961d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093633.649800:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000081798d59 reply state 00000000e32e6e00 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093633.649809:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093633.649852:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9616 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54e4 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649867:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c962b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54e4 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.649875:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff907202d46e00) 00010000:00010000:1.0:1784093633.649877:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093633.649879:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784093633.649956:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:35533:x1870757013636480:12345-192.168.204.57@tcp:101:touch.0 Request processed in 4680us (5102us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1784093633.649966:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 382 00010000:00010000:2.0:1784093633.652003:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.652015:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.652023:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.652029:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093633.652043:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.652050:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.652063:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202d46000) 00010000:00010000:2.0:1784093633.652065:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093633.652069:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.652080:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9624 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093633.653057:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093633.653237:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013636736 00000100:00100000:2.0:1784093633.653247:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013636736 00000100:00100000:1.0:1784093633.653496:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 383 00000100:00100000:1.0:1784093633.653511:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:35533:x1870757013636736:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:1.0:1784093633.653565:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093633.653595:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c962b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54e4 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.653611:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff907202d46e00) 00010000:00010000:1.0:1784093633.653621:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093633.653660:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.653671:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.653681:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093633.653791:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000000f539b9e reply state 000000008962a871 transno 4294967453 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093633.653800:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093633.653876:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:35533:x1870757013636736:12345-192.168.204.57@tcp:36:touch.0 Request processed in 369us (822us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1784093633.653884:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 383 00010000:00010000:0.0:1784093633.654783:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.654792:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.654806:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.654812:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093633.654815:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.654823:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.654833:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff907202d46800) 00010000:00010000:0.0:1784093633.654836:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093633.654840:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.654846:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9639 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093633.655378:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093633.655462:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013636864 00000100:00100000:2.0:1784093633.655470:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013636864 00000100:00100000:2.0:1784093633.655525:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 384 00000100:00100000:2.0:1784093633.655535:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:35533:x1870757013636864:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093633.655556:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093633.655573:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9640 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54eb expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.655617:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54eb expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.655632:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9640 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54eb expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.655663:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093633.655666:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784093633.655670:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784093633.655712:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:35533:x1870757013636864:12345-192.168.204.57@tcp:101:touch.0 Request processed in 180us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093633.655731:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 384 00000100:00100000:3.0:1784093633.657160:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093633.657209:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013636992 00000100:00100000:0.0:1784093633.657217:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013636992 00000100:00100000:0.0:1784093633.657262:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 180 00000100:00100000:0.0:1784093633.657272:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013636992:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:0.0:1784093633.657626:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013636992:12345-192.168.204.57@tcp:2:touch.0 Request processed in 354us (469us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784093633.657635:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 180 00000100:00100000:1.0:1784093633.658880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093633.658927:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013637248 00000100:00100000:2.0:1784093633.658933:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013637248 00000100:00100000:2.0:1784093633.658966:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 44 00000100:00100000:2.0:1784093633.658975:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:35533:x1870757013637248:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:2.0:1784093633.659192:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:35533:x1870757013637248:12345-192.168.204.57@tcp:35:touch.0 Request processed in 219us (315us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1784093633.659197:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 44 00000100:00100000:3.0:1784093633.680675:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093633.681025:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013637376 00000100:00100000:1.0:1784093633.681034:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013637376 00000100:00100000:1.0:1784093633.681085:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 385 00000100:00100000:1.0:1784093633.681093:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:35537:x1870757013637376:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093633.681113:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093633.681129:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9647 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54f2 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681198:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681213:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681225:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681239:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681246:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681253:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681343:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681349:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681353:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093633.681394:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 0 00000004:00200000:1.0:1784093633.681399:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093633.681418:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681473:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681482:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681488:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681494:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681500:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093633.681504:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681510:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681521:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784093633.681523:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093633.681527:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681533:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c964e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681549:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681554:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681562:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681565:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093633.681567:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681570:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681576:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202d46e00) 00010000:00010000:1.0:1784093633.681577:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093633.681579:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681582:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681605:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9647 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f2 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681613:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f2 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093633.681618:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff90721a781b00) 00010000:00010000:1.0:1784093633.681619:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093633.681621:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13400, rc 0) 00000100:00100000:1.0:1784093633.681681:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:35537:x1870757013637376:12345-192.168.204.57@tcp:101:rm.0 Request processed in 588us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093633.681697:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 385 00000100:00100000:3.0:1784093633.683939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093633.684001:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013637504 00000100:00100000:2.0:1784093633.684011:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013637504 00000100:00100000:2.0:1784093633.684064:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 181 00000100:00100000:2.0:1784093633.684074:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013637504:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093633.684090:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093633.684109:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf54f9 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093633.684133:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x6a571bc1, atime: 0x6a571bc1, ctime: 0x6a571bc1, blocks: 0x1 00010000:00010000:2.0:1784093633.684151:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=794s v=(0 0) 00010000:00010000:2.0:1784093633.684156:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093633.684170:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.684187:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.684201:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093633.684264:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013637504:12345-192.168.204.57@tcp:101:rm.0 Request processed in 191us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093633.684271:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 181 00000100:00100000:3.0:1784093633.687723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093633.687761:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013637760 00000100:00100000:1.0:1784093633.687770:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013637760 00000100:00100000:3.0:1784093633.687854:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 386 00000100:00100000:3.0:1784093633.687866:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:35537:x1870757013637760:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784093633.687916:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093633.687942:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c965c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f2 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.687962:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9640 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54eb expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.687974:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff90721a781b00) 00010000:00010000:3.0:1784093633.687984:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093633.688008:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688036:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688046:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688062:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688069:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688085:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688188:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688196:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688203:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093633.688736:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00000004:00080000:3.0:1784093633.688748:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794766325433ns, next at 795766322817ns, rc = 0 00010000:00010000:3.0:1784093633.688803:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688812:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688830:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688838:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688845:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688852:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688872:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093633.688892:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688899:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688904:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093633.688906:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688911:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688915:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093633.688921:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688937:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093633.688940:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688941:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688959:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.688963:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784093633.688968:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093633.688978:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688980:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff907204fce600) 00010000:00010000:0.0:1784093633.688986:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784093633.688988:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9678 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.688989:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.689003:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c967f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.689015:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093633.689016:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093633.689018:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093633.689021:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093633.689027:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.689033:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.689039:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093633.689042:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.689048:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.689056:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093633.689059:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093633.689062:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093633.689068:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c966a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093633.689078:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000012cb16cb reply state 0000000052eb24ee transno 4294967455 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093633.689097:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093633.689164:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:35537:x1870757013637760:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1299us (1447us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1784093633.689173:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 386 00010000:00010000:2.0:1784093633.690576:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.690587:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.690591:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.690595:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093633.690598:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.690602:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.690609:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907204fce400) 00010000:00010000:2.0:1784093633.690611:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093633.690613:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093633.690624:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9671 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093634.025524:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093634.453051:0:59224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd8d38370 20000000:00000080:3.0:1784093634.453068:0:59224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d68400 uarg=0000000000000000 00010000:00010000:3.0:1784093634.453282:0:59224:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093634.453310:0:59224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093634.453313:0:59224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093634.453324:0:59224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c960f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54dd expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.453351:0:59224:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093634.453379:0:59224:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093634.453394:0:59224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.453408:0:59224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c95ec expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.453416:0:59224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.453548:0:59224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c95ec expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.453562:0:59224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c95ec expref: 18 pid: 5772 timeout: 945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093634.453587:0:59224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59224:1870757024192000:0@lo:104: 00000100:00100000:3.0:1784093634.453651:0:59224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093634.453758:0:59224:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484600 going to sleep for 11 seconds 00000100:00100000:1.0:1784093634.453818:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192000 00000100:00100000:1.0:1784093634.453827:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192000 00000100:00100000:1.0:1784093634.453928:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784093634.453986:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:59224:x1870757024192000:12345-0@lo:104: 00010000:00010000:1.0:1784093634.454001:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093634.454073:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093634.454080:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:59224:x1870757024192000:12345-0@lo:104: Request processed in 144us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093634.454087:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784093634.454095:0:59224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59224:1870757024192000:0@lo:104: 00010000:00010000:3.0:1784093634.454115:0:59224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454157:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093634.454164:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454173:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093634.454177:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454186:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093634.454193:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093634.454199:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093634.454226:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454234:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093634.454268:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454276:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c95ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c95f3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093634.454280:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1784093634.454288:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093634.454291:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024192128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093634.454296:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093634.454298:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093634.454333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093634.454385:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192128 00000100:00100000:2.0:1784093634.454389:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192128 00010000:00010000:2.0:1784093634.454414:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c95ec expref: 19 pid: 5772 timeout: 945 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093634.454454:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784093634.454461:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024192128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093634.454472:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093634.454477:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c95ec expref: 19 pid: 5772 timeout: 945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454487:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c95ec expref: 19 pid: 5772 timeout: 945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454498:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214c95f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c95ec expref: 19 pid: 5772 timeout: 945 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454509:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454518:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454530:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454538:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454545:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454558:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454564:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093634.454567:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454574:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454591:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093634.454601:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093634.454633:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024192128:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093634.454640:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00010000:00010000:3.0:1784093634.454819:0:59224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.454831:0:59224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093634.454835:0:59224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9686 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093634.454985:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024192128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093635.050103:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784093635.561639:0:7044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 796639214002ns, next at 797639211278ns, rc = 0 00000100:00100000:0.0:1784093635.561693:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784093635.561714:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024192256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093635.561779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093635.561828:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192256 00000100:00100000:2.0:1784093635.561836:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192256 00000100:00080000:1.0:1784093635.561901:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093635.561903:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784093635.561916:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024192256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093635.562008:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093635.562057:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024192256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093635.562064:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784093635.562115:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024192256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093635.730141:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093635.730489:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013637888 00000100:00100000:2.0:1784093635.730511:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013637888 00000100:00100000:2.0:1784093635.730584:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 387 00000100:00100000:2.0:1784093635.730596:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:35624:x1870757013637888:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093635.730620:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093635.730643:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c968d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5500 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.730712:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.730727:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.730741:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093635.730802:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:2.0:1784093635.730807:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093635.730846:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.730873:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c968d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5500 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.730896:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5500 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.730906:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093635.730909:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093635.730912:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784093635.730968:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:35624:x1870757013637888:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 374us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093635.730984:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 387 00000100:00080000:3.0:1784093635.731252:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093635.733520:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093635.733562:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013638144 00000100:00100000:2.0:1784093635.733571:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013638144 00000100:00100000:2.0:1784093635.733665:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 388 00000100:00100000:2.0:1784093635.733676:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:35624:x1870757013638144:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093635.733718:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093635.733742:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5500 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.733757:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c960f) 00010000:00010000:2.0:1784093635.733760:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093635.733769:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093635.733789:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.733801:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.733809:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093635.763496:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:1.0:1784093635.763516:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:1.0:1784093635.763522:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 30 committed 00000004:00010000:0.0:1784093635.763532:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000003e1b7e07 reply state 000000005113c0c4 transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093635.763544:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 29 committed 00000100:00100000:0.0:1784093635.763545:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093635.763663:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024192384:0@lo:6:osp-syn-0-0.0 00000004:00200000:0.0:1784093635.763702:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000100:00100000:3.0:1784093635.763726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784093635.763791:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093635.763792:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192384 00000100:00100000:3.0:1784093635.763800:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192384 00000100:00100000:0.0:1784093635.763808:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35624:x1870757013638144:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 30132us (30290us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784093635.763818:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 388 00010000:00010000:0.0:1784093635.763851:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093635.763852:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00010000:00010000:0.0:1784093635.763864:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093635.763872:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093635.763875:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024192384:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784093635.763885:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093635.763891:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093635.763900:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784093635.763905:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:13 count 1 00010000:00010000:3.0:1784093635.763928:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.763952:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.763961:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1784093635.763965:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093635.763970:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.763996:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.764010:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 6 pid: 6573 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093635.764034:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024192512:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093635.764084:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484600 going to sleep for 11 seconds 00010000:00010000:0.0:1784093635.764244:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781300) 00010000:00010000:0.0:1784093635.764248:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093635.764253:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093635.764259:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c969b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093635.766605:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024192512:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784093635.766629:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093635.766750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093635.766804:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013638272 00000100:00100000:2.0:1784093635.766810:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013638272 00010000:00010000:2.0:1784093635.766847:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 7 pid: 6573 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784093635.766855:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093635.766882:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 209 00000100:00100000:2.0:1784093635.766891:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013638272:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093635.766913:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093635.766960:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 7 pid: 6573 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.766976:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 7 pid: 6573 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.767000:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008450040b/0x9ce98053214c9663 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf54f9 expref: 7 pid: 6573 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.767015:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093635.767018:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093635.767024:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.767032:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093635.767060:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093635.767103:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013638272:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 213us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093635.767111:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 209 00010000:00010000:3.0:1784093635.767167:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.767186:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.767195:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.767203:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093635.767223:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093635.767248:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093635.767257:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093635.767279:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093635.767283:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093635.767293:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093635.767305:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093635.767311:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214c96a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093635.767328:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093635.767331:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093635.767332:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093635.768025:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024192384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4152us (4298us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1784093635.768034:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000004:00080000:0.0:1784093635.768097:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237bfc000/2, rc 0, transno 4294967322 00000100:00100000:0.0:1784093635.768104:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024192384:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784093636.073528:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093636.075317:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093636.075327:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093636.075334:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093636.075480:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.075494:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.075506:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093636.075543:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024192640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093636.075634:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093636.075740:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484840 going to sleep for 11 seconds 00000100:00100000:2.0:1784093636.075766:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192640 00000100:00100000:2.0:1784093636.075784:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192640 00000100:00100000:2.0:1784093636.075905:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1784093636.075917:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024192640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093636.075950:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093636.075969:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c96a9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093636.075999:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093636.076011:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093636.076021:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093636.076107:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024192640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093636.076114:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1784093636.076220:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024192640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093636.076251:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.076262:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093636.076283:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093636.076288:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.076296:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093636.160088:0:59420:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd73921900 20000000:00000080:1.0:1784093636.160104:0:59420:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723d734400 uarg=0000000000000000 00010000:00010000:1.0:1784093636.160612:0:59420:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093636.160627:0:59420:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093636.160640:0:59420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093636.160657:0:59420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093636.160673:0:59420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093636.160687:0:59420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093636.160717:0:59420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093636.160728:0:59420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 18 pid: 5770 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093636.160739:0:59420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59420:1870757024192768:0@lo:104: 00000100:00100000:1.0:1784093636.160790:0:59420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093636.160889:0:59420:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2faa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784093636.160937:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784093636.160948:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192768 00000100:00100000:2.0:1784093636.160954:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192768 00000100:00100000:2.0:1784093636.160997:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784093636.161008:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:59420:x1870757024192768:12345-0@lo:104: 00010000:00010000:2.0:1784093636.161020:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093636.161088:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093636.161096:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101e3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:59420:x1870757024192768:12345-0@lo:104: Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093636.161104:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784093636.161107:0:59420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59420:1870757024192768:0@lo:104: 00010000:00010000:1.0:1784093636.161134:0:59420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161205:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093636.161213:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161221:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093636.161225:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161233:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093636.161241:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093636.161246:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093636.161324:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161332:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093636.161368:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161374:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c96a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c96b0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161386:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093636.161387:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093636.161389:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093636.161451:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093636.161461:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024192896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093636.161490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093636.161586:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024192896 00000100:00100000:3.0:1784093636.161590:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024192896 00010000:00010000:3.0:1784093636.161608:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 19 pid: 5770 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093636.161670:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784093636.161678:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024192896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093636.161688:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093636.161693:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 19 pid: 5770 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161702:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 19 pid: 5770 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161713:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41400/0x9ce98053214c96b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c96a9 expref: 19 pid: 5770 timeout: 947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161725:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161738:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161747:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161751:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161756:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161759:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161762:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093636.161765:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161769:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161782:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093636.161788:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093636.161808:0:59420:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093636.161816:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024192896:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (324us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093636.161821:0:59420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093636.161823:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00010000:1.0:1784093636.161832:0:59420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214c96b7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093636.161867:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024192896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093637.098532:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093637.122730:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1784093637.122760:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 10000000:01000000:0.0:1784093637.290480:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093637.290487:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093637.290499:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093637.290539:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093637.290551:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093637.290562:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093637.290588:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024193024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093637.290664:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093637.290713:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784093637.290903:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193024 00000100:00100000:3.0:1784093637.290911:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193024 00000100:00100000:3.0:1784093637.291013:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1784093637.291023:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024193024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093637.291037:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093637.291050:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c96be expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.291073:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c96be expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.291084:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c96be expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.291093:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784093637.291140:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024193024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093637.291147:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1784093637.291391:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024193024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093637.291406:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093637.291415:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093637.291467:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093637.291473:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093637.291481:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093637.510563:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093637.510597:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013638400 00000100:00100000:3.0:1784093637.510608:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013638400 00000100:00080000:0.0:1784093637.510644:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093637.510684:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 389 00000100:00100000:3.0:1784093637.510698:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:35700:x1870757013638400:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093637.510723:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093637.510747:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c96cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5507 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.510812:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.510843:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.510857:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.510879:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.510887:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.510894:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511372:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c96e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511394:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c96e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511402:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c96e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093637.511517:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093637.511522:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093637.511607:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c96e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511622:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511639:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511647:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511653:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093637.511658:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511665:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511677:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093637.511681:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.511685:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511692:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c96d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511703:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511709:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511715:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511721:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093637.511730:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511737:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511745:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce200) 00010000:00010000:3.0:1784093637.511748:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.511751:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511757:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c96da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511788:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c96cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5507 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511806:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c96e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5507 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.511815:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093637.511817:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093637.511820:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784093637.511879:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638400:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1186us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093637.511884:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 389 00000100:00100000:0.0:1784093637.514573:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093637.514624:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013638656 00000100:00100000:3.0:1784093637.514634:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013638656 00000100:00100000:3.0:1784093637.514690:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 390 00000100:00100000:3.0:1784093637.514702:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638656:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093637.514727:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093637.514745:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c96e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf550e expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515040:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515055:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515067:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515081:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515086:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515092:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093637.515361:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00010000:00010000:3.0:1784093637.515382:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515390:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515397:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515414:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093637.515419:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515454:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515467:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093637.515471:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.515475:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515480:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c96ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515492:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515496:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515500:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515503:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093637.515505:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515511:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515530:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907204fcea00) 00010000:00010000:3.0:1784093637.515532:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.515536:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515542:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c96f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515580:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c96e8 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf550e expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515590:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093637.515591:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.515594:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c96e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf550e expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.515602:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784093637.515659:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638656:12345-192.168.204.57@tcp:101:touch.0 Request processed in 960us (1091us total) trans 0 rc 301/301 00000100:00100000:3.0:1784093637.515667:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 390 00000100:00100000:0.0:1784093637.516862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093637.516897:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013638784 00000100:00100000:1.0:1784093637.516904:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013638784 00000100:00100000:1.0:1784093637.516937:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 391 00000100:00100000:1.0:1784093637.516945:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638784:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093637.516960:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093637.516970:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c96fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5515 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517005:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517013:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517021:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517029:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517033:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517037:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517120:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517124:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517128:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517131:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093637.517136:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517141:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517147:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:1.0:1784093637.517148:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093637.517150:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517154:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517160:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517164:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517167:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517170:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093637.517172:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517175:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517178:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202d46e00) 00010000:00010000:1.0:1784093637.517179:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093637.517184:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517188:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c970b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517204:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c96fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5515 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517209:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:1.0:1784093637.517211:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093637.517213:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c96fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5515 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093637.517218:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784093637.517252:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638784:12345-192.168.204.57@tcp:101:touch.0 Request processed in 308us (394us total) trans 0 rc 301/301 00000100:00100000:1.0:1784093637.517257:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 391 00000100:00100000:0.0:1784093637.518709:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093637.518742:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013638912 00000100:00100000:3.0:1784093637.518748:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013638912 00000100:00100000:3.0:1784093637.518786:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 392 00000100:00100000:3.0:1784093637.518796:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638912:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093637.518809:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093637.518823:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9712 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf551c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.518880:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.518892:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.518902:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.518922:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.518929:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.518936:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519024:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519029:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519032:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519036:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093637.519038:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519048:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519055:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093637.519056:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.519059:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519063:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519069:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519073:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519076:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519079:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093637.519081:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519084:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519087:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907204fcef00) 00010000:00010000:3.0:1784093637.519088:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.519090:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519098:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9720 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519118:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9712 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf551c expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519123:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093637.519126:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093637.519129:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9712 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf551c expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093637.519138:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093637.519189:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35700:x1870757013638912:12345-192.168.204.57@tcp:101:touch.0 Request processed in 393us (481us total) trans 0 rc 301/301 00000100:00100000:3.0:1784093637.519193:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 392 00000100:00100000:0.0:1784093638.008984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093638.009028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093638.009054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093638.009124:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639168 00000100:00100000:3.0:1784093638.009134:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639168 00000100:00100000:2.0:1784093638.009163:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639296 00000100:00100000:2.0:1784093638.009170:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639296 00000100:00080000:0.0:1784093638.009181:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093638.009186:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093638.009204:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 319 00000100:00100000:2.0:1784093638.009213:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 320 00000100:00100000:2.0:1784093638.009223:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013639296:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093638.009292:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013639296:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093638.009309:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 320 00000100:00100000:2.0:1784093638.009912:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013639168:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093638.009955:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013639168:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 743us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093638.009973:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 319 00000100:00100000:1.0:1784093638.010233:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639040 00000100:00100000:1.0:1784093638.010248:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639040 00000100:00100000:1.0:1784093638.010342:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 580 00000100:00100000:1.0:1784093638.010358:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013639040:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093638.010469:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013639040:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 115us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093638.010477:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 580 00010000:00010000:2.0:1784093638.121912:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093638.253532:0:59666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee72c6160 20000000:00000080:3.0:1784093638.253550:0:59666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d6bc00 uarg=0000000000000000 00010000:00010000:3.0:1784093638.253763:0:59666:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093638.253793:0:59666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093638.253796:0:59666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093638.253806:0:59666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c96e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5507 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.253826:0:59666:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093638.253845:0:59666:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093638.253857:0:59666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.253868:0:59666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c96be expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.253876:0:59666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.253910:0:59666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c96be expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.253923:0:59666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c96be expref: 18 pid: 5772 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093638.253937:0:59666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59666:1870757024193152:0@lo:104: 00000100:00100000:3.0:1784093638.253999:0:59666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093638.254099:0:59666:0:(client.c:2702:ptlrpc_set_wait()) set ffff907202ae6900 going to sleep for 11 seconds 00000100:00100000:1.0:1784093638.254144:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193152 00000100:00100000:1.0:1784093638.254152:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193152 00000100:00100000:1.0:1784093638.254199:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1784093638.254210:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:59666:x1870757024193152:12345-0@lo:104: 00010000:00010000:1.0:1784093638.254229:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093638.254339:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093638.254346:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:59666:x1870757024193152:12345-0@lo:104: Request processed in 139us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093638.254354:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:0.0:1784093638.254379:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093638.254387:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254406:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093638.254411:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093638.254416:0:59666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59666:1870757024193152:0@lo:104: 00010000:00010000:0.0:1784093638.254440:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093638.254449:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093638.254455:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093638.254486:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254493:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093638.254528:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254540:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c96be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c96c5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.254551:0:59666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254555:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093638.254559:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1784093638.254560:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093638.254565:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093638.254575:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024193280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093638.254617:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093638.254653:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193280 00000100:00100000:0.0:1784093638.254657:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193280 00010000:00010000:0.0:1784093638.254678:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c96be expref: 19 pid: 5772 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093638.254711:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1784093638.254726:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024193280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093638.254737:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093638.254743:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c96be expref: 19 pid: 5772 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254752:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c96be expref: 19 pid: 5772 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254764:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c96c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c96be expref: 19 pid: 5772 timeout: 949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254775:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254783:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254796:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254803:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254810:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254817:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254823:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093638.254827:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254840:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254859:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093638.254868:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093638.254879:0:59666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.254889:0:59666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093638.254896:0:59666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200031a00/0x9ce98053214c9727 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093638.254904:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024193280:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093638.254918:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784093638.255338:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024193280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093638.633629:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024193664:0@lo:400:kworker.0 00000100:00100000:3.0:1784093638.633641:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024193792:0@lo:400:kworker.0 00000100:00100000:2.0:1784093638.633702:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024193408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093638.633714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093638.633715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093638.633743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093638.633770:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784093638.633778:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024193536:0@lo:400:kworker.0 00000100:00100000:3.0:1784093638.633789:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193792 00000100:00100000:3.0:1784093638.633796:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193792 00000100:00100000:2.0:1784093638.633796:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024193920:0@lo:400:kworker.0 00000100:00100000:1.0:1784093638.633802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093638.633823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093638.633823:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024194048:0@lo:400:kworker.0 00000100:00100000:1.0:1784093638.633845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093638.633862:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194048 00000100:00100000:2.0:1784093638.633865:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193408 00000100:00100000:3.0:1784093638.633866:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194048 00000100:00100000:2.0:1784093638.633871:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193408 00000100:00100000:1.0:1784093638.633881:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193664 00000100:00100000:1.0:1784093638.633885:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193664 00000100:00100000:3.0:1784093638.633905:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784093638.633911:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784093638.633917:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193536 00000100:00100000:3.0:1784093638.633918:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024193792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093638.633921:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193536 00000100:00100000:2.0:1784093638.633935:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024193408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093638.633944:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024193920 00000100:00100000:1.0:1784093638.633947:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024193920 00000100:00100000:1.0:1784093638.633965:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00002000:00000024:2.0:1784093638.633974:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093638.633974:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024193664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093638.633980:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024193792:12345-0@lo:400:kworker.0 Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093638.633988:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784093638.634007:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784093638.634016:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024194048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093638.634021:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024193408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093638.634021:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024193664:12345-0@lo:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093638.634029:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784093638.634029:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1784093638.634048:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1784093638.634058:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1784093638.634059:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024194048:12345-0@lo:400:kworker.0 Request processed in 40us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093638.634059:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024193536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093638.634066:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024193920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093638.634071:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:3.0:1784093638.634092:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093638.634097:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093638.634100:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093638.634107:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024193920:12345-0@lo:400:kworker.0 Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093638.634107:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024193536:12345-0@lo:400:kworker.0 Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093638.634115:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1784093638.634118:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1784093638.634123:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1784093638.634129:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237bfc000, transno 4294967322 00000100:00100000:3.0:1784093638.634143:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024193792:0@lo:400:kworker.0 00000100:00100000:1.0:1784093638.634158:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024193536:0@lo:400:kworker.0 00000100:00100000:1.0:1784093638.634170:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024194048:0@lo:400:kworker.0 00000100:00100000:2.0:1784093638.634177:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024193408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093638.634178:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024193664:0@lo:400:kworker.0 00000100:00100000:2.0:1784093638.634194:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024193920:0@lo:400:kworker.0 00010000:00010000:3.0:1784093639.146639:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093639.560900:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093639.560938:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639424 00000100:00100000:1.0:1784093639.560947:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639424 00000100:00100000:1.0:1784093639.561014:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 393 00000100:00100000:1.0:1784093639.561023:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:35786:x1870757013639424:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093639.561040:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1784093639.561049:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784093639.561057:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c972e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5523 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.561108:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.561118:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.561129:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093639.561363:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:1.0:1784093639.561367:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093639.561488:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.561519:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c972e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5523 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.561539:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5523 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.561547:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46300) 00010000:00010000:1.0:1784093639.561550:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093639.561554:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784093639.561602:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35786:x1870757013639424:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 581us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093639.561650:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 393 00000100:00100000:3.0:1784093639.563937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093639.563971:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639680 00000100:00100000:3.0:1784093639.563985:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639680 00000100:00100000:3.0:1784093639.564033:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 394 00000100:00100000:3.0:1784093639.564044:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:35786:x1870757013639680:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093639.564085:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093639.564109:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5523 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093639.564123:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c96e1) 00010000:00010000:3.0:1784093639.564127:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46300) 00010000:00010000:3.0:1784093639.564138:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093639.564158:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093639.564170:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093639.564179:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093639.564606:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000024981fa3 reply state 00000000a4fe6425 transno 4294967457 ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093639.564616:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093639.564674:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000100:00100000:3.0:1784093639.564745:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:35786:x1870757013639680:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 703us (819us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1784093639.564752:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 394 00010000:00010000:1.0:1784093639.565718:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.565739:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.565747:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.565753:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093639.565757:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.565765:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.565776:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce100) 00010000:00010000:1.0:1784093639.565787:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093639.565792:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093639.565798:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c973c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093639.920367:0:59861:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3c64e940 20000000:00000080:2.0:1784093639.920387:0:59861:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d996000 uarg=0000000000000000 00010000:00010000:2.0:1784093639.920674:0:59861:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093639.920686:0:59861:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093639.920696:0:59861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093639.920712:0:59861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920724:0:59861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920733:0:59861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920737:0:59861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920741:0:59861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920746:0:59861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920750:0:59861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093639.920753:0:59861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920758:0:59861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920776:0:59861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920781:0:59861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093639.920785:0:59861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41a00/0x9ce98053214c9743 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093640.169743:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093640.169751:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093640.169756:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093640.169804:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093640.169816:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093640.169827:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093640.169867:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024194176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093640.169934:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093640.169981:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194176 00000100:00100000:0.0:1784093640.169988:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796480 going to sleep for 11 seconds 00000100:00100000:2.0:1784093640.169990:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194176 00010000:00010000:0.0:1784093640.170035:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093640.170049:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1784093640.170061:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024194176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093640.170074:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093640.170087:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c974a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093640.170109:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c974a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093640.170121:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c974a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093640.170130:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784093640.170176:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024194176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093640.170183:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1784093640.170522:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024194176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093640.170538:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093640.170558:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093640.170576:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093640.170581:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093640.170588:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093640.682603:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093640.682627:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024194304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093640.682695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093640.682796:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194304 00000100:00100000:1.0:1784093640.682804:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194304 00000100:00100000:1.0:1784093640.682895:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784093640.682905:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024194304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093640.682939:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093640.682996:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024194304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093640.683004:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:0.0:1784093640.683045:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093640.683046:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024194304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093641.178585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093641.179024:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639808 00000100:00100000:1.0:1784093641.179035:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639808 00000100:00100000:1.0:1784093641.179153:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 395 00000100:00100000:1.0:1784093641.179163:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013639808:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093641.179289:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013639808:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 119us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093641.179297:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 395 00000100:00080000:0.0:1784093641.179481:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093641.180409:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093641.180562:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013639936 00000100:00100000:3.0:1784093641.180569:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013639936 00000100:00100000:3.0:1784093641.180681:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 183 00000100:00100000:3.0:1784093641.180690:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013639936:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093641.181038:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013639936:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 348us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093641.181045:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 183 00000100:00080000:0.0:1784093641.181153:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093641.182536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093641.182637:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640064 00000100:00100000:2.0:1784093641.182666:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640064 00000100:00100000:2.0:1784093641.182747:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 184 00000100:00100000:2.0:1784093641.182759:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013640064:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:3.0:1784093641.183050:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093641.183163:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013640064:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 406us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093641.183170:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 184 00000100:00100000:2.0:1784093641.184744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093641.184998:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640192 00000100:00100000:1.0:1784093641.185009:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640192 00000100:00100000:1.0:1784093641.185075:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 396 00000100:00100000:1.0:1784093641.185086:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013640192:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093641.185758:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013640192:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 672us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093641.185781:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 396 00000100:00100000:0.0:1784093641.190533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093641.191291:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640320 00000100:00100000:3.0:1784093641.191308:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640320 00000100:00100000:3.0:1784093641.191379:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 397 00000100:00100000:3.0:1784093641.191390:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013640320:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093641.191536:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013640320:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 147us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093641.191556:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 397 00000100:00100000:3.0:1784093641.193067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093641.193123:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640448 00000100:00100000:2.0:1784093641.193153:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640448 00000100:00100000:2.0:1784093641.193233:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 185 00000100:00100000:2.0:1784093641.193257:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013640448:12345-192.168.204.57@tcp:19:lfs.0 00010000:00010000:1.0:1784093641.193741:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093641.193889:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013640448:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 643us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093641.193902:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 185 00000100:00100000:1.0:1784093641.196568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093641.196611:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640576 00000100:00100000:3.0:1784093641.196622:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640576 00000100:00100000:3.0:1784093641.196673:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 186 00000100:00100000:3.0:1784093641.196687:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013640576:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093641.197091:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:35871:x1870757013640576:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 402us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093641.197102:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 186 00000100:00100000:1.0:1784093641.198655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093641.198966:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640704 00000100:00100000:2.0:1784093641.198981:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640704 00000100:00100000:2.0:1784093641.199062:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 398 00000100:00100000:2.0:1784093641.199080:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013640704:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093641.200008:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:35871:x1870757013640704:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 932us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093641.200020:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 398 00000001:00080000:0.0:1784093641.210560:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000100:00100000:0.0:1784093641.224411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093641.224519:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013640832 00000100:00100000:1.0:1784093641.224533:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013640832 00000100:00100000:1.0:1784093641.224612:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 399 00000100:00100000:1.0:1784093641.224626:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:35875:x1870757013640832:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093641.224648:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093641.224674:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf552a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.224733:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.224744:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.224754:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.224761:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.224766:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.224773:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225253:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c976d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225262:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c976d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225269:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c976d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093641.225351:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:1.0:1784093641.225356:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093641.225466:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c976d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225479:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225485:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225492:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225498:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093641.225502:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225508:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225519:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202d46400) 00010000:00010000:1.0:1784093641.225528:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093641.225532:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225537:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c975f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225549:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225554:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225559:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225563:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093641.225566:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225571:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225578:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202d46800) 00010000:00010000:1.0:1784093641.225581:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093641.225583:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225589:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214c9766 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225619:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf552a expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225647:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c976d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf552a expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093641.225654:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46000) 00010000:00010000:1.0:1784093641.225657:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093641.225659:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093641.225727:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35875:x1870757013640832:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1105us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093641.225735:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 399 00000100:00100000:1.0:1784093641.227868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093641.227945:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641088 00000100:00100000:3.0:1784093641.227960:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641088 00000100:00100000:3.0:1784093641.228082:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 400 00000100:00100000:3.0:1784093641.228091:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:35875:x1870757013641088:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784093641.228116:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093641.228136:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9774 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5531 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.228532:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.228596:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.228608:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.228620:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.228624:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.228629:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093641.229289:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd:0x0], index 1: 0 00010000:00010000:3.0:1784093641.231176:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231198:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231211:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231299:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231307:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231313:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231319:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093641.231324:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231331:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231343:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46000) 00010000:00010000:3.0:1784093641.231347:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093641.231351:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231358:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c977b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093641.231376:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a5e25447 reply state 000000001f66f962 transno 4294967458 ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093641.231385:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784093641.231443:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9774 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5531 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231476:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5531 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.231484:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093641.231487:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093641.231489:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200031400, rc 0) 00000100:00100000:3.0:1784093641.231575:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:35875:x1870757013641088:12345-192.168.204.57@tcp:101:dd.0 Request processed in 3483us (3712us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1784093641.231583:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 400 00010000:00010000:3.0:1784093641.232902:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.232915:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.232923:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.232929:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093641.232933:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.232941:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.232955:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907204fce700) 00010000:00010000:3.0:1784093641.232958:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093641.232962:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093641.232978:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9782 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093641.235859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093641.235930:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641216 00000100:00100000:2.0:1784093641.235940:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641216 00000100:00100000:2.0:1784093641.235995:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 187 00000100:00100000:2.0:1784093641.236005:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:35875:x1870757013641216:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784093641.236023:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093641.236053:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5538 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093641.236079:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784093641.236099:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1784093641.236103:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093641.236112:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093641.236129:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093641.236141:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784093641.236199:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:35875:x1870757013641216:12345-192.168.204.57@tcp:101:dd.0 Request processed in 196us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093641.236207:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 187 00000100:00100000:0.0:1784093641.247222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093641.247418:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641344 00000100:00100000:1.0:1784093641.247465:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641344 00002000:00100000:1.0:1784093641.247527:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff9072379dc380 x1870757013641344/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:717/0 lens 488/0 e 0 to 0 dl 1784093652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093641.247538:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9072379dc380 with x1870757013641344 ext(0->1048575) 00002000:00010000:1.0:1784093641.247544:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9072379dc380 00000100:00100000:1.0:1784093641.247578:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 8 00000100:00100000:1.0:1784093641.247594:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013641344:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784093641.262435:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013641344:12345-192.168.204.57@tcp:4:dd.0 Request processed in 14826us (15201us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1784093641.262447:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 8 00002000:00100000:1.0:1784093641.262458:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff9072379dc380 x1870757013641344/t4294967321(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:717/0 lens 488/448 e 0 to 0 dl 1784093652 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093641.262476:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9072379dc380 with x1870757013641344 ext(0->1048575) 00002000:00010000:1.0:1784093641.262482:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9072379dc380 00000100:00100000:2.0:1784093641.264002:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093641.264075:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641472 00000100:00100000:0.0:1784093641.264084:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641472 00000100:00100000:0.0:1784093641.264133:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 401 00000100:00100000:0.0:1784093641.264155:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:35875:x1870757013641472:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:0.0:1784093641.281539:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000100:00100000:0.0:1784093641.281676:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:35875:x1870757013641472:12345-192.168.204.57@tcp:44:dd.0 Request processed in 17529us (17673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093641.281697:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 401 00000100:00100000:0.0:1784093641.283890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093641.283952:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641600 00000100:00100000:2.0:1784093641.283962:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641600 00000100:00100000:2.0:1784093641.284020:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 188 00000100:00100000:2.0:1784093641.284030:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013641600:12345-192.168.204.57@tcp:16:dd.0 00000001:00080000:0.0:1784093641.304381:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1784093641.304470:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013641600:12345-192.168.204.57@tcp:16:dd.0 Request processed in 20425us (20569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093641.304482:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 188 00000100:00100000:3.0:1784093641.307846:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093641.307911:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641856 00000100:00100000:2.0:1784093641.307920:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641856 00000100:00100000:2.0:1784093641.307976:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 45 00000100:00100000:2.0:1784093641.307995:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:35875:x1870757013641856:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:2.0:1784093641.308363:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:35875:x1870757013641856:12345-192.168.204.57@tcp:35:dd.0 Request processed in 369us (526us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1784093641.308369:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 45 00000001:00080000:3.0:1784093641.823684:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00010000:00010000:2.0:1784093642.219086:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784093642.338836:0:60108:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 803416411329ns, next at 797639211278ns, rc = 0 00000004:00080000:1.0:1784093642.338949:0:60108:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 803416526206ns, next at 768259989613ns, rc = 0 00000004:00080000:0.0:1784093642.340099:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000004:00080000:0.0:1784093642.341642:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 30 committed 00000100:00100000:1.0:1784093642.921109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093642.921197:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013641984 00000100:00100000:3.0:1784093642.921834:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013641984 00000100:00100000:3.0:1784093642.921894:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 402 00000100:00100000:3.0:1784093642.921904:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013641984:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093642.921999:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013641984:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 96us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093642.922006:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 402 00000100:00100000:0.0:1784093642.923736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093642.923784:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642112 00000100:00100000:3.0:1784093642.923792:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642112 00000100:00100000:3.0:1784093642.923860:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 189 00000100:00100000:3.0:1784093642.923869:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36067:x1870757013642112:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093642.924225:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36067:x1870757013642112:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 356us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093642.924233:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 189 00000100:00100000:3.0:1784093642.925583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093642.925626:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642240 00000100:00100000:0.0:1784093642.925633:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642240 00000100:00100000:0.0:1784093642.925665:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 190 00000100:00100000:0.0:1784093642.925672:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36067:x1870757013642240:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093642.925910:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36067:x1870757013642240:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 237us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093642.925918:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 190 00000100:00100000:0.0:1784093642.927645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093642.927713:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642368 00000100:00100000:3.0:1784093642.927720:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642368 00000100:00100000:3.0:1784093642.927762:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 403 00000100:00100000:3.0:1784093642.927771:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013642368:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093642.928146:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013642368:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 375us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093642.928160:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 403 00000100:00100000:1.0:1784093642.929925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093642.930015:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642496 00000100:00100000:2.0:1784093642.930024:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642496 00000100:00100000:2.0:1784093642.930072:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 404 00000100:00100000:2.0:1784093642.930082:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013642496:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093642.930162:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013642496:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093642.930170:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 404 00000100:00100000:3.0:1784093642.930919:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093642.930975:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642624 00000100:00100000:2.0:1784093642.930980:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642624 00000100:00100000:2.0:1784093642.931016:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 191 00000100:00100000:2.0:1784093642.931025:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:36067:x1870757013642624:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093642.931483:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:36067:x1870757013642624:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 458us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093642.931492:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 191 00000100:00100000:1.0:1784093642.933356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093642.934802:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642752 00000100:00100000:3.0:1784093642.934812:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642752 00000100:00100000:1.0:1784093642.935185:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 192 00000100:00100000:1.0:1784093642.935198:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:36067:x1870757013642752:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093642.935682:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:36067:x1870757013642752:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 485us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093642.935692:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 192 00000100:00100000:1.0:1784093642.936657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093642.936690:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013642880 00000100:00100000:1.0:1784093642.936695:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013642880 00000100:00100000:1.0:1784093642.936733:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 405 00000100:00100000:1.0:1784093642.936742:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013642880:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093642.937140:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:36067:x1870757013642880:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 398us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093642.937150:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 405 00000100:00100000:3.0:1784093642.960148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093642.960220:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643136 00000100:00100000:1.0:1784093642.960230:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643136 00000100:00100000:1.0:1784093642.960293:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 406 00000100:00100000:1.0:1784093642.960302:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:36071:x1870757013643136:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093642.960365:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093642.960393:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5531 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960409:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784093642.960453:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093642.960476:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960488:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960497:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960511:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960517:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960523:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960846:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960855:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.960862:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093642.961644:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9024 00000004:00080000:1.0:1784093642.961654:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804039231115ns, next at 805039229105ns, rc = 0 00010000:00010000:1.0:1784093642.961737:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961747:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961755:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961762:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961768:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961775:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961800:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093642.961829:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961836:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961843:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.961848:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093642.961850:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093642.961857:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961862:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.961870:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093642.961875:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.961885:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961889:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff907202d46200) 00010000:00010000:1.0:1784093642.961896:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093642.961901:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.961906:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961910:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c97ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.961924:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff907202d46200) 00010000:00010000:3.0:1784093642.961928:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093642.961932:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961939:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961945:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961950:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093642.961953:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961959:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961966:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46000) 00010000:00010000:1.0:1784093642.961968:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093642.961977:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093642.961982:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c979e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093642.961991:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000cc66f891 reply state 000000004b3575fd transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093642.961998:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093642.962066:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:36071:x1870757013643136:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1764us (1926us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1784093642.962075:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 406 00010000:00010000:3.0:1784093642.962076:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.962086:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c97b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093642.962101:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093642.962103:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093642.962105:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093642.964622:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093642.964638:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093642.964645:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093642.964651:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093642.964655:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093642.964662:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093642.964880:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202d46400) 00010000:00010000:0.0:1784093642.964884:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093642.964889:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093642.964896:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c97a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093643.130008:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093643.130703:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643264 00000100:00100000:2.0:1784093643.130714:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643264 00000100:00100000:2.0:1784093643.130770:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 582 00000100:00100000:2.0:1784093643.130780:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013643264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093643.130857:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013643264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093643.130877:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 582 00010000:00010000:1.0:1784093643.241947:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093643.753699:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024194432:0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.753714:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024194560:0@lo:400:kworker.0 00000100:00100000:3.0:1784093643.753784:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024194688:0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.753808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093643.753809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093643.753831:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024194816:0@lo:400:kworker.0 00000100:00100000:3.0:1784093643.753886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093643.753895:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194560 00000100:00100000:2.0:1784093643.753929:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024195072:0@lo:400:kworker.0 00000100:00100000:1.0:1784093643.753930:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024194944:0@lo:400:kworker.0 00000100:00100000:3.0:1784093643.753944:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194816 00000100:00100000:3.0:1784093643.753955:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194816 00000100:00100000:0.0:1784093643.753974:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194560 00000100:00100000:2.0:1784093643.753980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093643.753985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093643.754053:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194944 00000100:00100000:1.0:1784093643.754060:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194944 00000100:00100000:2.0:1784093643.754066:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195072 00000100:00100000:2.0:1784093643.754073:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195072 00000100:00100000:3.0:1784093643.754076:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784093643.754099:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024194816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093643.754100:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1784093643.754122:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024194560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093643.754137:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1784093643.754150:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024194944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.754163:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1784093643.754171:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024195072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093643.754532:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024194816:12345-0@lo:400:kworker.0 Request processed in 443us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093643.754543:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:3.0:1784093643.754578:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093643.754581:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024194944:12345-0@lo:400:kworker.0 Request processed in 433us (601us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093643.754586:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093643.754590:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093643.754592:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1784093643.754643:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024194944:0@lo:400:kworker.0 00000100:00100000:3.0:1784093643.754655:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024194816:0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.754656:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024195072:12345-0@lo:400:kworker.0 Request processed in 482us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093643.754668:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784093643.754677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093643.754699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093643.754707:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194432 00000100:00100000:1.0:1784093643.754712:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194432 00000100:00100000:1.0:1784093643.754759:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1784093643.754783:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024194432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.754784:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024195072:0@lo:400:kworker.0 00000100:00100000:0.0:1784093643.754785:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024194560:12345-0@lo:400:kworker.0 Request processed in 652us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093643.754808:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024195200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093643.754817:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1784093643.754821:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024194560:0@lo:400:kworker.0 00000100:00100000:1.0:1784093643.754859:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024194432:12345-0@lo:400:kworker.0 Request processed in 89us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093643.754860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093643.754860:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024194688 00000100:00100000:0.0:1784093643.754870:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024194688 00000100:00100000:1.0:1784093643.754878:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1784093643.754900:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195200 00000100:00100000:2.0:1784093643.754906:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195200 00000100:00100000:1.0:1784093643.754933:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024194432:0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.754948:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784093643.754957:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024195200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784093643.754993:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784093643.755003:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1784093643.755016:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024194688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093643.755060:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024195200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093643.755069:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784093643.755096:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024194688:12345-0@lo:400:kworker.0 Request processed in 77us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093643.755098:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024195200:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093643.755107:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093643.755115:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024194688:0@lo:400:kworker.0 00000100:00100000:0.0:1784093643.755135:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000004:00080000:2.0:1784093643.859707:0:60252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804937281857ns, next at 797639211278ns, rc = 0 00000004:00080000:2.0:1784093643.859806:0:60252:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804937383887ns, next at 805039229105ns, rc = 0 00000001:00080000:0.0:1784093643.877071:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1784093643.877085:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 31 committed 00000004:00080000:0.0:1784093643.877106:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 32 committed 00000004:00080000:0.0:1784093643.877112:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 32 committed 00000100:00100000:1.0:1784093643.877465:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024195328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784093643.877535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093643.877596:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195328 00000100:00100000:2.0:1784093643.877607:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195328 00000100:00100000:2.0:1784093643.877657:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784093643.877668:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024195328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784093643.877693:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:13 count 1 00010000:00010000:2.0:1784093643.877784:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.877806:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.877815:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093643.877819:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093643.877824:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 4/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.877852:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.877866:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 5 pid: 6572 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093643.877879:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024195456:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093643.877930:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093643.879368:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024195456:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093643.879398:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093643.879773:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093643.879844:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643392 00000100:00100000:2.0:1784093643.879851:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643392 00010000:00010000:2.0:1784093643.879906:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 6 pid: 6572 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093643.879938:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 212 00000100:00100000:2.0:1784093643.879946:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013643392:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093643.879959:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093643.879965:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 6 pid: 6572 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.879976:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 6 pid: 6572 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.879996:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1813652/0x9ce98053214c9797 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5538 expref: 6 pid: 6572 timeout: 904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880011:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093643.880015:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093643.880020:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880029:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880063:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093643.880112:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013643392:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 166us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093643.880119:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 212 00010000:00010000:1.0:1784093643.880392:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093643.880401:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093643.880411:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784093643.880450:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093643.880453:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093643.880473:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093643.880502:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093643.880508:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880517:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093643.880521:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880529:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880540:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880546:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214c97ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093643.880563:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093643.880564:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093643.880566:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093643.881026:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024195328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3359us (3489us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1784093643.881034:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000004:00080000:3.0:1784093643.881076:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907101251500/2, rc 0, transno 4294967322 00000100:00100000:3.0:1784093643.881091:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024195328:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784093644.265647:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093645.289732:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093645.801914:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093645.801945:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024195584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093645.802012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093645.802055:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195584 00000100:00100000:1.0:1784093645.802065:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195584 00000100:00080000:3.0:1784093645.802126:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093645.802132:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1784093645.802143:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024195584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093645.802189:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093645.802260:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024195584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093645.802268:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784093645.802576:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024195584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093646.313804:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093647.337685:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093648.249676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093648.249832:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093648.249872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093648.249906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093648.249957:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643776 00000100:00100000:0.0:1784093648.249966:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643776 00000100:00100000:0.0:1784093648.250023:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643904 00000100:00100000:0.0:1784093648.250026:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643904 00000100:00100000:0.0:1784093648.250049:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 325 00000100:00100000:0.0:1784093648.250059:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013643776:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093648.250149:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013643776:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 92us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093648.250159:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 325 00000100:00100000:0.0:1784093648.250177:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 326 00000100:00100000:0.0:1784093648.250184:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013643904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093648.250210:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013643904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093648.250216:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 326 00000100:00100000:1.0:1784093648.250230:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643648 00000100:00100000:1.0:1784093648.250237:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643648 00000100:00080000:0.0:1784093648.250238:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093648.250243:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093648.250287:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00100000:1.0:1784093648.250297:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013643648:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093648.250338:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013643648:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093648.250345:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00080000:0.0:1784093648.250380:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093648.250612:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013643520 00000100:00100000:3.0:1784093648.250616:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013643520 00000100:00100000:3.0:1784093648.250830:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 584 00000100:00100000:3.0:1784093648.250838:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013643520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093648.250879:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013643520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093648.250899:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 584 00010000:00010000:2.0:1784093648.361727:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093648.385062:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1784093648.873730:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024195712:0@lo:400:kworker.0 00000100:00100000:1.0:1784093648.873738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024195840:0@lo:400:kworker.0 00000100:00100000:3.0:1784093648.873810:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024196096:0@lo:400:kworker.0 00000100:00100000:1.0:1784093648.873811:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093648.873853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093648.873890:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093648.873893:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024196352:0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.873897:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195840 00000100:00100000:3.0:1784093648.873901:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024196224:0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.873906:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195840 00000100:00100000:1.0:1784093648.873925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093648.873941:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093648.873964:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784093648.873974:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024195968:0@lo:400:kworker.0 00000100:00100000:0.0:1784093648.873975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093648.874027:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196096 00000100:00100000:1.0:1784093648.874031:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196096 00000100:00100000:0.0:1784093648.874031:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195712 00000100:00100000:0.0:1784093648.874038:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195712 00000100:00100000:1.0:1784093648.874073:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196352 00000100:00100000:1.0:1784093648.874078:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196352 00000100:00100000:2.0:1784093648.874122:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196224 00000100:00100000:1.0:1784093648.874123:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784093648.874128:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196224 00000100:00100000:1.0:1784093648.874142:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024196096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093648.874162:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1784093648.874167:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784093648.874175:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024195712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.874177:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024195840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093648.874201:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024196096:12345-0@lo:400:kworker.0 Request processed in 62us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093648.874231:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1784093648.874237:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784093648.874243:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024196352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093648.874272:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093648.874286:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093648.874288:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093648.874317:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1784093648.874325:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024196224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.875586:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024195840:12345-0@lo:400:kworker.0 Request processed in 1406us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093648.875586:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024195712:12345-0@lo:400:kworker.0 Request processed in 1410us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093648.875587:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024196352:12345-0@lo:400:kworker.0 Request processed in 1350us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093648.875604:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784093648.875605:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1784093648.875607:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1784093648.875674:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024196480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093648.875679:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024195712:0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.875686:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024196224:0@lo:400:kworker.0 00000100:00100000:1.0:1784093648.875687:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024196224:12345-0@lo:400:kworker.0 Request processed in 1360us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093648.875701:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1784093648.875708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093648.875710:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024196096:0@lo:400:kworker.0 00000100:00100000:0.0:1784093648.875736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093648.875759:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196480 00000100:00100000:3.0:1784093648.875765:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024195968 00000100:00100000:2.0:1784093648.875765:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196480 00000100:00100000:0.0:1784093648.875766:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000100:00100000:3.0:1784093648.875771:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024195968 00000004:00080000:0.0:1784093648.875772:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907101251500, transno 4294967322 00000100:00100000:0.0:1784093648.875783:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024196352:0@lo:400:kworker.0 00000100:00100000:0.0:1784093648.875796:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024195840:0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.875808:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784093648.875815:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1784093648.875820:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024196480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093648.875827:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024195968:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784093648.875856:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093648.875877:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024195968:12345-0@lo:400:kworker.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093648.875884:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1784093648.875910:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024195968:0@lo:400:kworker.0 00000100:00100000:2.0:1784093648.875914:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024196480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093648.875924:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784093648.875939:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024196480:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093648.875955:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784093649.385687:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093650.412028:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093650.921626:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024196608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093650.921698:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093650.921940:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196608 00000100:00100000:3.0:1784093650.921948:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196608 00000100:00080000:2.0:1784093650.921993:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093650.922014:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784093650.922025:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024196608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093650.922086:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093650.922148:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024196608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093650.922156:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784093650.922251:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024196608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093651.433675:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093652.457683:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093653.369785:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093653.369993:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093653.370043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093653.370082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093653.370110:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644416 00000100:00100000:1.0:1784093653.370119:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644416 00000100:00100000:1.0:1784093653.370172:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644288 00000100:00100000:1.0:1784093653.370175:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644288 00000100:00100000:1.0:1784093653.370203:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 329 00000100:00100000:1.0:1784093653.370213:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013644416:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093653.370282:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013644416:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093653.370306:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 329 00000100:00100000:1.0:1784093653.370322:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:1.0:1784093653.370329:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013644288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093653.370357:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013644288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093653.370363:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:2.0:1784093653.371463:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644160 00000100:00100000:2.0:1784093653.371471:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644160 00000100:00100000:2.0:1784093653.371523:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 517 00000100:00100000:2.0:1784093653.371531:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013644160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093653.371573:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013644160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093653.371579:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 517 00000100:00080000:2.0:1784093653.371598:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093653.371601:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093653.371603:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093653.373158:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644032 00000100:00100000:3.0:1784093653.373170:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644032 00000100:00100000:3.0:1784093653.373269:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 586 00000100:00100000:3.0:1784093653.373280:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013644032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093653.373346:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013644032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (3571us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093653.373353:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 586 00010000:00010000:1.0:1784093653.482661:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093653.993711:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024196736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093653.993783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093653.993829:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024197120:0@lo:400:kworker.0 00000100:00100000:0.0:1784093653.993856:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024197248:0@lo:400:kworker.0 00000100:00100000:1.0:1784093653.993861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093653.993896:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197120 00000100:00100000:0.0:1784093653.993897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093653.993903:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197120 00000100:00100000:3.0:1784093653.993930:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024196992:0@lo:400:kworker.0 00000100:00100000:1.0:1784093653.993963:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1784093653.993976:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024197120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093653.993984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093653.994032:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784093653.994040:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024196864:0@lo:400:kworker.0 00000100:00100000:1.0:1784093653.994055:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024197120:12345-0@lo:400:kworker.0 Request processed in 79us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093653.994064:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1784093653.994082:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196992 00000100:00100000:0.0:1784093653.994087:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196992 00000100:00100000:3.0:1784093653.994091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093653.994117:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1784093653.994120:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024197120:0@lo:400:kworker.0 00000100:00100000:0.0:1784093653.994127:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024196992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093653.994135:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024197376:0@lo:400:kworker.0 00000100:00100000:0.0:1784093653.994164:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024196992:12345-0@lo:400:kworker.0 Request processed in 40us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093653.994171:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1784093653.994218:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197248 00000100:00100000:0.0:1784093653.994221:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197248 00000100:00100000:2.0:1784093653.994223:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196736 00000100:00100000:2.0:1784093653.994230:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196736 00000100:00100000:0.0:1784093653.994248:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1784093653.994255:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024197248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093653.994271:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784093653.994282:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024196736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093653.994288:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024197248:12345-0@lo:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093653.994292:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00080000:0.0:1784093653.994304:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093653.994306:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093653.994308:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:2.0:1784093653.994315:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093653.994324:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024197248:0@lo:400:kworker.0 00000100:00100000:0.0:1784093653.994351:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024196864 00000100:00100000:0.0:1784093653.994354:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024196864 00000100:00100000:2.0:1784093653.994369:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024196736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093653.994377:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784093653.994383:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1784093653.994391:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024196864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093653.994437:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024196736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093653.994469:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024196864:12345-0@lo:400:kworker.0 Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093653.994474:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1784093653.994859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093653.994900:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024196992:0@lo:400:kworker.0 00000100:00100000:3.0:1784093653.994915:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024196864:0@lo:400:kworker.0 00000100:00100000:1.0:1784093653.994973:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197376 00000100:00100000:1.0:1784093653.994977:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197376 00000100:00100000:1.0:1784093653.995058:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1784093653.995066:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024197376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093653.995075:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093653.995113:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024197376:12345-0@lo:400:kworker.0 Request processed in 47us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093653.995120:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1784093653.995144:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024197376:0@lo:400:kworker.0 00010000:00010000:1.0:1784093654.505617:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093655.529847:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093656.042012:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024197504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093656.042079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093656.042238:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197504 00000100:00100000:3.0:1784093656.042248:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197504 00000100:00100000:3.0:1784093656.042362:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784093656.042373:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024197504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093656.042447:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093656.042506:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024197504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093656.042514:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784093656.042553:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024197504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784093656.046020:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784093656.553872:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093657.578083:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093658.490636:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093658.490672:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093658.490783:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644544 00000100:00100000:3.0:1784093658.490793:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644544 00000100:00100000:3.0:1784093658.490893:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 588 00000100:00100000:3.0:1784093658.490904:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013644544:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093658.490994:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013644544:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093658.491002:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 588 00000100:00100000:0.0:1784093658.491381:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093658.491458:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093658.491515:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644672 00000100:00100000:2.0:1784093658.491521:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644672 00000100:00100000:2.0:1784093658.491568:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:2.0:1784093658.491576:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013644672:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093658.491618:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013644672:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093658.491633:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:1.0:1784093658.491804:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644800 00000100:00100000:1.0:1784093658.491809:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644800 00000100:00100000:1.0:1784093658.491846:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013644928 00000100:00100000:1.0:1784093658.491849:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013644928 00000100:00100000:1.0:1784093658.491870:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 332 00000100:00100000:1.0:1784093658.491878:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013644800:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093658.491923:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013644800:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093658.491930:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 332 00000100:00100000:1.0:1784093658.491944:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 333 00000100:00100000:1.0:1784093658.491950:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013644928:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093658.491985:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013644928:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093658.491991:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 333 00000100:00080000:3.0:1784093658.493525:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093658.493532:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093658.493536:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784093658.601605:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093659.113683:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093659.113747:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024197760:0@lo:400:kworker.0 00000100:00100000:0.0:1784093659.113831:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093659.113873:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197760 00000100:00100000:2.0:1784093659.113881:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197760 00000100:00100000:0.0:1784093659.113893:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024197632:0@lo:400:kworker.0 00000100:00100000:0.0:1784093659.113941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093659.113952:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1784093659.113964:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024197760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093659.114029:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197632 00000100:00100000:3.0:1784093659.114032:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024197888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093659.114034:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197632 00000100:00100000:0.0:1784093659.114074:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1784093659.114093:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024197632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093659.114097:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024197760:12345-0@lo:400:kworker.0 Request processed in 134us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093659.114108:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1784093659.114115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093659.114144:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024197888 00000100:00100000:0.0:1784093659.114146:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024197632:12345-0@lo:400:kworker.0 Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093659.114149:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024197888 00000100:00100000:0.0:1784093659.114158:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1784093659.114190:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024197760:0@lo:400:kworker.0 00000100:00100000:2.0:1784093659.114190:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784093659.114200:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024197888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093659.114210:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024197632:0@lo:400:kworker.0 00002000:00000024:2.0:1784093659.114226:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784093659.114238:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093659.114277:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024197888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093659.114281:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1784093659.114488:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024198016:0@lo:400:kworker.0 00000100:00100000:0.0:1784093659.114516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093659.114557:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198016 00000100:00100000:2.0:1784093659.114562:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198016 00000100:00100000:3.0:1784093659.114601:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024197888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093659.114605:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024198144:0@lo:400:kworker.0 00000100:00080000:3.0:1784093659.114623:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093659.114634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093659.114640:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1784093659.114648:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024198016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093659.114653:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093659.114659:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024198272:0@lo:400:kworker.0 00000100:00100000:1.0:1784093659.114683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093659.114711:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198144 00000100:00100000:2.0:1784093659.114717:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198144 00000100:00100000:1.0:1784093659.114724:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198272 00000100:00100000:1.0:1784093659.114730:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198272 00000100:00100000:2.0:1784093659.114758:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784093659.114770:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1784093659.114771:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024198144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093659.114797:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093659.114815:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024198144:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093659.114823:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784093659.114841:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024198272:12345-0@lo:400:kworker.0 Request processed in 46us (155us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093659.114843:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093659.114847:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093659.114851:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1784093659.114885:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024198272:0@lo:400:kworker.0 00000100:00100000:1.0:1784093659.114894:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024198144:0@lo:400:kworker.0 00000100:00100000:3.0:1784093659.114974:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024198016:12345-0@lo:400:kworker.0 Request processed in 326us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093659.114976:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024198016:0@lo:400:kworker.0 00000100:00100000:3.0:1784093659.114993:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00010000:00010000:2.0:1784093659.625760:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093660.350824:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093660.351030:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645056 00000100:00100000:0.0:1784093660.351040:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645056 00000100:00100000:0.0:1784093660.351177:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 407 00000100:00100000:0.0:1784093660.351188:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645056:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093660.351296:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645056:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 109us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093660.351305:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 407 00000100:00080000:3.0:1784093660.351913:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093660.353710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093660.353800:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645184 00000100:00100000:0.0:1784093660.353809:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645184 00000100:00080000:3.0:1784093660.353858:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093660.353893:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 194 00000100:00100000:0.0:1784093660.353919:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645184:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093660.354355:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645184:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 439us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093660.354363:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 194 00000100:00100000:1.0:1784093660.357806:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093660.357866:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645312 00000100:00100000:2.0:1784093660.357876:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645312 00000100:00080000:3.0:1784093660.357997:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093660.358004:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 195 00000100:00100000:2.0:1784093660.358018:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645312:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093660.359181:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645312:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 1164us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093660.359190:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 195 00000100:00100000:2.0:1784093660.362344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093660.362413:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645440 00000100:00100000:1.0:1784093660.362794:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645440 00000100:00100000:1.0:1784093660.362845:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 408 00000100:00100000:1.0:1784093660.362856:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645440:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093660.363288:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645440:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 432us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093660.363296:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 408 00000100:00100000:1.0:1784093660.367709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093660.367779:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645568 00000100:00100000:3.0:1784093660.367789:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645568 00000100:00100000:3.0:1784093660.367845:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 409 00000100:00100000:3.0:1784093660.367857:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645568:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093660.368028:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645568:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 174us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093660.368036:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 409 00000100:00100000:0.0:1784093660.369642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093660.369907:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645696 00000100:00100000:2.0:1784093660.369915:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645696 00000100:00100000:2.0:1784093660.369966:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 196 00000100:00100000:2.0:1784093660.369976:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645696:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093660.370330:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645696:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 355us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093660.370339:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 196 00000100:00100000:2.0:1784093660.371656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093660.371720:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645824 00000100:00100000:0.0:1784093660.371728:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645824 00000100:00100000:0.0:1784093660.371816:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 197 00000100:00100000:0.0:1784093660.371826:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645824:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093660.372107:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36369:x1870757013645824:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 281us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093660.372114:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 197 00000100:00100000:1.0:1784093660.373478:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093660.373589:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013645952 00000100:00100000:2.0:1784093660.373597:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013645952 00000100:00100000:2.0:1784093660.373696:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 410 00000100:00100000:2.0:1784093660.373707:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645952:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093660.374046:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:36369:x1870757013645952:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 341us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093660.374054:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 410 00010000:00010000:1.0:1784093660.653108:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093661.162586:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024198400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093661.162646:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093661.162754:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198400 00000100:00100000:3.0:1784093661.162760:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198400 00000100:00100000:3.0:1784093661.162805:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784093661.162812:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024198400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093661.162842:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093661.162897:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024198400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093661.162903:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1784093661.162920:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093661.162950:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024198400:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1784093661.523054:0:60621:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcddcac3c0 20000000:00000080:3.0:1784093661.523072:0:60621:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101393800 uarg=0000000000000000 00010000:00010000:3.0:1784093661.523605:0:60621:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093661.523650:0:60621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202d46000) 00010000:00010000:3.0:1784093661.523654:0:60621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093661.523664:0:60621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c976d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf552a expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093661.523687:0:60621:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093661.523703:0:60621:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093661.523717:0:60621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093661.523729:0:60621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c974a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093661.523738:0:60621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093661.523774:0:60621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c974a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093661.523788:0:60621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c974a expref: 18 pid: 5771 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093661.523803:0:60621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60621:1870757024198528:0@lo:104: 00000100:00100000:3.0:1784093661.523935:0:60621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093661.524043:0:60621:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839240 going to sleep for 11 seconds 00000100:00100000:0.0:1784093661.524089:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198528 00000100:00100000:0.0:1784093661.524096:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198528 00000100:00100000:0.0:1784093661.524193:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784093661.524203:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:60621:x1870757024198528:12345-0@lo:104: 00010000:00010000:0.0:1784093661.524216:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093661.524331:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093661.524338:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:60621:x1870757024198528:12345-0@lo:104: Request processed in 137us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093661.524345:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784093661.524406:0:60621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60621:1870757024198528:0@lo:104: 00010000:00010000:3.0:1784093661.524443:0:60621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524557:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093661.524570:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524575:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093661.524578:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524584:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093661.524588:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093661.524591:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093661.524618:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524623:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093661.524638:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524643:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214c974a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9751 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524653:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093661.524654:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093661.524655:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093661.524663:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024198656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093661.524685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093661.524713:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198656 00000100:00100000:2.0:1784093661.524720:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198656 00010000:00010000:2.0:1784093661.524733:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c974a expref: 19 pid: 5771 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093661.524748:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1784093661.524752:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024198656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093661.524759:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093661.524762:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c974a expref: 19 pid: 5771 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524769:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c974a expref: 19 pid: 5771 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524777:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41200/0x9ce98053214c9751 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c974a expref: 19 pid: 5771 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524787:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524792:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524801:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524805:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524810:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524814:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524821:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093661.524825:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524829:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524837:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093661.524845:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093661.524880:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024198656:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093661.524891:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00010000:3.0:1784093661.524910:0:60621:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093661.524920:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024198656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093661.524924:0:60621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093661.524930:0:60621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200030600/0x9ce98053214c97c1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093661.675052:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093662.699046:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093662.888454:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093662.888661:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646080 00000100:00100000:3.0:1784093662.888671:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646080 00000100:00100000:3.0:1784093662.888786:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 411 00000100:00100000:3.0:1784093662.888797:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:36455:x1870757013646080:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093662.888821:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093662.888887:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf553f expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.888988:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c97cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.889003:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c97cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.889017:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c97cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093662.889239:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093662.889244:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093662.889327:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c97cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.889354:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf553f expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.889382:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c97cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf553f expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.889391:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093662.889394:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093662.889397:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200030800, rc 0) 00000100:00100000:3.0:1784093662.889482:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:36455:x1870757013646080:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 686us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093662.889490:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 411 00000100:00080000:0.0:1784093662.889860:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093662.893817:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093662.893926:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646336 00000100:00100000:0.0:1784093662.893936:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646336 00000100:00100000:0.0:1784093662.893992:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 412 00000100:00100000:0.0:1784093662.894001:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:36455:x1870757013646336:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093662.894044:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093662.894068:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c97cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf553f expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.894082:0:5809:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c976d) 00010000:00010000:0.0:1784093662.894086:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce500) 00010000:00010000:0.0:1784093662.894098:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093662.894126:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.894136:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.894143:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093662.911021:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000dd6c6613 reply state 00000000fb8210fa transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093662.911040:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093662.911180:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000100:00100000:0.0:1784093662.911322:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:36455:x1870757013646336:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 17318us (17508us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1784093662.911332:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 412 00000001:00080000:0.0:1784093662.911379:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00010000:00010000:0.0:1784093662.911407:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.911448:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.911455:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.911462:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093662.911467:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.911476:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.911493:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784093662.911496:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093662.911502:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093662.911508:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c97d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093662.953608:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093662.953621:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093662.953627:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093662.953685:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093662.953703:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093662.953747:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093662.953778:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024198784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093662.953866:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093662.953949:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af900 going to sleep for 11 seconds 00000100:00100000:3.0:1784093662.954046:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198784 00000100:00100000:3.0:1784093662.954054:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198784 00000100:00100000:3.0:1784093662.954103:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1784093662.954110:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024198784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093662.954121:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093662.954135:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c97dd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.954158:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c97dd expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.954169:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c97dd expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093662.954179:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200030600, rc 0) 00000100:00100000:1.0:1784093662.954285:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024198784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093662.954300:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093662.954309:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093662.954325:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024198784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (397us total) trans 0 rc 0/0 10000000:01000000:1.0:1784093662.954334:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:3.0:1784093662.954340:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00010000:00010000:1.0:1784093662.954340:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093662.954347:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093663.317257:0:60818:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc1a91ae0 20000000:00000080:1.0:1784093663.317270:0:60818:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b37800 uarg=0000000000000000 00010000:00010000:1.0:1784093663.317762:0:60818:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093663.317778:0:60818:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093663.317792:0:60818:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093663.317810:0:60818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093663.317847:0:60818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c97dd expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093663.317856:0:60818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093663.317895:0:60818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c97dd expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093663.317910:0:60818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c97dd expref: 18 pid: 5772 timeout: 974 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093663.317924:0:60818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60818:1870757024198912:0@lo:104: 00000100:00100000:1.0:1784093663.317983:0:60818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093663.318083:0:60818:0:(client.c:2702:ptlrpc_set_wait()) set ffff907226004e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093663.318131:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024198912 00000100:00100000:2.0:1784093663.318138:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024198912 00000100:00100000:2.0:1784093663.318212:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784093663.318222:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:60818:x1870757024198912:12345-0@lo:104: 00010000:00010000:2.0:1784093663.318234:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093663.318303:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093663.318310:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:60818:x1870757024198912:12345-0@lo:104: Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093663.318316:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00010000:0.0:1784093663.318368:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093663.318376:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093663.318380:0:60818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60818:1870757024198912:0@lo:104: 00010000:00010000:0.0:1784093663.318392:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093663.318397:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093663.318400:0:60818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.318412:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093663.318445:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093663.319656:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093663.319700:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319707:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093663.319740:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319747:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c97dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c97e4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319766:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093663.319767:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024199040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093663.319770:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093663.319775:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093663.319812:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093663.319860:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199040 00000100:00100000:0.0:1784093663.319865:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199040 00010000:00010000:0.0:1784093663.319885:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c97dd expref: 19 pid: 5772 timeout: 974 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093663.319912:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784093663.319921:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024199040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093663.319932:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093663.319938:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c97dd expref: 19 pid: 5772 timeout: 974 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319950:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c97dd expref: 19 pid: 5772 timeout: 974 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319970:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200030600/0x9ce98053214c97e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c97dd expref: 19 pid: 5772 timeout: 974 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319980:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.319987:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320000:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320008:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320014:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320021:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320026:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093663.320030:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320037:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320060:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093663.320081:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093663.320087:0:60818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093663.320099:0:60818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093663.320105:0:60818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13c00/0x9ce98053214c97eb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093663.320123:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024199040:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093663.320132:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1784093663.320164:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024199040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093663.608836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093663.610258:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646464 00000100:00100000:0.0:1784093663.610270:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646464 00000100:00100000:0.0:1784093663.610335:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:0.0:1784093663.610345:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013646464:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093663.610455:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013646464:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 77us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093663.610463:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:1.0:1784093663.610610:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093663.610644:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093663.610662:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646720 00000100:00100000:0.0:1784093663.610668:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646720 00000100:00100000:2.0:1784093663.610673:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646592 00000100:00100000:2.0:1784093663.610680:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646592 00000100:00100000:1.0:1784093663.610680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093663.610712:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646848 00000100:00100000:0.0:1784093663.610717:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646848 00000100:00100000:2.0:1784093663.610718:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 525 00000100:00100000:2.0:1784093663.610726:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013646592:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093663.610754:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 335 00000100:00100000:0.0:1784093663.610764:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013646720:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093663.610770:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013646592:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093663.610775:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 525 00000100:00100000:2.0:1784093663.610812:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 336 00000100:00100000:2.0:1784093663.610831:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013646848:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093663.610862:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013646720:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 98us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093663.610870:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013646848:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093663.610879:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 335 00000100:00100000:2.0:1784093663.610887:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 336 00000100:00080000:3.0:1784093663.610931:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093663.610936:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784093663.721857:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093664.233549:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093664.233571:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024199168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093664.233642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093664.233684:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199168 00000100:00100000:2.0:1784093664.233695:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199168 00000100:00080000:3.0:1784093664.233757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093664.233762:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784093664.233774:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024199168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784093664.233823:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093664.234026:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024199168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093664.234037:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024199168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093664.234038:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784093664.234838:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024199296:0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.234853:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024199424:0@lo:400:kworker.0 00000100:00100000:2.0:1784093664.234890:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024199680:0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.234899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093664.234933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093664.234942:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093664.234951:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093664.234953:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024199808:0@lo:400:kworker.0 00000100:00100000:2.0:1784093664.234993:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784093664.234998:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199296 00000100:00100000:2.0:1784093664.235004:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024199552:0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.235005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093664.235006:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199296 00000100:00100000:2.0:1784093664.235047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093664.235061:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1784093664.235061:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199424 00000100:00100000:0.0:1784093664.235067:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199424 00000100:00100000:3.0:1784093664.235074:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024199296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093664.235100:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199808 00000100:00100000:2.0:1784093664.235106:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199808 00000100:00100000:0.0:1784093664.235111:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199552 00000100:00100000:0.0:1784093664.235116:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199552 00000100:00100000:0.0:1784093664.235152:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1784093664.235159:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024199424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093664.235165:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1784093664.235173:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.235217:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024199424:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093664.235219:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024199808:12345-0@lo:400:kworker.0 Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093664.235233:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1784093664.235241:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1784093664.235248:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024199296:12345-0@lo:400:kworker.0 Request processed in 175us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093664.235259:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1784093664.235260:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1784093664.235289:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024199552:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784093664.235302:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093664.235328:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024199296:0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.235348:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024199552:12345-0@lo:400:kworker.0 Request processed in 78us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093664.235356:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1784093664.235391:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199680 00000100:00100000:0.0:1784093664.235395:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199680 00000100:00080000:3.0:1784093664.235449:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093664.235471:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784093664.235482:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024199680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093664.235505:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024199552:0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.235528:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024199680:12345-0@lo:400:kworker.0 Request processed in 48us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093664.235533:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024199680:0@lo:400:kworker.0 00000100:00100000:0.0:1784093664.235538:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784093664.235590:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024199808:0@lo:400:kworker.0 00000100:00100000:2.0:1784093664.235601:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210607800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024199424:0@lo:400:kworker.0 00000100:00100000:1.0:1784093664.653240:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093664.653505:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013646976 00000100:00100000:3.0:1784093664.653516:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013646976 00000100:00100000:3.0:1784093664.653629:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 413 00000100:00100000:3.0:1784093664.653641:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36531:x1870757013646976:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093664.653661:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093664.653684:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c97f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5546 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.653743:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.653756:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.653769:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.653830:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.653838:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784093664.653845:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784093664.653846:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654505:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654515:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654521:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093664.654595:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093664.654599:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093664.654673:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654686:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654693:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654699:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654705:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093664.654709:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654716:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654728:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093664.654740:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093664.654746:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654752:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c97f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654763:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654770:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654776:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654781:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093664.654784:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654790:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654807:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce600) 00010000:00010000:3.0:1784093664.654810:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093664.654813:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654819:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9800 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654848:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c97f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5546 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654873:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5546 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093664.654881:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093664.654884:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093664.654886:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200031400, rc 0) 00000100:00100000:3.0:1784093664.654986:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:36531:x1870757013646976:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1347us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093664.654995:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 413 00000100:00100000:1.0:1784093664.658750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093664.658779:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013647232 00000100:00100000:0.0:1784093664.658788:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013647232 00000100:00100000:0.0:1784093664.658860:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 414 00000100:00100000:0.0:1784093664.658872:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36531:x1870757013647232:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093664.658904:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093664.658924:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c980e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf554d expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.659291:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.659307:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.659320:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.659339:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.659347:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.659355:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784093664.662003:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00010000:00010000:0.0:1784093664.662389:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662405:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662416:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662483:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662489:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662494:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662498:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093664.662501:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662506:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662516:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce400) 00010000:00010000:0.0:1784093664.662519:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093664.662522:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662526:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9815 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093664.662535:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000050d448e9 reply state 000000000c23b5ac transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093664.662542:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093664.662570:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c980e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf554d expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662589:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf554d expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.662594:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784093664.662595:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093664.662597:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77800, rc 0) 00000100:00100000:0.0:1784093664.662664:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:36531:x1870757013647232:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 3794us (3921us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784093664.662674:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 414 00010000:00010000:0.0:1784093664.664327:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.664343:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.664350:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.664357:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093664.664361:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.664368:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.664487:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202e6bc00) 00010000:00010000:0.0:1784093664.664490:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093664.664495:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.664508:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c981c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093664.669571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093664.669850:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013647488 00000100:00100000:0.0:1784093664.669861:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013647488 00000100:00100000:0.0:1784093664.669924:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 415 00000100:00100000:0.0:1784093664.669935:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:36531:x1870757013647488:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:0.0:1784093664.669993:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093664.670020:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf554d expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.670036:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784093664.670046:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093664.670087:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.670098:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.670105:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093664.670207:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000065ee3da7 reply state 00000000b5746559 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093664.670213:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093664.670290:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:36531:x1870757013647488:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 357us (730us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1784093664.670297:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 415 00010000:00010000:0.0:1784093664.673245:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.673262:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.673269:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.673275:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093664.673280:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.673295:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.673314:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784093664.673317:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093664.673322:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.673328:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093664.677051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093664.677135:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013647616 00000100:00100000:2.0:1784093664.677144:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013647616 00000100:00100000:2.0:1784093664.677233:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 416 00000100:00100000:2.0:1784093664.677247:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:36531:x1870757013647616:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093664.677271:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093664.677296:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9838 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5554 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.677358:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5554 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.677386:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5554 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.677412:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093664.677416:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784093664.677441:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093664.677500:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:36531:x1870757013647616:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 257us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093664.677509:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 416 00000100:00100000:1.0:1784093664.679338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093664.679398:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013647744 00000100:00100000:2.0:1784093664.679406:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013647744 00000100:00100000:2.0:1784093664.679478:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 198 00000100:00100000:2.0:1784093664.679489:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013647744:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:2.0:1784093664.679883:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013647744:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 396us (549us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784093664.679891:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 198 00000100:00100000:2.0:1784093664.681766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093664.681830:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013648000 00000100:00100000:1.0:1784093664.681840:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013648000 00000100:00100000:1.0:1784093664.681896:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 46 00000100:00100000:1.0:1784093664.681909:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:36531:x1870757013648000:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:1.0:1784093664.682196:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:36531:x1870757013648000:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 291us (436us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1784093664.682211:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 46 00000100:00100000:1.0:1784093664.704673:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093664.704734:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013648128 00000100:00100000:0.0:1784093664.704745:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013648128 00000100:00100000:0.0:1784093664.704855:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 417 00000100:00100000:0.0:1784093664.704866:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:36535:x1870757013648128:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:0.0:1784093664.704890:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093664.704910:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c983f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf555b expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.704992:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705006:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705032:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705048:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705056:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705063:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705167:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705175:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705182:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093664.705214:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 0 00000004:00200000:0.0:1784093664.705219:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093664.705238:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705260:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705270:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705276:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705283:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705290:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093664.705294:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705301:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705313:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce400) 00010000:00010000:0.0:1784093664.705316:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093664.705320:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705326:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9846 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705338:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705344:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705357:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705362:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093664.705366:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705372:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705381:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202e6bf00) 00010000:00010000:0.0:1784093664.705383:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093664.705387:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705393:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c984d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705459:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c983f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf555b expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705476:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf555b expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.705485:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff90721a781d00) 00010000:00010000:0.0:1784093664.705488:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093664.705491:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784093664.705554:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:36535:x1870757013648128:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 691us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093664.705573:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 417 00000100:00100000:2.0:1784093664.709690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093664.709754:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013648256 00000100:00100000:0.0:1784093664.709764:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013648256 00000100:00100000:0.0:1784093664.709825:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 199 00000100:00100000:0.0:1784093664.709835:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013648256:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:0.0:1784093664.709855:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093664.709878:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5562 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784093664.709904:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x6a571be0, atime: 0x6a571be0, ctime: 0x6a571be0, blocks: 0x1 00010000:00010000:0.0:1784093664.709928:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=825s v=(0 0) 00010000:00010000:0.0:1784093664.709932:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093664.709946:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.709967:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.709981:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784093664.710044:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013648256:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 210us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093664.710051:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 199 00000100:00100000:1.0:1784093664.713936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093664.714005:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013648512 00000100:00100000:2.0:1784093664.714013:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013648512 00000100:00100000:2.0:1784093664.714051:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 418 00000100:00100000:2.0:1784093664.714058:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:36535:x1870757013648512:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784093664.714099:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093664.714125:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9854 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf555b expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714167:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5554 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714184:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093664.714194:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093664.714215:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714228:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714237:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714266:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714274:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714281:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714381:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714389:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.714395:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784093664.714968:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:2.0:1784093664.714978:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825792555964ns, next at 826792553568ns, rc = 0 00010000:00010000:2.0:1784093664.715031:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715042:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715051:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715059:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715066:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715073:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715090:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093664.715108:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715115:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715123:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093664.715123:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093664.715132:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715133:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093664.715138:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093664.715143:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715145:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093664.715151:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715153:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093664.715160:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff90721a781400) 00010000:00010000:1.0:1784093664.715163:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093664.715166:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715170:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff90721a781400) 00010000:00010000:1.0:1784093664.715171:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9877 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715175:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093664.715177:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715181:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9870 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715195:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715200:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715204:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093664.715206:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093664.715210:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093664.715211:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093664.715213:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093664.715214:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093664.715219:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715224:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce400) 00010000:00010000:2.0:1784093664.715226:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093664.715231:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.715235:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9862 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093664.715242:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ae71d495 reply state 00000000539c6a47 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093664.715247:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093664.715304:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:36535:x1870757013648512:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1246us (1375us total) trans 4294967465 rc 0/0 00000100:00100000:2.0:1784093664.715310:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 418 00010000:00010000:0.0:1784093664.716288:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.716301:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.716318:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.716324:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093664.716327:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.716334:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.716345:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff90721a781800) 00010000:00010000:0.0:1784093664.716348:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093664.716352:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.716357:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.745826:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784093664.873687:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093664.873695:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093664.873699:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093664.873744:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.873753:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.873761:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093664.873781:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024199936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093664.873876:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093664.873932:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024199936 00000100:00100000:2.0:1784093664.873941:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024199936 00000100:00100000:0.0:1784093664.874008:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093664.874044:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1784093664.874056:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024199936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093664.874070:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093664.874085:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c987e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.874108:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c987e expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.874120:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c987e expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093664.874129:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784093664.874180:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024199936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093664.874194:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1784093664.874273:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024199936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093664.874293:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.874302:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093664.874326:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093664.874331:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093664.874339:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093665.465642:0:61062:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2f76a8f0 20000000:00000080:3.0:1784093665.465660:0:61062:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019f8400 uarg=0000000000000000 00010000:00010000:3.0:1784093665.465873:0:61062:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093665.465901:0:61062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093665.465903:0:61062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093665.465911:0:61062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c9807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5546 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.465927:0:61062:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093665.465937:0:61062:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093665.465947:0:61062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.465956:0:61062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c987e expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.465962:0:61062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.465997:0:61062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c987e expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.466008:0:61062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c987e expref: 18 pid: 5771 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093665.466023:0:61062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61062:1870757024200064:0@lo:104: 00000100:00100000:3.0:1784093665.466080:0:61062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093665.466133:0:61062:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093665.466148:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200064 00000100:00100000:0.0:1784093665.466161:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200064 00000100:00100000:0.0:1784093665.466314:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784093665.466323:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:61062:x1870757024200064:12345-0@lo:104: 00010000:00010000:0.0:1784093665.466339:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093665.466453:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093665.466459:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:61062:x1870757024200064:12345-0@lo:104: Request processed in 137us (379us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093665.466470:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784093665.466470:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00010000:1.0:1784093665.466480:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466489:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093665.466499:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466507:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093665.466513:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093665.466516:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1784093665.466520:0:61062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61062:1870757024200064:0@lo:104: 00010000:00010000:3.0:1784093665.466541:0:61062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466551:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466556:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093665.466586:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466594:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214c987e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9885 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093665.466605:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024200192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093665.466609:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093665.466613:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093665.466616:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093665.466645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093665.466697:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200192 00000100:00100000:1.0:1784093665.466704:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200192 00010000:00010000:1.0:1784093665.466727:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c987e expref: 19 pid: 5771 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093665.466806:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784093665.466826:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024200192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093665.466839:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093665.466849:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c987e expref: 19 pid: 5771 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466860:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c987e expref: 19 pid: 5771 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466870:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214c9885 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c987e expref: 19 pid: 5771 timeout: 976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466878:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466885:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466898:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466904:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466911:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466917:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466923:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093665.466927:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466935:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466958:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093665.466965:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093665.466999:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024200192:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093665.467007:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784093665.467027:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024200192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093665.467090:0:61062:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.467098:0:61062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093665.467104:0:61062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200031a00/0x9ce98053214c988c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093665.769557:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093666.281626:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024200320:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1784093666.281630:0:7044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 827359206511ns, next at 828359204485ns, rc = 0 00000100:00100000:1.0:1784093666.281690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093666.281738:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200320 00000100:00100000:3.0:1784093666.281745:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200320 00000100:00080000:1.0:1784093666.281801:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093666.281833:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784093666.281852:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024200320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093666.281888:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093666.281952:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024200320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093666.281985:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784093666.282102:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024200320:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1784093666.537615:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093666.537622:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093666.537626:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093666.537666:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.537678:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.537696:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093666.537722:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024200448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093666.537857:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093666.537938:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720900 going to sleep for 11 seconds 00000100:00100000:3.0:1784093666.537977:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200448 00000100:00100000:3.0:1784093666.537984:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200448 00000100:00100000:3.0:1784093666.538042:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1784093666.538056:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024200448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093666.538069:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093666.538083:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9893 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.538106:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9893 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.538116:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9893 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.538124:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200031a00, rc 0) 00000100:00100000:3.0:1784093666.538167:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024200448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093666.538173:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1784093666.538221:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024200448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093666.538240:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093666.538250:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093666.538272:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093666.538278:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093666.538286:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093666.727650:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093666.727807:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013648640 00000100:00100000:3.0:1784093666.727817:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013648640 00000100:00080000:1.0:1784093666.727869:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093666.727926:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 419 00000100:00100000:3.0:1784093666.727938:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:36623:x1870757013648640:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093666.727962:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093666.727995:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c98a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5569 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.728059:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c98a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.728074:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c98a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.728088:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c98a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093666.728143:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093666.728148:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093666.728171:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c98a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.728195:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c98a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5569 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.728216:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c98a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5569 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.728225:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784093666.728228:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093666.728231:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200031400, rc 0) 00000100:00100000:3.0:1784093666.728293:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:36623:x1870757013648640:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 358us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093666.728301:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 419 00000100:00100000:1.0:1784093666.729873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093666.729941:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013648896 00000100:00100000:3.0:1784093666.729956:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013648896 00000100:00100000:3.0:1784093666.729999:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 420 00000100:00100000:3.0:1784093666.730008:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:36623:x1870757013648896:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093666.730046:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093666.730066:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c98a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5569 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.730079:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9807) 00010000:00010000:3.0:1784093666.730083:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784093666.730090:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093666.730108:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.730118:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.730126:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784093666.750655:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000001:00080000:0.0:1784093666.750675:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000001:00080000:0.0:1784093666.750686:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967465 is committed 00000004:00080000:0.0:1784093666.750690:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 33 committed 00000001:00080000:0.0:1784093666.750707:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967466 is committed 00000004:00080000:0.0:1784093666.750713:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 34 committed 00000100:00100000:0.0:1784093666.750844:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784093666.750862:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024200576:0@lo:6:osp-syn-0-0.0 00000004:00010000:3.0:1784093666.750898:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006834f85a reply state 00000000fec77ca4 transno 4294967466 ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093666.750911:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093666.750924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093666.751004:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200576 00000100:00100000:0.0:1784093666.751011:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200576 00000100:00100000:0.0:1784093666.751056:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1784093666.751065:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024200576:12345-0@lo:6:osp-syn-0-0.0 00000004:00200000:3.0:1784093666.751080:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00002000:00080000:0.0:1784093666.751091:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00010000:00010000:0.0:1784093666.751114:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.751140:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.751150:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784093666.751155:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00080000:3.0:1784093666.751160:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1784093666.751161:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093666.751178:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36623:x1870757013648896:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 21169us (21308us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1784093666.751190:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 420 00010000:00010000:0.0:1784093666.751190:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.751208:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 6 pid: 6573 timeout: 927 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093666.751221:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024200704:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093666.751260:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037203c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784093666.751350:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.751372:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.751378:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.751384:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093666.751388:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.751396:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.751412:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784093666.751415:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093666.751560:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.751567:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c98af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093666.753590:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024200704:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093666.753615:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093666.753929:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093666.754863:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649024 00000100:00100000:2.0:1784093666.754872:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649024 00010000:00010000:2.0:1784093666.754918:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 7 pid: 6573 timeout: 927 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093666.754960:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 216 00000100:00100000:2.0:1784093666.754971:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013649024:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093666.754985:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093666.754992:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 7 pid: 6573 timeout: 927 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093666.755008:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 7 pid: 6573 timeout: 927 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093666.755032:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214c985b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5562 expref: 7 pid: 6573 timeout: 927 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784093666.755041:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784093666.755048:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093666.755053:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093666.755060:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093666.755070:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093666.755114:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093666.755142:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.755152:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093666.755165:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013649024:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 195us (1235us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093666.755166:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093666.755179:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093666.755183:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 216 00010000:00010000:0.0:1784093666.755205:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093666.755606:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093666.755614:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.755625:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093666.755630:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.755651:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.755665:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.755673:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b50c80/0x9ce98053214c98b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093666.755690:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093666.755692:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093666.755694:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093666.755737:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024200576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4671us (4811us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1784093666.755746:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000004:00080000:1.0:1784093666.755775:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d263480/2, rc 0, transno 4294967324 00000100:00100000:1.0:1784093666.755781:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024200576:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784093666.794835:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093667.102796:0:61258:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd549156b0 20000000:00000080:2.0:1784093667.102813:0:61258:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237edfc00 uarg=0000000000000000 00010000:00010000:2.0:1784093667.103207:0:61258:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093667.103221:0:61258:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093667.103235:0:61258:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093667.103252:0:61258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093667.103270:0:61258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9893 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093667.103279:0:61258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093667.103317:0:61258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9893 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093667.103332:0:61258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9893 expref: 18 pid: 5772 timeout: 978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093667.103347:0:61258:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61258:1870757024200832:0@lo:104: 00000100:00100000:2.0:1784093667.103408:0:61258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093667.103555:0:61258:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26c240 going to sleep for 11 seconds 00000100:00100000:0.0:1784093667.103606:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200832 00000100:00100000:0.0:1784093667.103613:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200832 00000100:00100000:0.0:1784093667.103654:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1784093667.103664:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:61258:x1870757024200832:12345-0@lo:104: 00010000:00010000:0.0:1784093667.103678:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093667.103790:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093667.103797:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:61258:x1870757024200832:12345-0@lo:104: Request processed in 135us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093667.103805:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00010000:3.0:1784093667.103810:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093667.103817:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.103825:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093667.103830:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.103838:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093667.103845:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093667.103850:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1784093667.103860:0:61258:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61258:1870757024200832:0@lo:104: 00010000:00010000:2.0:1784093667.103877:0:61258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.103889:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.103895:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093667.103926:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.103934:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214c9893 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c989a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093667.103942:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1784093667.103949:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093667.103952:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093667.103952:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024200960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093667.103954:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093667.103981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093667.104017:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024200960 00000100:00100000:3.0:1784093667.104022:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024200960 00010000:00010000:3.0:1784093667.104041:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9893 expref: 19 pid: 5772 timeout: 978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093667.104064:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1784093667.104070:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024200960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093667.104079:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093667.104084:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9893 expref: 19 pid: 5772 timeout: 978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104094:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9893 expref: 19 pid: 5772 timeout: 978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104106:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200031a00/0x9ce98053214c989a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9893 expref: 19 pid: 5772 timeout: 978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104116:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104126:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104135:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104139:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104143:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104147:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104150:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093667.104153:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104157:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104169:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093667.104177:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093667.104188:0:61258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093667.104196:0:61258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093667.104202:0:61258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40000/0x9ce98053214c98bd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093667.104233:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024200960:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093667.104239:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784093667.104478:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024200960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093667.817727:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093668.383294:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093668.383337:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649152 00000100:00100000:0.0:1784093668.383345:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649152 00000100:00080000:2.0:1784093668.383378:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093668.383455:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 421 00000100:00100000:2.0:1784093668.383472:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36699:x1870757013649152:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093668.383497:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093668.383521:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c98c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5570 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.383586:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.383601:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.383614:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.383631:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.383646:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.383655:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384125:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c98d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384134:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c98d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384142:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c98d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093668.384224:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:2.0:1784093668.384229:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093668.384320:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c98d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384334:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384340:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384347:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384354:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093668.384358:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384373:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384385:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784093668.384389:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093668.384394:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384401:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c98cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384414:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384440:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384447:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384452:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093668.384455:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384461:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384469:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781700) 00010000:00010000:2.0:1784093668.384472:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093668.384475:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384490:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c98d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384521:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c98c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5570 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384539:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c98d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5570 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093668.384548:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781c00) 00010000:00010000:2.0:1784093668.384551:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093668.384553:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784093668.384612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:36699:x1870757013649152:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1147us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093668.384621:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 421 10000000:01000000:1.0:1784093668.714471:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093668.714479:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093668.714484:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093668.714526:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093668.714549:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093668.714561:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093668.714586:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024201088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093668.714661:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093668.714735:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210b936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784093668.714746:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201088 00000100:00100000:3.0:1784093668.714760:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201088 00000100:00100000:3.0:1784093668.714814:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1784093668.714823:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024201088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093668.714837:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093668.714850:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c98e0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093668.714872:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093668.714882:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093668.714890:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200030600, rc 0) 00000100:00100000:3.0:1784093668.714933:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024201088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093668.714941:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1784093668.714964:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024201088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093668.714978:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093668.714988:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093668.715006:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093668.715011:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093668.715030:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093668.728853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093668.728895:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093668.728914:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649280 00000100:00100000:2.0:1784093668.728925:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649280 00000100:00100000:2.0:1784093668.728982:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:1.0:1784093668.728985:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093668.728996:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013649280:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093668.729066:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013649280:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093668.729074:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:0.0:1784093668.729333:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649536 00000100:00100000:0.0:1784093668.729338:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649536 00000100:00100000:2.0:1784093668.729356:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649408 00000100:00100000:2.0:1784093668.729364:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649408 00000100:00100000:0.0:1784093668.729448:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 338 00000100:00100000:0.0:1784093668.729458:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013649536:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093668.729496:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 339 00000100:00100000:0.0:1784093668.729503:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013649536:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093668.729510:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013649408:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093668.729514:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 338 00000100:00100000:2.0:1784093668.729554:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013649408:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093668.729563:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 339 00000100:00080000:1.0:1784093668.730029:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093668.730033:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093668.841806:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093668.862443:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1784093668.862467:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000020:00000080:0.0:1784093669.128190:0:61503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc297d7ee0 20000000:00000080:0.0:1784093669.128207:0:61503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907209019800 uarg=0000000000000000 00010000:00010000:0.0:1784093669.128499:0:61503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093669.128539:0:61503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781c00) 00010000:00010000:0.0:1784093669.128543:0:61503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093669.128554:0:61503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c98d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5570 expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.128577:0:61503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093669.128593:0:61503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093669.128606:0:61503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.128619:0:61503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.128628:0:61503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.128675:0:61503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.128686:0:61503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 18 pid: 5771 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093669.128701:0:61503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61503:1870757024201216:0@lo:104: 00000100:00100000:0.0:1784093669.128767:0:61503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093669.128827:0:61503:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c000 going to sleep for 11 seconds 00000100:00100000:1.0:1784093669.128894:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201216 00000100:00100000:1.0:1784093669.128902:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201216 00000100:00100000:1.0:1784093669.128950:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1784093669.128959:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:61503:x1870757024201216:12345-0@lo:104: 00010000:00010000:1.0:1784093669.128972:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093669.129078:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093669.129085:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:61503:x1870757024201216:12345-0@lo:104: Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093669.129092:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00010000:00010000:3.0:1784093669.129141:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093669.129152:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129161:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093669.129164:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129171:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093669.129172:0:61503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61503:1870757024201216:0@lo:104: 10000000:00010000:3.0:1784093669.129178:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.129188:0:61503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093669.129195:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093669.129253:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129259:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093669.129281:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129289:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c98e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c98e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093669.129300:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024201344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093669.129303:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093669.129305:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093669.129307:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093669.129328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093669.129366:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201344 00000100:00100000:3.0:1784093669.129371:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201344 00010000:00010000:3.0:1784093669.129388:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 19 pid: 5771 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093669.129413:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1784093669.129436:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024201344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093669.129448:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093669.129453:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 19 pid: 5771 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129465:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 19 pid: 5771 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129478:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200030600/0x9ce98053214c98e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c98e0 expref: 19 pid: 5771 timeout: 980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129496:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129504:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129516:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129523:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129531:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129538:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129544:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093669.129547:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129554:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129569:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093669.129578:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093669.129587:0:61503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.129594:0:61503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093669.129601:0:61503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214c98ee lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093669.129617:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024201344:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093669.129628:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784093669.129760:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024201344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093669.353870:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024201472:0@lo:400:kworker.0 00000100:00100000:3.0:1784093669.353887:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024201600:0@lo:400:kworker.0 00000100:00100000:3.0:1784093669.353943:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093669.353960:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024201728:0@lo:400:kworker.0 00000100:00100000:2.0:1784093669.353998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093669.354003:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201600 00000100:00100000:1.0:1784093669.354012:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201600 00000100:00100000:3.0:1784093669.354020:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784093669.354029:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024201984:0@lo:400:kworker.0 00000100:00100000:2.0:1784093669.354029:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093669.354039:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024201856:0@lo:400:kworker.0 00000100:00100000:3.0:1784093669.354069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093669.354080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093669.354095:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201856 00000100:00100000:1.0:1784093669.354101:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201856 00000100:00100000:3.0:1784093669.354122:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201728 00000100:00100000:3.0:1784093669.354127:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201728 00000100:00100000:2.0:1784093669.354134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093669.354138:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1784093669.354150:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024201600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093669.354167:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201984 00000100:00100000:3.0:1784093669.354171:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201984 00000100:00100000:3.0:1784093669.354198:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784093669.354207:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024201728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093669.354250:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024201600:12345-0@lo:400:kworker.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093669.354264:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024201728:12345-0@lo:400:kworker.0 Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093669.354264:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024201472 00000100:00100000:1.0:1784093669.354264:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1784093669.354276:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1784093669.354288:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1784093669.354296:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1784093669.354300:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024201856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093669.354310:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093669.354333:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024201472 00000100:00100000:1.0:1784093669.354341:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024201856:12345-0@lo:400:kworker.0 Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093669.354350:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1784093669.354357:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024201984:12345-0@lo:400:kworker.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093669.354366:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1784093669.354366:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1784093669.354377:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024201472:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093669.354388:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093669.354394:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093669.354397:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093669.354482:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210604000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024201984:0@lo:400:kworker.0 00000100:00100000:0.0:1784093669.354484:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024201472:12345-0@lo:400:kworker.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093669.354499:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1784093669.354501:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024201600:0@lo:400:kworker.0 00000100:00100000:0.0:1784093669.354544:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024201472:0@lo:400:kworker.0 00000100:00100000:2.0:1784093669.354581:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024202112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093669.354603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093669.354654:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024201856:0@lo:400:kworker.0 00000100:00100000:3.0:1784093669.354671:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1784093669.354676:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d263480, transno 4294967324 00000100:00100000:0.0:1784093669.354687:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202112 00000100:00100000:3.0:1784093669.354691:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024201728:0@lo:400:kworker.0 00000100:00100000:0.0:1784093669.354691:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202112 00000100:00100000:0.0:1784093669.354733:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784093669.354742:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024202112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093669.354769:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093669.354813:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024202112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093669.354820:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784093669.354852:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024202112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784093669.865551:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093670.420619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093670.420785:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649664 00000100:00100000:0.0:1784093670.420795:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649664 00000100:00100000:0.0:1784093670.420859:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 422 00000100:00100000:0.0:1784093670.420869:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36785:x1870757013649664:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093670.420889:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093670.420914:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c98f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5577 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.420974:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c98fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.420987:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c98fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.421000:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c98fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093670.421187:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:0.0:1784093670.421191:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093670.421270:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c98fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.421297:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214c98f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5577 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.421318:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c98fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5577 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.421326:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784093670.421330:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093670.421333:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784093670.421384:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:36785:x1870757013649664:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 517us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093670.421392:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 422 00000100:00080000:1.0:1784093670.421483:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093670.423617:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093670.423733:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013649920 00000100:00100000:3.0:1784093670.423744:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013649920 00000100:00100000:3.0:1784093670.423799:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 423 00000100:00100000:3.0:1784093670.423809:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36785:x1870757013649920:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093670.423857:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093670.423882:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c98fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5577 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.423898:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c98d9) 00010000:00010000:3.0:1784093670.423901:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b000) 00010000:00010000:3.0:1784093670.423910:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093670.423933:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.423945:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.423954:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093670.424346:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c52c56e4 reply state 000000006434ab5c transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093670.424356:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093670.424443:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000100:00100000:3.0:1784093670.424527:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:36785:x1870757013649920:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 719us (914us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1784093670.424535:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 423 00010000:00010000:0.0:1784093670.425636:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.425649:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.425658:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.425665:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093670.425676:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.425685:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.425711:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fcea00) 00010000:00010000:0.0:1784093670.425714:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093670.425719:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.425726:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9903 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093670.796194:0:61698:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee0bf0ba0 20000000:00000080:3.0:1784093670.796216:0:61698:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3bfc00 uarg=0000000000000000 00010000:00010000:3.0:1784093670.796482:0:61698:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093670.796498:0:61698:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093670.796511:0:61698:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093670.796531:0:61698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796547:0:61698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796558:0:61698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796565:0:61698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796573:0:61698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796580:0:61698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796587:0:61698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093670.796592:0:61698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796600:0:61698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796614:0:61698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796633:0:61698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.796640:0:61698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200030600/0x9ce98053214c990a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.889509:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784093670.953550:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093670.953557:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093670.953562:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093670.953606:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093670.953617:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093670.953629:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093670.953655:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024202240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093670.953729:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093670.953910:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a76eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784093670.954524:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202240 00000100:00100000:0.0:1784093670.954532:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202240 00000100:00100000:0.0:1784093670.954586:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1784093670.954596:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024202240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093670.954609:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093670.954623:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9911 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.954725:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9911 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.954738:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9911 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093670.954746:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784093670.954795:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024202240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093670.954809:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1784093670.956647:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024202240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093670.956672:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.956693:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093670.956718:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093670.956724:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093670.956731:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093671.402060:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024202368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093671.402131:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093671.402264:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202368 00000100:00100000:3.0:1784093671.402272:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202368 00000100:00100000:3.0:1784093671.402397:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784093671.402407:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024202368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784093671.402450:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784093671.402469:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093671.402526:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024202368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093671.402549:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784093671.402717:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024202368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093671.913798:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093671.934852:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967467 is committed 00000100:00100000:0.0:1784093672.123919:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093672.124712:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650048 00000100:00100000:2.0:1784093672.124857:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650048 00000100:00100000:2.0:1784093672.124938:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 424 00000100:00100000:2.0:1784093672.124949:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650048:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093672.125070:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650048:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 123us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093672.125077:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 424 00000100:00080000:1.0:1784093672.125149:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093672.126819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093672.126862:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650176 00000100:00100000:2.0:1784093672.126869:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650176 00000100:00080000:1.0:1784093672.126919:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093672.126921:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 201 00000100:00100000:2.0:1784093672.126930:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650176:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093672.127241:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650176:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 312us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093672.127247:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 201 00000100:00100000:3.0:1784093672.128898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093672.128945:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650304 00000100:00100000:0.0:1784093672.128953:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650304 00000100:00100000:0.0:1784093672.129014:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 202 00000100:00100000:0.0:1784093672.129024:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650304:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093672.129320:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650304:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 296us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093672.129327:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 202 00000100:00080000:1.0:1784093672.129703:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093672.130557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093672.130598:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650432 00000100:00100000:1.0:1784093672.130606:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650432 00000100:00100000:1.0:1784093672.130746:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 425 00000100:00100000:1.0:1784093672.130756:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650432:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093672.131093:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650432:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 338us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093672.131101:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 425 00000100:00100000:3.0:1784093672.133610:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093672.133668:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650560 00000100:00100000:0.0:1784093672.133677:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650560 00000100:00100000:0.0:1784093672.133728:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 426 00000100:00100000:0.0:1784093672.133738:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650560:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093672.133834:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650560:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093672.133841:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 426 00000100:00100000:3.0:1784093672.135149:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093672.135247:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650688 00000100:00100000:2.0:1784093672.135256:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650688 00000100:00100000:2.0:1784093672.135304:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 203 00000100:00100000:2.0:1784093672.135314:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650688:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093672.135728:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650688:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 415us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093672.135736:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 203 00000100:00100000:3.0:1784093672.139743:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093672.139831:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650816 00000100:00100000:0.0:1784093672.139840:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650816 00000100:00100000:0.0:1784093672.139957:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 204 00000100:00100000:0.0:1784093672.139967:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650816:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093672.140381:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650816:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 415us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093672.140401:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 204 00000100:00100000:1.0:1784093672.144529:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093672.144604:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013650944 00000100:00100000:0.0:1784093672.144614:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013650944 00000100:00100000:0.0:1784093672.144681:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 427 00000100:00100000:0.0:1784093672.144691:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650944:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093672.145112:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:36869:x1870757013650944:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 421us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093672.145120:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 427 00000100:00100000:1.0:1784093672.181937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093672.181997:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013651072 00000100:00100000:3.0:1784093672.182008:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013651072 00000100:00100000:3.0:1784093672.182071:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 428 00000100:00100000:3.0:1784093672.182081:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:36873:x1870757013651072:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784093672.182100:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093672.182123:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c991f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf557e expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.182179:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.182190:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.182201:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.182212:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.182219:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.182243:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.182921:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.182933:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183240:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093672.183334:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:2.0:1784093672.183344:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093672.183444:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183459:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183466:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183473:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183479:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093672.183483:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183490:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183503:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcee00) 00010000:00010000:2.0:1784093672.183506:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093672.183511:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183518:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c9926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183531:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183537:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183553:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183559:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093672.183562:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183579:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183588:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fcef00) 00010000:00010000:2.0:1784093672.183591:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093672.183594:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183601:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c992d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183634:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c991f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf557e expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183664:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf557e expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.183672:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093672.183675:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093672.183677:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093672.183756:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:36873:x1870757013651072:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1675us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093672.183772:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 428 00000100:00100000:3.0:1784093672.186237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093672.186715:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013651328 00000100:00100000:0.0:1784093672.186725:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013651328 00000100:00100000:0.0:1784093672.186785:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 429 00000100:00100000:0.0:1784093672.186795:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36873:x1870757013651328:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784093672.186818:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093672.186840:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c993b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5585 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.187173:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.187188:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.187199:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.187218:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.187237:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.187245:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784093672.188053:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe:0x0], index 1: 0 00010000:00010000:0.0:1784093672.188311:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9950 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188323:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188333:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188368:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188376:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188383:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188389:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093672.188395:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188403:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188447:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781000) 00010000:00010000:0.0:1784093672.188451:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093672.188456:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188463:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9942 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093672.188476:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000023a45419 reply state 00000000213ee6b1 transno 4294967468 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093672.188485:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093672.188515:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c993b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5585 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188528:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5585 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093672.188535:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784093672.188538:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093672.188540:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784093672.188606:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:36873:x1870757013651328:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1813us (2378us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1784093672.188614:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 429 00010000:00010000:3.0:1784093672.191466:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.191480:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.191487:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.191494:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093672.191498:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.191506:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.191521:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202e6b300) 00010000:00010000:3.0:1784093672.191525:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093672.191529:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093672.191535:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9949 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093672.195028:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093672.195463:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013651456 00000100:00100000:2.0:1784093672.195476:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013651456 00000100:00100000:2.0:1784093672.195533:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 205 00000100:00100000:2.0:1784093672.195544:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:36873:x1870757013651456:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784093672.195565:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093672.195587:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf558c expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093672.195621:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784093672.195648:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=833s v=(0 0) 00010000:00010000:2.0:1784093672.195665:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093672.195678:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.195698:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093672.195712:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784093672.195765:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:36873:x1870757013651456:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 223us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093672.195774:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 205 00000100:00100000:1.0:1784093672.208604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093672.208681:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013651584 00000100:00100000:2.0:1784093672.208691:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013651584 00002000:00100000:2.0:1784093672.209018:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe:0x0] (0->1048575) req@ffff907237bfe680 x1870757013651584/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:748/0 lens 488/0 e 0 to 0 dl 1784093683 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093672.209047:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907237bfe680 with x1870757013651584 ext(0->1048575) 00002000:00010000:2.0:1784093672.209052:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907237bfe680 00000100:00100000:2.0:1784093672.209084:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 9 00000100:00100000:2.0:1784093672.209092:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013651584:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:2.0:1784093672.224836:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013651584:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 15734us (16237us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784093672.224851:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 9 00002000:00100000:2.0:1784093672.224863:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xe:0x0] (0->1048575) req@ffff907237bfe680 x1870757013651584/t4294967323(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:748/0 lens 488/448 e 0 to 0 dl 1784093683 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093672.224874:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907237bfe680 with x1870757013651584 ext(0->1048575) 00002000:00010000:2.0:1784093672.224881:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907237bfe680 00000100:00100000:1.0:1784093672.226696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093672.226955:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013651712 00000100:00100000:0.0:1784093672.226966:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013651712 00000100:00100000:0.0:1784093672.227032:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 430 00000100:00100000:0.0:1784093672.227042:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:36873:x1870757013651712:12345-192.168.204.57@tcp:44:dd.60003 00000100:00100000:1.0:1784093672.247645:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:36873:x1870757013651712:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 20592us (20944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093672.247670:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 430 00000001:00080000:3.0:1784093672.247756:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00000100:00100000:3.0:1784093672.249589:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093672.249686:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013651840 00000100:00100000:2.0:1784093672.249697:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013651840 00000100:00100000:2.0:1784093672.249747:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 206 00000100:00100000:2.0:1784093672.249757:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013651840:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:3.0:1784093672.269766:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:2.0:1784093672.269934:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013651840:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 20172us (20344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093672.269946:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 206 00000100:00100000:2.0:1784093672.272328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093672.272414:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652096 00000100:00100000:1.0:1784093672.272449:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652096 00000100:00100000:1.0:1784093672.272516:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 47 00000100:00100000:1.0:1784093672.272524:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:36873:x1870757013652096:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093672.272891:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:36873:x1870757013652096:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 367us (567us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1784093672.272897:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 47 00000001:00080000:3.0:1784093672.829163:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967469 is committed 00010000:00010000:3.0:1784093672.937727:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784093673.385593:0:61947:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 834463167832ns, next at 828359204485ns, rc = 0 00000004:00080000:2.0:1784093673.385720:0:61947:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 834463296985ns, next at 805039229105ns, rc = 0 00000004:00080000:3.0:1784093673.388358:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00000004:00080000:3.0:1784093673.388391:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 33 committed 00000100:00100000:1.0:1784093673.850795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093673.850875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093673.850908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093673.850918:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652480 00000100:00100000:0.0:1784093673.850929:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652480 00000100:00100000:0.0:1784093673.850987:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 342 00000100:00100000:0.0:1784093673.850999:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013652480:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093673.851007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093673.851034:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652352 00000100:00100000:1.0:1784093673.851039:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652352 00000100:00100000:1.0:1784093673.851080:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 532 00000100:00100000:1.0:1784093673.851089:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013652352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093673.851122:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013652352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093673.851131:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 532 00000100:00100000:1.0:1784093673.851154:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652608 00000100:00100000:1.0:1784093673.851157:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652608 00000100:00100000:1.0:1784093673.851180:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 343 00000100:00100000:1.0:1784093673.851187:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013652608:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093673.851213:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013652608:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093673.851220:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 343 00000100:00100000:0.0:1784093673.851534:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013652480:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093673.851544:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 342 00000100:00100000:3.0:1784093673.851567:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652224 00000100:00100000:3.0:1784093673.851573:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652224 00000100:00100000:3.0:1784093673.851796:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 598 00000100:00100000:3.0:1784093673.851807:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013652224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093673.851850:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013652224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093673.851858:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 598 00010000:00010000:3.0:1784093673.962701:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093674.045017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093674.045488:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652736 00000100:00100000:3.0:1784093674.045498:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652736 00000100:00080000:1.0:1784093674.045561:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093674.045568:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 431 00000100:00100000:3.0:1784093674.045581:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013652736:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093674.045701:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013652736:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 123us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093674.045710:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 431 00000100:00100000:0.0:1784093674.047524:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093674.047574:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652864 00000100:00100000:3.0:1784093674.047583:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652864 00000100:00100000:3.0:1784093674.047666:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 207 00000100:00100000:3.0:1784093674.047677:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:37066:x1870757013652864:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093674.048087:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:37066:x1870757013652864:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 411us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093674.048105:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 207 00000100:00080000:0.0:1784093674.048161:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093674.050397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093674.050470:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013652992 00000100:00100000:3.0:1784093674.050478:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013652992 00000100:00080000:0.0:1784093674.050509:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093674.050536:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 208 00000100:00100000:3.0:1784093674.050548:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37066:x1870757013652992:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093674.051457:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37066:x1870757013652992:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 909us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093674.051466:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 208 00000100:00100000:2.0:1784093674.058471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093674.058542:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013653120 00000100:00100000:0.0:1784093674.058550:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013653120 00000100:00100000:0.0:1784093674.058630:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 432 00000100:00100000:0.0:1784093674.058645:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013653120:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093674.059089:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013653120:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 448us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093674.059097:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 432 00000100:00100000:3.0:1784093674.062713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093674.062756:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013653248 00000100:00100000:1.0:1784093674.062766:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013653248 00000100:00100000:1.0:1784093674.062834:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 433 00000100:00100000:1.0:1784093674.062846:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013653248:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093674.062942:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013653248:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093674.062951:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 433 00000100:00100000:2.0:1784093674.064506:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093674.064550:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013653376 00000100:00100000:1.0:1784093674.064557:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013653376 00000100:00100000:1.0:1784093674.064596:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 209 00000100:00100000:1.0:1784093674.064602:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37066:x1870757013653376:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093674.064905:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37066:x1870757013653376:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 303us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093674.064911:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 209 00000100:00100000:2.0:1784093674.066906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093674.067113:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013653504 00000100:00100000:3.0:1784093674.067121:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013653504 00000100:00100000:3.0:1784093674.067164:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 210 00000100:00100000:3.0:1784093674.067174:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:37066:x1870757013653504:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093674.067531:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:37066:x1870757013653504:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 359us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093674.067537:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 210 00000100:00100000:3.0:1784093674.069827:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093674.069880:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013653632 00000100:00100000:1.0:1784093674.069890:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013653632 00000100:00100000:1.0:1784093674.069940:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 434 00000100:00100000:1.0:1784093674.069951:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013653632:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093674.070383:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37066:x1870757013653632:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 433us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093674.070389:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 434 00000100:00100000:2.0:1784093674.103823:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093674.103882:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013653888 00000100:00100000:0.0:1784093674.103896:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013653888 00000100:00100000:0.0:1784093674.103955:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 435 00000100:00100000:0.0:1784093674.103965:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:37070:x1870757013653888:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784093674.104018:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093674.104043:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c9950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5585 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104060:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784093674.104085:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093674.104107:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104122:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104132:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104146:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104152:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104158:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104527:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104537:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.104545:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093674.105402:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9088 00000004:00080000:0.0:1784093674.105413:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 835182990445ns, next at 836182987724ns, rc = 0 00010000:00010000:0.0:1784093674.105531:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105552:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105561:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105568:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105575:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105581:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105603:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093674.105636:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105643:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105650:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105656:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093674.105657:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093674.105662:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105666:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105672:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105678:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093674.105683:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105703:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105708:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093674.105712:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093674.105716:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105723:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093674.105723:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c9973 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105730:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093674.105735:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105743:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c997a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105745:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105758:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105765:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093674.105767:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093674.105771:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093674.105772:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093674.105775:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093674.105777:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105783:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105791:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781000) 00010000:00010000:0.0:1784093674.105794:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093674.105797:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.105803:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9965 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093674.105823:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a8449d0c reply state 00000000e855050b transno 4294967470 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093674.105832:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093674.105910:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:37070:x1870757013653888:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1945us (2093us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1784093674.105919:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 435 00010000:00010000:0.0:1784093674.108170:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.108186:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.108193:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.108199:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093674.108203:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.108210:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.108224:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff907202e6b800) 00010000:00010000:0.0:1784093674.108227:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093674.108231:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093674.108237:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c996c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093674.473703:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024202496:0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.473739:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024202880:0@lo:400:kworker.0 00000100:00100000:1.0:1784093674.473784:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024202624:0@lo:400:kworker.0 00000100:00100000:2.0:1784093674.473797:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024202752:0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.473802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093674.473839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093674.473847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093674.473871:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093674.473876:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202880 00000100:00100000:3.0:1784093674.473880:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024203008:0@lo:400:kworker.0 00000100:00100000:2.0:1784093674.473886:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202880 00000100:00100000:1.0:1784093674.473891:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024203264:0@lo:400:kworker.0 00000100:00100000:0.0:1784093674.473901:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202496 00000100:00100000:3.0:1784093674.473906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093674.473907:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202496 00000100:00100000:1.0:1784093674.473926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093674.473957:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202624 00000100:00100000:0.0:1784093674.473958:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1784093674.473961:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202624 00000100:00100000:0.0:1784093674.473970:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024202496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.473991:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203008 00000100:00100000:1.0:1784093674.474001:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1784093674.474007:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203008 00000100:00100000:1.0:1784093674.474016:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024202624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093674.474033:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203264 00000100:00100000:2.0:1784093674.474039:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203264 00000100:00100000:3.0:1784093674.474040:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1784093674.474051:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024203008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093674.474076:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024202496:12345-0@lo:400:kworker.0 Request processed in 108us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093674.474089:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784093674.474089:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1784093674.474090:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024202624:12345-0@lo:400:kworker.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093674.474098:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024203008:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093674.474105:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1784093674.474111:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024202880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.474115:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1784093674.474147:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093674.474157:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024202624:0@lo:400:kworker.0 00000100:00100000:2.0:1784093674.474162:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024202880:12345-0@lo:400:kworker.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093674.474172:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024203136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093674.474174:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784093674.474196:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1784093674.474201:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093674.474207:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024203264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.474209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784093674.474209:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093674.474215:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093674.474250:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024202496:0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.474265:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024203008:0@lo:400:kworker.0 00000100:00100000:2.0:1784093674.474266:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024203264:12345-0@lo:400:kworker.0 Request processed in 61us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093674.474279:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784093674.474286:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024202752 00000100:00100000:3.0:1784093674.474287:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024202880:0@lo:400:kworker.0 00000100:00100000:1.0:1784093674.474293:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024202752 00000100:00100000:2.0:1784093674.474337:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024203264:0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.474338:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203136 00000100:00100000:1.0:1784093674.474342:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1784093674.474344:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203136 00000100:00100000:1.0:1784093674.474356:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024202752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.474378:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784093674.474385:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024203136:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784093674.474395:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093674.474406:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024202752:12345-0@lo:400:kworker.0 Request processed in 54us (258us total) trans 0 rc 0/0 00002000:00000024:3.0:1784093674.474410:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784093674.474416:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1784093674.474451:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024202752:0@lo:400:kworker.0 00000100:00100000:3.0:1784093674.474485:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024203136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093674.474493:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024203136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093674.474494:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00010000:3.0:1784093674.985632:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784093675.020072:0:62092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 836097646552ns, next at 828359204485ns, rc = 0 00000004:00080000:1.0:1784093675.020183:0:62092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 836097760066ns, next at 836182987724ns, rc = 0 00000001:00080000:2.0:1784093675.036945:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967470 is committed 00000004:00080000:2.0:1784093675.036959:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 34 committed 00000004:00080000:2.0:1784093675.036979:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 35 committed 00000004:00080000:2.0:1784093675.036985:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 36 committed 00000100:00100000:0.0:1784093675.037119:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024203392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784093675.037189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093675.037275:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203392 00000100:00100000:3.0:1784093675.037283:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203392 00000100:00100000:3.0:1784093675.037349:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784093675.037359:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024203392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784093675.037386:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:14 count 1 00010000:00010000:3.0:1784093675.037410:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.037504:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.037510:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1784093675.037514:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093675.037517:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.037538:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.037548:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 5 pid: 6572 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093675.037557:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024203520:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093675.037719:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072103b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093675.038958:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024203520:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093675.038981:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093675.039690:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093675.039754:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654016 00000100:00100000:1.0:1784093675.039762:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654016 00010000:00010000:1.0:1784093675.039792:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 6 pid: 6572 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093675.039826:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 219 00000100:00100000:1.0:1784093675.039835:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013654016:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093675.039849:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093675.039855:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 6 pid: 6572 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093675.039868:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 6 pid: 6572 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093675.039892:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214c995e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf558c expref: 6 pid: 6572 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093675.039924:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093675.039928:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093675.039933:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093675.039942:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093675.039965:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093675.039994:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093675.040006:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093675.040016:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013654016:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 180us (325us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093675.040019:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093675.040025:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 219 00010000:00010000:2.0:1784093675.040037:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093675.040058:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093675.040094:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093675.040102:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.040162:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093675.040169:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.040179:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.040199:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.040208:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077430137/0x9ce98053214c9981 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093675.040360:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093675.040364:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093675.040366:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093675.040668:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024203392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3311us (3479us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1784093675.040674:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000004:00080000:0.0:1784093675.040726:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230d26300/2, rc 0, transno 4294967324 00000100:00100000:0.0:1784093675.040741:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024203392:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784093676.009808:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093676.521941:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093676.521966:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024203648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093676.522101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093676.522145:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203648 00000100:00100000:3.0:1784093676.522153:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203648 00000100:00100000:3.0:1784093676.522205:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784093676.522214:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024203648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093676.522243:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093676.522285:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024203648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093676.522289:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:2.0:1784093676.522524:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093676.522589:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024203648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093677.033577:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093678.057613:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093678.969515:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093678.969570:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093678.969610:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093678.969639:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654400 00000100:00100000:0.0:1784093678.969649:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654400 00000100:00100000:3.0:1784093678.969652:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:3.0:1784093678.969695:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093678.969718:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654528 00000100:00100000:0.0:1784093678.969723:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654528 00000100:00100000:3.0:1784093678.969731:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 346 00000100:00100000:3.0:1784093678.969745:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013654400:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093678.969755:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:0.0:1784093678.969769:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013654528:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093678.969857:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654272 00000100:00100000:1.0:1784093678.969862:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654272 00000100:00100000:1.0:1784093678.969898:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:1.0:1784093678.969906:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013654272:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093678.969930:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013654528:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 161us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093678.969938:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:1.0:1784093678.969944:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013654272:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093678.969953:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00080000:0.0:1784093678.969960:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093678.969965:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093678.970051:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654144 00000100:00100000:2.0:1784093678.970056:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654144 00000100:00100000:2.0:1784093678.970092:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:2.0:1784093678.970099:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013654144:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093678.970125:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013654144:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 28us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093678.970132:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:3.0:1784093678.970297:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013654400:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 556us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093678.970302:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 346 00010000:00010000:2.0:1784093679.082142:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093679.100746:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:3.0:1784093679.593731:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024203776:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.593735:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024204032:0@lo:400:kworker.0 00000100:00100000:2.0:1784093679.593806:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024203904:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.594051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093679.594105:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093679.594113:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024204160:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.594139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093679.594173:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204032 00000100:00100000:0.0:1784093679.594193:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204032 00000100:00100000:3.0:1784093679.594242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093679.594246:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1784093679.594257:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024204032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093679.594282:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024204288:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.594314:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024204032:12345-0@lo:400:kworker.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093679.594321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093679.594330:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1784093679.594350:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204288 00000100:00100000:0.0:1784093679.594354:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204288 00000100:00100000:3.0:1784093679.594367:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203776 00000100:00100000:3.0:1784093679.594372:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203776 00000100:00100000:0.0:1784093679.594383:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1784093679.594391:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024204288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093679.594411:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1784093679.594439:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024203776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093679.594456:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093679.594456:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024204288:12345-0@lo:400:kworker.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093679.594473:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1784093679.594478:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024203776:12345-0@lo:400:kworker.0 Request processed in 59us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093679.594487:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1784093679.594535:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093679.594544:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204160 00000100:00100000:0.0:1784093679.594544:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024204544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093679.594548:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204160 00000100:00100000:3.0:1784093679.594564:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024204288:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.594577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093679.594581:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024203776:0@lo:400:kworker.0 00000100:00100000:1.0:1784093679.594587:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784093679.594595:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024204160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.594612:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204544 00000100:00100000:0.0:1784093679.594616:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204544 00000100:00100000:1.0:1784093679.594638:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024204160:12345-0@lo:400:kworker.0 Request processed in 45us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093679.594644:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784093679.594645:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1784093679.594651:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024204544:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784093679.594660:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093679.594663:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784093679.594678:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093679.594686:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024204160:0@lo:400:kworker.0 00000100:00100000:1.0:1784093679.594697:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024204032:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.594716:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024204544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093679.594723:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784093679.594734:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1784093679.594738:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230d26300, transno 4294967324 00000100:00100000:1.0:1784093679.594755:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024204544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093679.595598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093679.595629:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024204416:0@lo:400:kworker.0 00000100:00100000:0.0:1784093679.595634:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024203904 00000100:00100000:0.0:1784093679.595639:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024203904 00000100:00100000:2.0:1784093679.595657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093679.595669:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1784093679.595678:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024203904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093679.595696:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204416 00000100:00100000:2.0:1784093679.595701:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204416 00000100:00100000:0.0:1784093679.595727:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024203904:12345-0@lo:400:kworker.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093679.595734:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1784093679.595739:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1784093679.595746:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024204416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093679.595753:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024203904:0@lo:400:kworker.0 00000100:00100000:2.0:1784093679.595797:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024204416:12345-0@lo:400:kworker.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093679.595803:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784093679.595808:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024204416:0@lo:400:kworker.0 00010000:00010000:3.0:1784093680.105871:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093681.129754:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093681.641668:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024204672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093681.641737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093681.642251:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204672 00000100:00100000:3.0:1784093681.642260:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204672 00000100:00100000:3.0:1784093681.642338:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784093681.642348:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024204672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093681.642387:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093681.642466:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024204672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093681.642504:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784093681.642525:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024204672:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784093681.642589:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784093682.153573:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093683.177882:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093684.089574:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093684.089689:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093684.089725:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093684.089760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093684.089808:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655040 00000100:00100000:3.0:1784093684.089818:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655040 00000100:00100000:3.0:1784093684.089874:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654912 00000100:00100000:3.0:1784093684.089878:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654912 00000100:00100000:3.0:1784093684.089903:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 350 00000100:00100000:3.0:1784093684.089914:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013655040:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093684.089984:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013655040:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093684.089993:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 350 00000100:00100000:3.0:1784093684.090011:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 351 00000100:00100000:3.0:1784093684.090017:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013654912:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093684.090052:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013654912:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093684.090060:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 351 00000100:00080000:2.0:1784093684.090083:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093684.090089:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093684.090183:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654656 00000100:00100000:1.0:1784093684.090188:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654656 00000100:00100000:1.0:1784093684.090222:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 602 00000100:00100000:1.0:1784093684.090230:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013654656:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093684.090268:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013654656:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093684.090274:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 602 00000100:00100000:0.0:1784093684.090674:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013654784 00000100:00100000:0.0:1784093684.090679:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013654784 00000100:00100000:0.0:1784093684.090731:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00080000:2.0:1784093684.090733:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093684.090741:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013654784:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093684.090863:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013654784:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 123us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093684.090887:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 540 00010000:00010000:1.0:1784093684.201733:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093684.714210:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024204928:0@lo:400:kworker.0 00000100:00100000:2.0:1784093684.714223:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024205056:0@lo:400:kworker.0 00000100:00100000:0.0:1784093684.714227:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024205184:0@lo:400:kworker.0 00000100:00100000:1.0:1784093684.714308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093684.714312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093684.714340:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024205312:0@lo:400:kworker.0 00000100:00100000:3.0:1784093684.714363:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204928 00000100:00100000:3.0:1784093684.714372:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204928 00000100:00100000:1.0:1784093684.714373:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024204800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093684.714381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093684.714390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093684.714449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093684.714459:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024205568:0@lo:400:kworker.0 00000100:00100000:2.0:1784093684.714469:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205312 00000100:00100000:2.0:1784093684.714474:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205312 00000100:00100000:1.0:1784093684.714481:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024205440:0@lo:400:kworker.0 00000100:00100000:0.0:1784093684.714489:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093684.714521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093684.714540:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205568 00000100:00100000:0.0:1784093684.714541:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205184 00000100:00100000:2.0:1784093684.714546:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205568 00000100:00100000:0.0:1784093684.714548:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205184 00000100:00100000:3.0:1784093684.714567:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1784093684.714582:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093684.714589:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1784093684.714591:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205056 00000100:00100000:0.0:1784093684.714595:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205056 00000100:00100000:2.0:1784093684.714599:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1784093684.714602:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024205312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093684.714613:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024205568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093684.714619:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205440 00000100:00100000:0.0:1784093684.714624:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205440 00000100:00100000:0.0:1784093684.714646:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1784093684.714655:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024205184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093684.714663:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024204928:12345-0@lo:400:kworker.0 Request processed in 85us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093684.714679:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024205312:12345-0@lo:400:kworker.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093684.714683:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024205568:12345-0@lo:400:kworker.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093684.714688:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1784093684.714695:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784093684.714701:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1784093684.714718:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024205184:12345-0@lo:400:kworker.0 Request processed in 64us (409us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093684.714725:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093684.714730:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024204800 00000100:00100000:0.0:1784093684.714730:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:2.0:1784093684.714732:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093684.714736:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093684.714737:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024204800 00000100:00100000:3.0:1784093684.714749:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1784093684.714757:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1784093684.714762:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024205056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093684.714770:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024205440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093684.714781:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784093684.714792:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024204800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093684.714798:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024204928:0@lo:400:kworker.0 00000100:00100000:3.0:1784093684.714823:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024205056:12345-0@lo:400:kworker.0 Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093684.714824:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024205440:12345-0@lo:400:kworker.0 Request processed in 57us (304us total) trans 0 rc 0/0 00002000:00000024:1.0:1784093684.714826:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093684.714835:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024205440:0@lo:400:kworker.0 00000100:00100000:3.0:1784093684.714840:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1784093684.714848:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1784093684.714893:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024204800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093684.714901:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024205184:0@lo:400:kworker.0 00000100:00100000:1.0:1784093684.714902:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784093684.714930:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024205312:0@lo:400:kworker.0 00000100:00100000:0.0:1784093684.714941:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024205568:0@lo:400:kworker.0 00000100:00100000:0.0:1784093684.714955:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024205056:0@lo:400:kworker.0 00000100:00100000:2.0:1784093684.714972:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024204800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784093685.227002:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093686.249686:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093686.762513:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093686.762538:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024205696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093686.762597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093686.762655:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205696 00000100:00100000:3.0:1784093686.762663:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205696 00000100:00080000:2.0:1784093686.762702:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093686.762724:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784093686.762736:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024205696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093686.762767:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093686.762832:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024205696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093686.762840:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784093686.762884:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024205696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093687.273653:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093688.297815:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093689.208639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093689.208691:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093689.208726:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093689.208732:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655168 00000100:00100000:0.0:1784093689.208744:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655168 00000100:00100000:2.0:1784093689.208776:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655424 00000100:00100000:2.0:1784093689.208784:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655424 00000100:00100000:0.0:1784093689.208812:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 604 00000100:00100000:0.0:1784093689.208834:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013655168:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093689.208842:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655296 00000100:00100000:3.0:1784093689.208857:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093689.208858:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655296 00000100:00100000:2.0:1784093689.208866:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 354 00000100:00100000:2.0:1784093689.208884:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013655424:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093689.208913:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655552 00000100:00100000:3.0:1784093689.208920:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655552 00000100:00100000:0.0:1784093689.208921:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013655168:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.208931:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013655424:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.208935:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 604 00000100:00100000:2.0:1784093689.208946:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 354 00000100:00100000:2.0:1784093689.208969:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 355 00000100:00100000:2.0:1784093689.208979:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013655552:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093689.208985:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:0.0:1784093689.208996:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013655296:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093689.209010:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013655552:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.209034:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013655296:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.209041:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00080000:0.0:1784093689.209107:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093689.209114:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093689.209117:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093689.209254:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 355 00010000:00010000:1.0:1784093689.321668:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093689.833773:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024206208:0@lo:400:kworker.0 00000100:00100000:0.0:1784093689.833773:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024205952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093689.833778:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024206080:0@lo:400:kworker.0 00000100:00100000:3.0:1784093689.833843:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024205824:0@lo:400:kworker.0 00000100:00100000:1.0:1784093689.833873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093689.833887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093689.833928:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206208 00000100:00100000:3.0:1784093689.833936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093689.833942:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206208 00000100:00100000:0.0:1784093689.833993:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205952 00000100:00100000:3.0:1784093689.834001:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024205824 00000100:00100000:0.0:1784093689.834003:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205952 00000100:00100000:3.0:1784093689.834010:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024205824 00000100:00100000:2.0:1784093689.834044:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1784093689.834061:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024206208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093689.834117:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1784093689.834118:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784093689.834135:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024205824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093689.834139:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024205952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093689.834154:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024206592:0@lo:400:kworker.0 00000100:00100000:2.0:1784093689.834168:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024206208:12345-0@lo:400:kworker.0 Request processed in 112us (297us total) trans 0 rc 0/0 00002000:00000024:0.0:1784093689.834181:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093689.834190:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1784093689.834227:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024205824:12345-0@lo:400:kworker.0 Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093689.834228:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093689.834238:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093689.834244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093689.834249:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1784093689.834266:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024205952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.834281:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784093689.834286:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206592 00000100:00100000:2.0:1784093689.834295:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206592 00000100:00100000:1.0:1784093689.834337:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024205952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093689.834345:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093689.834368:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784093689.834391:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784093689.834398:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024206592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093689.834408:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024206464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093689.834469:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206080 00000100:00100000:0.0:1784093689.834479:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206080 00000100:00100000:3.0:1784093689.834505:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024205824:0@lo:400:kworker.0 00000100:00100000:1.0:1784093689.834506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093689.834519:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024206592:12345-0@lo:400:kworker.0 Request processed in 138us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093689.834529:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024206336:0@lo:400:kworker.0 00000100:00100000:2.0:1784093689.834534:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1784093689.834535:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206464 00000100:00100000:0.0:1784093689.834547:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206464 00000100:00100000:3.0:1784093689.834592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093689.834594:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024206592:0@lo:400:kworker.0 00000100:00100000:2.0:1784093689.834613:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024206208:0@lo:400:kworker.0 00000100:00100000:0.0:1784093689.834644:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1784093689.834657:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093689.834668:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206336 00000100:00100000:2.0:1784093689.834673:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206336 00000100:00100000:1.0:1784093689.834687:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1784093689.834701:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024206464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093689.834702:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093689.834716:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093689.834718:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784093689.834739:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024206336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093689.834741:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024206080:12345-0@lo:400:kworker.0 Request processed in 79us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093689.834761:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024206464:12345-0@lo:400:kworker.0 Request processed in 65us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.834766:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1784093689.834775:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1784093689.834825:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024206336:12345-0@lo:400:kworker.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.834839:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784093689.834841:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024206080:0@lo:400:kworker.0 00000100:00100000:0.0:1784093689.834863:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024206464:0@lo:400:kworker.0 00000100:00100000:3.0:1784093689.834907:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024206336:0@lo:400:kworker.0 00000100:00100000:1.0:1784093689.950734:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093689.950942:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655680 00000100:00100000:2.0:1784093689.950952:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655680 00000100:00100000:2.0:1784093689.951011:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 436 00000100:00100000:2.0:1784093689.951069:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013655680:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093689.951172:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013655680:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 108us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.951196:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 436 00000100:00100000:1.0:1784093689.952312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093689.952405:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655808 00000100:00100000:2.0:1784093689.952412:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655808 00000100:00100000:2.0:1784093689.952478:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 212 00000100:00100000:2.0:1784093689.952487:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013655808:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093689.953259:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013655808:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 771us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.953265:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 212 00000100:00100000:3.0:1784093689.954549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093689.954601:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013655936 00000100:00100000:2.0:1784093689.954609:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013655936 00000100:00100000:2.0:1784093689.954647:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 213 00000100:00100000:2.0:1784093689.954655:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013655936:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093689.954912:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013655936:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 258us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.954917:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 213 00000100:00100000:1.0:1784093689.955851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093689.955934:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656064 00000100:00100000:3.0:1784093689.955941:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656064 00000100:00100000:3.0:1784093689.955979:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 437 00000100:00100000:3.0:1784093689.955987:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013656064:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093689.956345:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013656064:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 358us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093689.956353:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 437 00000100:00100000:1.0:1784093689.959485:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093689.959533:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656192 00000100:00100000:0.0:1784093689.959542:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656192 00000100:00100000:0.0:1784093689.959621:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 438 00000100:00100000:0.0:1784093689.959630:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013656192:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093689.959715:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013656192:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.959720:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 438 00000100:00100000:0.0:1784093689.961354:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093689.961465:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656320 00000100:00100000:2.0:1784093689.961474:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656320 00000100:00100000:2.0:1784093689.961520:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 214 00000100:00100000:2.0:1784093689.961530:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013656320:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093689.961928:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013656320:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 398us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.961936:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 214 00000100:00100000:1.0:1784093689.965564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093689.965791:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656448 00000100:00100000:2.0:1784093689.965808:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656448 00000100:00100000:2.0:1784093689.965901:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 215 00000100:00100000:2.0:1784093689.965936:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013656448:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093689.966396:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37327:x1870757013656448:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 462us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093689.966404:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 215 00000100:00100000:1.0:1784093689.968003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093689.968092:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656576 00000100:00100000:2.0:1784093689.968101:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656576 00000100:00100000:0.0:1784093689.968222:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 439 00000100:00100000:0.0:1784093689.968237:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013656576:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093689.968998:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37327:x1870757013656576:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 759us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.969009:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 439 00000100:00100000:0.0:1784093689.986270:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093689.986332:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656704 00000100:00100000:3.0:1784093689.986345:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656704 00000100:00100000:3.0:1784093689.986473:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:3.0:1784093689.986487:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:37328:x1870757013656704:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093689.986512:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093689.986552:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5593 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.986625:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c998f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.986636:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c998f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.986649:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c998f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093689.986899:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093689.986904:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093689.988641:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c998f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.988681:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c9988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5593 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.988705:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c998f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5593 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.988714:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781000) 00010000:00010000:3.0:1784093689.988717:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093689.988721:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200030600, rc 0) 00000100:00100000:3.0:1784093689.988788:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:37328:x1870757013656704:12345-192.168.204.57@tcp:101:rm.0 Request processed in 2305us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093689.988797:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:0.0:1784093689.991855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093689.991950:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013656960 00000100:00100000:3.0:1784093689.991972:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013656960 00000100:00100000:3.0:1784093689.992089:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 441 00000100:00100000:3.0:1784093689.992103:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37328:x1870757013656960:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093689.992123:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093689.992148:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf559a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093689.992512:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00010000:00010000:3.0:1784093689.992991:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9996 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf559a expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.993011:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784093689.993015:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784093689.993021:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c9996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf559a expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093689.993056:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200031a00, rc 0) 00000100:00100000:3.0:1784093689.993134:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:37328:x1870757013656960:12345-192.168.204.57@tcp:101:rm.0 Request processed in 1031us (1347us total) trans 4294967471 rc 301/301 00000100:00100000:3.0:1784093689.993146:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 441 00000100:00100000:0.0:1784093689.995674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093689.995726:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013657088 00000100:00100000:3.0:1784093689.995734:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013657088 00000100:00100000:3.0:1784093689.995785:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 48 00000100:00100000:3.0:1784093689.995801:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:37328:x1870757013657088:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:0.0:1784093689.998563:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:37328:x1870757013657088:12345-192.168.204.57@tcp:37:rm.0 Request processed in 2758us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093689.998575:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 48 00000100:00100000:0.0:1784093690.000829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093690.000879:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013657344 00000100:00100000:2.0:1784093690.000889:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013657344 00000100:00100000:2.0:1784093690.000942:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 49 00000100:00100000:2.0:1784093690.000954:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:37328:x1870757013657344:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784093690.001632:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:37328:x1870757013657344:12345-192.168.204.57@tcp:35:rm.0 Request processed in 679us (808us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1784093690.001641:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 49 00000100:00100000:2.0:1784093690.003805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093690.003944:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013657600 00000100:00100000:0.0:1784093690.003953:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013657600 00000100:00100000:0.0:1784093690.004012:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 442 00000100:00100000:0.0:1784093690.004024:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:37328:x1870757013657600:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093690.004074:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784093690.004103:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c998f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5593 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004126:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf557e expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004147:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c95bb) 00010000:00010000:0.0:1784093690.004151:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781000) 00010000:00010000:0.0:1784093690.004165:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093690.004188:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004197:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004204:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004214:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004228:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004233:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004745:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004756:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004765:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004978:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004987:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.004995:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005002:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093690.005007:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005015:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005026:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093690.005035:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093690.005040:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005046:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c99b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005068:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005074:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005080:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005086:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093690.005090:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005097:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005107:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784093690.005109:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093690.005112:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005119:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214c99a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005132:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005149:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005155:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005160:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093690.005163:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005170:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005181:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202e6b400) 00010000:00010000:0.0:1784093690.005184:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093690.005187:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093690.005193:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214c99ab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093690.005278:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:37328:x1870757013657600:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1251us (1484us total) trans 0 rc -13/-13 00000100:00100000:0.0:1784093690.005287:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 442 00010000:00010000:0.0:1784093690.345688:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093690.364885:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967472 is committed 00000020:00000080:1.0:1784093691.309346:0:62455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7fe5bc10 20000000:00000080:1.0:1784093691.309368:0:62455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210910800 uarg=0000000000000000 00010000:00010000:1.0:1784093691.309961:0:62455:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093691.309979:0:62455:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093691.309993:0:62455:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093691.310017:0:62455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093691.310039:0:62455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9911 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093691.310056:0:62455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093691.310104:0:62455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9911 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093691.310121:0:62455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9911 expref: 18 pid: 5770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093691.310140:0:62455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62455:1870757024206720:0@lo:104: 00000100:00100000:1.0:1784093691.310225:0:62455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093691.310309:0:62455:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a9be840 going to sleep for 11 seconds 00000100:00100000:0.0:1784093691.310332:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784093691.310349:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206720 00000100:00100000:0.0:1784093691.310357:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206720 00000100:00100000:0.0:1784093691.310452:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784093691.310466:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90722d994450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:62455:x1870757024206720:12345-0@lo:104: 00010000:00010000:0.0:1784093691.310490:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.310567:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093691.310573:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90722d994450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:62455:x1870757024206720:12345-0@lo:104: Request processed in 111us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093691.310580:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784093691.310598:0:62455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62455:1870757024206720:0@lo:104: 00010000:00010000:2.0:1784093691.310603:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093691.310619:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093691.310633:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:1.0:1784093691.310634:0:62455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093691.310640:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093691.310658:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093691.310666:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093691.310690:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093691.310748:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093691.310756:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093691.310790:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093691.310797:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12e00/0x9ce98053214c9911 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9918 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093691.310820:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1784093691.310822:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093691.310826:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093691.310829:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093691.310839:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024206848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093691.310885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093691.310942:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206848 00000100:00100000:0.0:1784093691.310948:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206848 00010000:00010000:0.0:1784093691.310967:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9911 expref: 19 pid: 5770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093691.310997:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1784093691.311004:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024206848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093691.311016:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093691.311023:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9911 expref: 19 pid: 5770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311036:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9911 expref: 19 pid: 5770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311051:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214c9918 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9911 expref: 19 pid: 5770 timeout: 1002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311066:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311074:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311102:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311110:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311116:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311122:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311128:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093691.311133:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311141:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093691.311225:0:62455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311225:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093691.311234:0:62455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 2/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093691.311237:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093691.311241:0:62455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214c99b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093691.311274:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024206848:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093691.311283:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784093691.311322:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024206848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093691.370463:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093691.692274:0:62503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0d927f30 20000000:00000080:3.0:1784093691.692306:0:62503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907230a48000 uarg=0000000000000000 00010000:00010000:3.0:1784093691.692629:0:62503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093691.692645:0:62503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093691.692659:0:62503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093691.692680:0:62503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692695:0:62503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692707:0:62503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692713:0:62503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692720:0:62503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692727:0:62503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692734:0:62503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093691.692738:0:62503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692747:0:62503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692768:0:62503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692776:0:62503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093691.692782:0:62503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907200030800/0x9ce98053214c99c0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093691.881579:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024206976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093691.881656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093691.881712:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024206976 00000100:00100000:2.0:1784093691.881722:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024206976 00000100:00080000:0.0:1784093691.881757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093691.881786:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784093691.881798:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024206976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093691.881836:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093691.881890:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024206976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093691.881899:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1784093691.881928:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024206976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093692.393727:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093692.969097:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093692.969348:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013657728 00000100:00100000:3.0:1784093692.969358:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013657728 00000100:00080000:0.0:1784093692.969416:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093692.969577:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 443 00000100:00100000:3.0:1784093692.969589:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:37440:x1870757013657728:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093692.969607:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093692.969628:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c99c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55a1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093692.969646:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093692.969649:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093692.969652:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093692.969689:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c99ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093692.969692:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093692.969708:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.969711:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c99ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093692.969714:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.969728:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c99ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093692.969747:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024207104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093692.969813:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093692.969859:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486d80 going to sleep for 11 seconds 00000004:00200000:3.0:1784093692.969924:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093692.969929:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093692.970012:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c99ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.970039:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214c99c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55a1 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.970054:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c99ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55a1 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.970061:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093692.970064:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093692.970067:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200031a00, rc 0) 00000100:00100000:3.0:1784093692.970118:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:37440:x1870757013657728:12345-192.168.204.57@tcp:101:rm.0 Request processed in 532us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093692.970124:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207104 00000100:00100000:3.0:1784093692.970126:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 443 00000100:00100000:0.0:1784093692.970131:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207104 00000100:00100000:0.0:1784093692.970167:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1784093692.970175:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024207104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093692.970181:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093692.970191:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c99d5 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093692.970204:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093692.970210:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093692.970217:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784093692.970274:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024207104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093692.970282:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1784093692.971331:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024207104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093692.971351:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.971360:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093692.971379:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093692.971383:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.971393:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093692.972012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093692.972052:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013657856 00000100:00100000:3.0:1784093692.972066:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013657856 00000100:00100000:3.0:1784093692.972114:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 444 00000100:00100000:3.0:1784093692.972123:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37440:x1870757013657856:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093692.972137:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093692.972153:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c99e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55a8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972198:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972208:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972218:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972231:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972239:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972245:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972638:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c99f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972649:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c99f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972657:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c99f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093692.972767:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00000004:00200000:3.0:1784093692.972771:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093692.972847:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c99f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972859:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972865:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972870:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972874:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093692.972877:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972882:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972889:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093692.972891:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093692.972894:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972898:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214c99ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972909:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972925:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972931:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972936:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093692.972939:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972946:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972954:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fceb00) 00010000:00010000:3.0:1784093692.972957:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093692.972959:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972965:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c99f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.972995:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214c99e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55a8 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.973009:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c99f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55a8 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.973017:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093692.973019:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093692.973028:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784093692.973122:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37440:x1870757013657856:12345-192.168.204.57@tcp:101:rm.0 Request processed in 999us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093692.973130:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 444 00000100:00100000:1.0:1784093692.974816:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093692.974973:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013658112 00000100:00100000:0.0:1784093692.974980:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013658112 00000100:00100000:0.0:1784093692.975018:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 445 00000100:00100000:0.0:1784093692.975028:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:37440:x1870757013658112:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093692.975045:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093692.975059:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c99ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55af expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093692.975280:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00010000:00010000:0.0:1784093692.975516:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c99ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55af expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093692.975529:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:0.0:1784093692.975532:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784093692.975536:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c99ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55af expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093692.975548:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784093692.975597:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:37440:x1870757013658112:12345-192.168.204.57@tcp:101:rm.0 Request processed in 570us (784us total) trans 4294967473 rc 301/301 00000100:00100000:0.0:1784093692.975604:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 445 00000100:00100000:0.0:1784093692.978375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093692.978508:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013658240 00000100:00100000:3.0:1784093692.978517:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013658240 00000100:00100000:3.0:1784093692.978615:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 50 00000100:00100000:3.0:1784093692.978623:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:37440:x1870757013658240:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:3.0:1784093692.982038:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:37440:x1870757013658240:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3406us (3661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093692.982051:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 50 00000100:00100000:1.0:1784093692.984173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093692.984230:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013658496 00000100:00100000:2.0:1784093692.984238:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013658496 00000100:00100000:2.0:1784093692.984324:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 51 00000100:00100000:2.0:1784093692.984332:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:37440:x1870757013658496:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784093692.984743:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:37440:x1870757013658496:12345-192.168.204.57@tcp:35:rm.0 Request processed in 410us (575us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1784093692.984750:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 51 00000100:00100000:0.0:1784093692.986120:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093692.986195:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013658752 00000100:00100000:2.0:1784093692.986201:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013658752 00000100:00100000:2.0:1784093692.986235:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 446 00000100:00100000:2.0:1784093692.986244:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:37440:x1870757013658752:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784093692.986294:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093692.986318:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c99f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55a8 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986331:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff907204fce900) 00010000:00010000:2.0:1784093692.986341:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214c99ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55a1 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986347:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:2.0:1784093692.986351:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093692.986370:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986382:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986391:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986404:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986449:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986456:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986693:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986707:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.986712:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093692.987521:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 7680 00010000:00010000:2.0:1784093692.987533:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987538:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987543:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987546:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093692.987549:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987553:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987567:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093692.987569:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093692.987571:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987575:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987588:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987591:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987595:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987598:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093692.987600:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987603:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987606:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093692.987607:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093692.987609:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093692.987612:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a0d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093692.987626:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006f73b4e5 reply state 00000000cb86a56b transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093692.987632:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093692.987726:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:37440:x1870757013658752:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1483us (1609us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1784093692.987732:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 446 00010000:00010000:3.0:1784093692.988604:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.988613:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.988620:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.988626:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093692.988629:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.988636:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.988645:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781600) 00010000:00010000:3.0:1784093692.988742:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093692.988755:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093692.988762:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9a14 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093693.007543:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093693.008080:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013658880 00000100:00100000:3.0:1784093693.008090:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013658880 00000100:00100000:3.0:1784093693.008152:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 447 00000100:00100000:3.0:1784093693.008164:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:37444:x1870757013658880:12345-192.168.204.57@tcp:101:mkdir.0 00010000:00010000:3.0:1784093693.008190:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093693.008215:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55b6 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.008286:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9a29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.008300:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.008312:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093693.008370:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093693.008375:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093693.008400:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.008452:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55b6 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.008472:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55b6 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.008495:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784093693.008499:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093693.008502:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093693.008556:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:37444:x1870757013658880:12345-192.168.204.57@tcp:101:mkdir.0 Request processed in 394us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093693.008562:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 447 00000100:00100000:0.0:1784093693.010457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093693.010491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093693.010518:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013659264 00000100:00100000:1.0:1784093693.010527:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013659008 00000100:00100000:3.0:1784093693.010528:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013659264 00000100:00100000:1.0:1784093693.010532:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013659008 00000100:00100000:3.0:1784093693.010585:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 448 00000100:00100000:1.0:1784093693.010593:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 449 00000100:00100000:3.0:1784093693.010599:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:37444:x1870757013659264:12345-192.168.204.57@tcp:36:mkdir.0 00000100:00100000:1.0:1784093693.010605:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:2352:x1870757013659008:12345-192.168.204.57@tcp:41:mkdir.0 00000004:00000024:1.0:1784093693.010635:0:5779:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:3.0:1784093693.010645:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093693.010670:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9a29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55b6 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093693.010681:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:2352:x1870757013659008:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 81us (190us total) trans 0 rc 0/0 00010000:00010000:3.0:1784093693.010687:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fceb00) 00000100:00100000:1.0:1784093693.010687:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 449 00010000:00010000:3.0:1784093693.010703:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093693.010768:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.010784:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.010794:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.010856:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.010880:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.010888:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093693.011854:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00010000:00010000:3.0:1784093693.011863:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.011869:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.011874:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.011878:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093693.011881:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.011886:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.011892:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093693.011894:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093693.011896:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.011900:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093693.011919:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005733d5d0 reply state 00000000aeef5689 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093693.011925:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093693.012223:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:37444:x1870757013659264:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1626us (1770us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1784093693.012231:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 448 00010000:00010000:3.0:1784093693.013156:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.013166:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.013172:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.013177:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093693.013180:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.013186:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.013196:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce500) 00010000:00010000:3.0:1784093693.013198:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093693.013201:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.013206:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a37 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093693.034484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093693.034647:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013659392 00000100:00100000:3.0:1784093693.034657:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013659392 00000100:00100000:3.0:1784093693.034717:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 450 00000100:00100000:3.0:1784093693.034729:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:37448:x1870757013659392:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784093693.034754:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093693.034777:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55bd expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.034826:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.034837:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.034846:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093693.034904:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093693.034908:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093693.034933:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.034956:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55bd expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.034974:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55bd expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.034983:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093693.034999:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093693.035004:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784093693.035062:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:37448:x1870757013659392:12345-192.168.204.57@tcp:101:chown.0 Request processed in 335us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093693.035070:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 450 00000100:00100000:0.0:1784093693.036501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093693.036648:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013659520 00000100:00100000:2.0:1784093693.036656:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013659520 00000100:00100000:2.0:1784093693.036702:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 451 00000100:00100000:2.0:1784093693.036710:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:37448:x1870757013659520:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093693.036722:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093693.036745:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55c4 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036785:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036796:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036805:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036830:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036837:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036856:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036936:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036943:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.036951:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093693.036990:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:2.0:1784093693.036994:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093693.037013:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037024:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037031:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037041:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037047:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093693.037052:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037059:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037075:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784093693.037078:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093693.037082:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037088:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037101:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037107:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037113:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037118:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093693.037121:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037130:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037137:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781b00) 00010000:00010000:2.0:1784093693.037139:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093693.037142:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037148:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214c9a5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037183:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55c4 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037195:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55c4 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.037202:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093693.037204:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093693.037207:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784093693.037275:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:37448:x1870757013659520:12345-192.168.204.57@tcp:101:chown.0 Request processed in 566us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093693.037282:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 451 00000100:00100000:1.0:1784093693.040584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093693.040689:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013659776 00000100:00100000:3.0:1784093693.040699:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013659776 00000100:00100000:3.0:1784093693.040764:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 452 00000100:00100000:3.0:1784093693.040775:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:37448:x1870757013659776:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:3.0:1784093693.040910:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093693.040938:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55c4 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.040958:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781900) 00010000:00010000:3.0:1784093693.040969:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093693.040992:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.041005:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093693.041014:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093693.058994:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c8283a40 reply state 000000001a61a42e transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093693.059014:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784093693.059014:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967473 is committed 00000001:00080000:1.0:1784093693.059032:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967475 is committed 00000001:00080000:1.0:1784093693.059045:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967477 is committed 00000004:00200000:3.0:1784093693.059175:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00010000:00080000:3.0:1784093693.059286:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093693.059309:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:37448:x1870757013659776:12345-192.168.204.57@tcp:36:chown.0 Request processed in 18532us (18731us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1784093693.059319:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 452 00010000:00010000:1.0:1784093693.059321:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.059351:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.059362:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.059368:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093693.059376:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.059384:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.059401:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce400) 00010000:00010000:1.0:1784093693.059404:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093693.059409:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.059415:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9a68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.417642:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093693.421972:0:62700:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdefc55830 20000000:00000080:1.0:1784093693.421987:0:62700:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101e3bc00 uarg=0000000000000000 00010000:00010000:1.0:1784093693.422452:0:62700:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093693.422487:0:62700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784093693.422491:0:62700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093693.422502:0:62700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9a45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55bd expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.422523:0:62700:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093693.422544:0:62700:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093693.422557:0:62700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.422569:0:62700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.422577:0:62700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.422611:0:62700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.422621:0:62700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 18 pid: 5771 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093693.422632:0:62700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62700:1870757024207232:0@lo:104: 00000100:00100000:1.0:1784093693.422684:0:62700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093693.422721:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207232 00000100:00100000:1.0:1784093693.422728:0:62700:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093693.422729:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207232 00000100:00100000:0.0:1784093693.422773:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784093693.422781:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:62700:x1870757024207232:12345-0@lo:104: 00010000:00010000:0.0:1784093693.422792:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.422841:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093693.422846:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:62700:x1870757024207232:12345-0@lo:104: Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093693.422853:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00010000:2.0:1784093693.422870:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1784093693.422876:0:62700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62700:1870757024207232:0@lo:104: 00010000:00010000:2.0:1784093693.422880:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.422891:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093693.422895:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.422897:0:62700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.422910:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093693.422919:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093693.422925:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093693.422961:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.422968:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093693.422998:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423006:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13c00/0x9ce98053214c99d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c99dc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093693.423019:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1784093693.423021:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093693.423025:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093693.423028:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093693.423033:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024207360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093693.423062:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093693.423099:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207360 00000100:00100000:2.0:1784093693.423104:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207360 00010000:00010000:2.0:1784093693.423137:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 19 pid: 5771 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093693.423161:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784093693.423169:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024207360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093693.423189:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093693.423194:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 19 pid: 5771 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423204:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 19 pid: 5771 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423214:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76200/0x9ce98053214c99dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c99d5 expref: 19 pid: 5771 timeout: 1004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423226:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423240:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423252:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423270:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423276:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423282:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423287:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093693.423291:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423298:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423313:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093693.423322:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093693.423328:0:62700:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.423337:0:62700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093693.423351:0:62700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214c9a6f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093693.423364:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024207360:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093693.423371:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784093693.424251:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024207360:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784093693.812569:0:62748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0f87ea30 20000000:00000080:0.0:1784093693.812587:0:62748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723082b800 uarg=0000000000000000 00010000:00010000:0.0:1784093693.812800:0:62748:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093693.812815:0:62748:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093693.812827:0:62748:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093693.812844:0:62748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812859:0:62748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812869:0:62748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812876:0:62748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812883:0:62748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812890:0:62748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812897:0:62748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093693.812906:0:62748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812914:0:62748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812926:0:62748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812934:0:62748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093693.812941:0:62748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214c9a76 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093694.329092:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093694.329129:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093694.329165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093694.329192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093694.329216:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660032 00000100:00100000:1.0:1784093694.329226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660032 00000100:00100000:1.0:1784093694.329297:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:1.0:1784093694.329308:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013660032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093694.329336:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013659904 00000100:00100000:3.0:1784093694.329340:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013659904 00000100:00100000:3.0:1784093694.329369:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:3.0:1784093694.329375:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013659904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093694.329387:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013660032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093694.329394:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:3.0:1784093694.329398:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013659904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 24us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093694.329403:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:0.0:1784093694.329591:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660160 00000100:00100000:0.0:1784093694.329595:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660160 00000100:00100000:0.0:1784093694.329624:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660288 00000100:00100000:0.0:1784093694.329627:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660288 00000100:00100000:0.0:1784093694.329658:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 358 00000100:00100000:3.0:1784093694.329663:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 359 00000100:00100000:0.0:1784093694.329666:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013660160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093694.329670:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013660288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093694.329701:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013660288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093694.329701:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013660160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093694.329708:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 358 00000100:00100000:3.0:1784093694.329711:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 359 00000100:00080000:0.0:1784093694.329727:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093694.329731:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093694.329734:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784093694.442628:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784093694.697992:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093694.697998:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093694.698002:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093694.698044:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093694.698068:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093694.698080:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093694.698105:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024207488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093694.698186:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093694.698257:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af780 going to sleep for 11 seconds 00000100:00100000:2.0:1784093694.698258:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207488 00000100:00100000:2.0:1784093694.698272:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207488 00000100:00100000:2.0:1784093694.698326:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1784093694.698342:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024207488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093694.698356:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093694.698370:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9a7d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093694.698392:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093694.698403:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093694.698413:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093694.698473:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024207488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093694.698481:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1784093694.698587:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024207488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093694.698601:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093694.698612:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093694.698631:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093694.698636:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093694.698643:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093694.953602:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024207872:0@lo:400:kworker.0 00000100:00100000:0.0:1784093694.953602:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024207616:0@lo:400:kworker.0 00000100:00100000:1.0:1784093694.953620:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024207744:0@lo:400:kworker.0 00000100:00100000:2.0:1784093694.953697:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024208000:0@lo:400:kworker.0 00000100:00100000:3.0:1784093694.954215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093694.954268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093694.954298:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024208256:0@lo:400:kworker.0 00000100:00100000:3.0:1784093694.954314:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207872 00000100:00100000:3.0:1784093694.954321:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207872 00000100:00100000:1.0:1784093694.954329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093694.954395:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207744 00000100:00100000:1.0:1784093694.954399:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207744 00000100:00100000:1.0:1784093694.954465:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1784093694.954475:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024207744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093694.954524:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024207744:12345-0@lo:400:kworker.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093694.954532:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1784093694.954605:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024207744:0@lo:400:kworker.0 00000100:00100000:3.0:1784093694.954620:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1784093694.954623:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093694.954627:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024207872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093694.954639:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024208384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093694.954665:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024207872:12345-0@lo:400:kworker.0 Request processed in 38us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093694.954677:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1784093694.954677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093694.954711:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208256 00000100:00100000:3.0:1784093694.954721:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208256 00000100:00100000:3.0:1784093694.954758:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784093694.954765:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024208256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093694.954806:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024208256:12345-0@lo:400:kworker.0 Request processed in 42us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093694.954814:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:1.0:1784093694.954817:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093694.954823:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093694.954889:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208384 00000100:00100000:3.0:1784093694.954893:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208384 00000100:00100000:3.0:1784093694.954918:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784093694.954921:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024208256:0@lo:400:kworker.0 00000100:00100000:3.0:1784093694.954926:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024208384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093694.954950:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093694.954984:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024208384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093694.954988:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784093694.955012:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024207872:0@lo:400:kworker.0 00000100:00100000:3.0:1784093694.955045:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024208384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093694.955505:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093694.955517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093694.955550:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024207616 00000100:00100000:3.0:1784093694.955556:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024207616 00000100:00100000:0.0:1784093694.955564:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024208128:0@lo:400:kworker.0 00000100:00100000:2.0:1784093694.955582:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208000 00000100:00100000:2.0:1784093694.955587:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208000 00000100:00100000:3.0:1784093694.955593:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1784093694.955604:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024207616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093694.955606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093694.955637:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1784093694.955646:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024208000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093694.955679:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208128 00000100:00100000:3.0:1784093694.955681:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024207616:12345-0@lo:400:kworker.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093694.955686:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208128 00000100:00100000:3.0:1784093694.955694:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1784093694.955696:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024208000:12345-0@lo:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093694.955706:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1784093694.955734:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00080000:2.0:1784093694.955735:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093694.955740:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093694.955744:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024207616:0@lo:400:kworker.0 00000100:00100000:0.0:1784093694.955745:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024208128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093694.955777:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024208000:0@lo:400:kworker.0 00000100:00100000:0.0:1784093694.955800:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024208128:12345-0@lo:400:kworker.0 Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093694.955811:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024208128:0@lo:400:kworker.0 00000100:00100000:0.0:1784093694.955812:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:1.0:1784093695.071235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093695.071302:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660416 00000100:00100000:3.0:1784093695.071312:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660416 00000100:00100000:3.0:1784093695.071383:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 8 00000100:00100000:3.0:1784093695.071395:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:5558:x1870757013660416:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093695.071411:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093695.071414:0:5765:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9a45) 00010000:00010000:3.0:1784093695.071417:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093695.071497:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:5558:x1870757013660416:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 104us (281us total) trans 0 rc 116/116 00000100:00100000:3.0:1784093695.071506:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 8 00010000:00010000:3.0:1784093695.466001:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093695.804683:0:62991:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4ecfbb80 20000000:00000080:0.0:1784093695.804701:0:62991:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d997400 uarg=0000000000000000 00010000:00010000:0.0:1784093695.804914:0:62991:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093695.804929:0:62991:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093695.804942:0:62991:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093695.804960:0:62991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093695.804975:0:62991:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093695.804984:0:62991:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093695.805021:0:62991:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093695.805035:0:62991:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 18 pid: 5771 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093695.805050:0:62991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62991:1870757024208512:0@lo:104: 00000100:00100000:0.0:1784093695.805118:0:62991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093695.805162:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208512 00000100:00100000:0.0:1784093695.805166:0:62991:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720780 going to sleep for 11 seconds 00000100:00100000:1.0:1784093695.805169:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208512 00000100:00100000:1.0:1784093695.805226:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784093695.805237:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:62991:x1870757024208512:12345-0@lo:104: 00010000:00010000:1.0:1784093695.805254:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093695.805318:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093695.805325:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:62991:x1870757024208512:12345-0@lo:104: Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093695.805333:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784093695.805338:0:62991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62991:1870757024208512:0@lo:104: 00010000:00010000:0.0:1784093695.805359:0:62991:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805406:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093695.805414:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805442:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093695.805446:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805456:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093695.805464:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093695.805471:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093695.805503:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805522:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093695.805552:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805557:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214c9a7d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9a84 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093695.805568:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024208640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093695.805570:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093695.805572:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093695.805576:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093695.805603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093695.805664:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208640 00000100:00100000:3.0:1784093695.805669:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208640 00010000:00010000:3.0:1784093695.805693:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 19 pid: 5771 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093695.805723:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1784093695.805732:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024208640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093695.805743:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093695.805748:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 19 pid: 5771 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805759:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 19 pid: 5771 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805771:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214c9a84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9a7d expref: 19 pid: 5771 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805783:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805800:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805810:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805822:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805828:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805835:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805840:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093695.805844:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805852:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805874:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093695.805884:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093695.805894:0:62991:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093695.805904:0:62991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093695.805910:0:62991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77800/0x9ce98053214c9a8b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093695.805920:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024208640:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093695.805926:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784093695.805958:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024208640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093696.489665:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093697.002593:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024208768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093697.002673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093697.005531:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208768 00000100:00100000:1.0:1784093697.005545:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208768 00000100:00080000:0.0:1784093697.005592:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093697.005611:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1784093697.005623:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024208768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093697.005663:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093697.005739:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024208768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093697.005748:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784093697.005778:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024208768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093697.007248:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093697.007320:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660544 00000100:00100000:0.0:1784093697.007328:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660544 00000100:00080000:1.0:1784093697.007402:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093697.007402:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 453 00000100:00100000:0.0:1784093697.007416:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:37625:x1870757013660544:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093697.007583:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093697.007607:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55cb expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.007664:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9a99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.007678:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.007697:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093697.007898:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784093697.007903:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093697.007990:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.008028:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55cb expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.008044:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55cb expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.008053:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784093697.008056:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093697.008061:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093697.008122:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37625:x1870757013660544:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 702us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093697.008130:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 453 00000100:00100000:1.0:1784093697.010279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093697.010341:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660672 00000100:00100000:3.0:1784093697.010350:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660672 00000100:00100000:3.0:1784093697.010402:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 454 00000100:00100000:3.0:1784093697.010413:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37625:x1870757013660672:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093697.010448:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093697.010463:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55d2 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010503:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010513:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010520:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010531:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010535:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010540:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010798:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010812:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.010817:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093697.010889:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:3.0:1784093697.010894:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093697.011006:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011019:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011027:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011034:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011040:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093697.011044:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011052:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011064:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b800) 00010000:00010000:3.0:1784093697.011068:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093697.011072:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011089:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011101:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011107:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011113:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011119:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093697.011123:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011130:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011140:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce600) 00010000:00010000:3.0:1784093697.011143:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093697.011146:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011152:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011196:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55d2 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011268:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55d2 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.011283:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784093697.011286:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093697.011289:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784093697.011390:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:37625:x1870757013660672:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 978us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093697.011396:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 454 00000100:00100000:1.0:1784093697.015509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093697.015581:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013660928 00000100:00100000:2.0:1784093697.015589:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013660928 00000100:00100000:2.0:1784093697.015629:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 455 00000100:00100000:2.0:1784093697.015639:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:37625:x1870757013660928:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093697.015689:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093697.015714:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55d2 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093697.015726:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784093697.015733:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093697.015824:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093697.015835:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093697.015848:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093697.037326:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967478 is committed 00000004:00010000:2.0:1784093697.037469:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000fe9149c7 reply state 000000003bc7e7c4 transno 4294967478 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093697.037484:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784093697.037654:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00010000:00080000:2.0:1784093697.037748:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784093697.037770:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:37625:x1870757013660928:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 22128us (22266us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1784093697.037780:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 455 00010000:00010000:3.0:1784093697.037841:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.037851:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.037860:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.037866:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093697.037869:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.037876:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.037889:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784093697.037892:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093697.037894:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.037898:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9abc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093697.065582:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093697.065592:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093697.065598:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093697.065672:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093697.065685:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093697.065699:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093697.065733:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024208896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093697.065824:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093697.065887:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093697.066045:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024208896 00000100:00100000:2.0:1784093697.066060:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024208896 00000100:00100000:2.0:1784093697.066123:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1784093697.066133:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024208896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093697.066152:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093697.066174:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9ac3 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093697.066214:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093697.066226:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093697.066235:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093697.066315:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024208896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093697.066322:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1784093697.066376:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024208896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093697.066397:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093697.066408:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093697.066449:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093697.066457:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093697.066490:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093697.374045:0:63186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff952422f0 20000000:00000080:0.0:1784093697.374061:0:63186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d997400 uarg=0000000000000000 00010000:00010000:0.0:1784093697.374536:0:63186:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093697.374567:0:63186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784093697.374570:0:63186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093697.374580:0:63186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9a99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55cb expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.374612:0:63186:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093697.374627:0:63186:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093697.374640:0:63186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.374715:0:63186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.374724:0:63186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.374758:0:63186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.374770:0:63186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 18 pid: 5771 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093697.374783:0:63186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63186:1870757024209024:0@lo:104: 00000100:00100000:0.0:1784093697.374838:0:63186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093697.374886:0:63186:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093697.374903:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209024 00000100:00100000:2.0:1784093697.374911:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209024 00000100:00100000:2.0:1784093697.374953:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784093697.374962:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:63186:x1870757024209024:12345-0@lo:104: 00010000:00010000:2.0:1784093697.374972:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093697.375050:0:63186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63186:1870757024209024:0@lo:104: 00010000:00010000:2.0:1784093697.375060:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093697.375066:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:63186:x1870757024209024:12345-0@lo:104: Request processed in 106us (228us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093697.375069:0:63186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093697.375074:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00010000:3.0:1784093697.375116:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093697.375121:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375127:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093697.375130:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375136:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093697.375140:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093697.375143:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093697.375168:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375172:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784093697.375239:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1784093697.375278:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375283:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13600/0x9ce98053214c9ac3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9aca expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375296:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093697.375297:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093697.375298:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093697.375321:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024209152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093697.375342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093697.375557:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209152 00000100:00100000:3.0:1784093697.375565:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209152 00010000:00010000:3.0:1784093697.375581:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 19 pid: 5771 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093697.375603:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784093697.375608:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024209152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093697.375616:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093697.375619:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 19 pid: 5771 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375626:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 19 pid: 5771 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375633:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214c9aca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9ac3 expref: 19 pid: 5771 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375644:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375652:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375664:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375672:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375679:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375686:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375696:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093697.375700:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375705:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375719:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093697.375727:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093697.375750:0:63186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093697.375757:0:63186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093697.375761:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024209152:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (417us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093697.375775:0:63186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76200/0x9ce98053214c9ad1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093697.375776:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1784093697.375838:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024209152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093697.513694:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093698.537538:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093698.553987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093698.554025:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013661056 00000100:00100000:1.0:1784093698.554036:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013661056 00000100:00100000:1.0:1784093698.554087:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 456 00000100:00100000:1.0:1784093698.554099:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:37701:x1870757013661056:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093698.554124:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093698.554147:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55d9 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554230:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554244:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554257:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554273:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554281:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554289:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554816:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9aed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554827:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.554836:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093698.554923:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:1.0:1784093698.554927:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093698.555017:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555030:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555037:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555044:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555050:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093698.555055:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555063:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555075:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202d46200) 00010000:00010000:1.0:1784093698.555083:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093698.555088:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555095:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555106:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555111:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555117:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555122:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093698.555125:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555131:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555138:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202d46a00) 00010000:00010000:1.0:1784093698.555141:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093698.555144:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555150:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555191:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55d9 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555221:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9aed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55d9 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.555228:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:1.0:1784093698.555231:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093698.555234:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784093698.555290:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37701:x1870757013661056:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1194us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093698.555298:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 456 00000100:00100000:3.0:1784093698.556863:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093698.556911:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013661312 00000100:00100000:1.0:1784093698.556919:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013661312 00000100:00100000:1.0:1784093698.556970:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 457 00000100:00100000:1.0:1784093698.556982:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37701:x1870757013661312:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093698.556997:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093698.557009:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9af4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55e0 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.557308:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.557320:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.557331:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.557383:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.557397:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.557405:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093698.558230:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:1.0:1784093698.558518:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9b09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558530:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558539:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558574:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558582:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558589:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558596:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093698.558601:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558608:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558628:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:1.0:1784093698.558632:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093698.558637:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558643:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9afb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093698.558656:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ee00da45 reply state 000000004321b647 transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093698.558665:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093698.558694:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9af4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55e0 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558711:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55e0 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.558718:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202d46000) 00010000:00010000:1.0:1784093698.558720:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093698.558722:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093698.558784:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:37701:x1870757013661312:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1804us (1924us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1784093698.558794:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 457 00010000:00010000:3.0:1784093698.560619:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.560639:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.560646:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.560665:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093698.560670:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.560697:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.560714:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907202d46300) 00010000:00010000:3.0:1784093698.560717:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093698.560722:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.560729:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214c9b02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093698.561226:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093698.561289:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013661568 00000100:00100000:0.0:1784093698.561303:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013661568 00000100:00100000:0.0:1784093698.561364:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 458 00000100:00100000:0.0:1784093698.561375:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:37701:x1870757013661568:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:0.0:1784093698.561456:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093698.561479:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9b09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55e0 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.561497:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202d46000) 00010000:00010000:0.0:1784093698.561506:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093698.561543:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.561556:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.561566:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093698.561680:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000cad38829 reply state 00000000aab789f7 transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093698.561690:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093698.561772:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:37701:x1870757013661568:12345-192.168.204.57@tcp:36:touch.0 Request processed in 398us (551us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1784093698.561792:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 458 00000100:00100000:1.0:1784093698.562835:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093698.562890:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013661696 00000100:00100000:1.0:1784093698.562900:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013661696 00000100:00100000:1.0:1784093698.562981:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:1.0:1784093698.563009:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:37701:x1870757013661696:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093698.563037:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093698.563060:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55e7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.563128:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55e7 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.563145:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55e7 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.563183:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202e6b700) 00010000:00010000:1.0:1784093698.563187:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093698.563191:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784093698.563254:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:37701:x1870757013661696:12345-192.168.204.57@tcp:101:touch.0 Request processed in 252us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093698.563261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 459 00010000:00010000:3.0:1784093698.563899:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.563908:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.563914:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.563919:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093698.563924:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.563929:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.563944:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202e6b700) 00010000:00010000:3.0:1784093698.563946:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093698.563956:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.563962:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093698.564904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093698.565031:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013661824 00000100:00100000:1.0:1784093698.565042:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013661824 00000100:00080000:2.0:1784093698.565106:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093698.565111:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 216 00000100:00100000:1.0:1784093698.565122:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013661824:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:1.0:1784093698.565518:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013661824:12345-192.168.204.57@tcp:2:touch.0 Request processed in 399us (622us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784093698.565525:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 216 00000100:00100000:3.0:1784093698.566537:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093698.566714:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662080 00000100:00100000:0.0:1784093698.566721:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662080 00000100:00100000:0.0:1784093698.566757:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 52 00000100:00100000:0.0:1784093698.566766:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:37701:x1870757013662080:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:0.0:1784093698.567026:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:37701:x1870757013662080:12345-192.168.204.57@tcp:35:touch.0 Request processed in 259us (489us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1784093698.567033:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 52 00000100:00100000:3.0:1784093698.586903:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093698.586970:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662208 00000100:00100000:1.0:1784093698.586981:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662208 00000100:00100000:1.0:1784093698.587039:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 460 00000100:00100000:1.0:1784093698.587058:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:37705:x1870757013662208:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093698.587079:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093698.587095:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9b25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55ee expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587148:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587172:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587182:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587192:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587197:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587202:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587297:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587303:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587307:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093698.587340:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 0 00000004:00200000:1.0:1784093698.587343:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093698.587357:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587365:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587371:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587375:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587379:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587382:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093698.587385:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587391:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587399:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:1.0:1784093698.587401:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093698.587403:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587408:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587458:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587465:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587471:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587476:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093698.587479:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587485:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587493:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907202d46200) 00010000:00010000:1.0:1784093698.587495:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093698.587498:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587503:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587532:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214c9b25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55ee expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587547:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55ee expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.587566:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202e6b700) 00010000:00010000:1.0:1784093698.587569:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093698.587573:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093698.587630:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:37705:x1870757013662208:12345-192.168.204.57@tcp:101:rm.0 Request processed in 571us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093698.587638:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 460 00000100:00100000:3.0:1784093698.589546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093698.589761:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662336 00000100:00100000:1.0:1784093698.589831:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662336 00000100:00100000:1.0:1784093698.589957:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 217 00000100:00100000:1.0:1784093698.589968:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013662336:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093698.589991:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093698.590020:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55f5 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093698.590051:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x6a571c02, atime: 0x6a571c02, ctime: 0x6a571c02, blocks: 0x1 00010000:00010000:1.0:1784093698.590074:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=859s v=(0 0) 00010000:00010000:1.0:1784093698.590079:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093698.590090:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.590112:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.590127:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784093698.590203:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013662336:12345-192.168.204.57@tcp:101:rm.0 Request processed in 237us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093698.590227:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 217 00000100:00100000:3.0:1784093698.592554:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093698.592639:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662592 00000100:00100000:0.0:1784093698.592656:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662592 00000100:00100000:0.0:1784093698.592780:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 461 00000100:00100000:0.0:1784093698.592792:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:37705:x1870757013662592:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093698.592847:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093698.592873:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9b3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55ee expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.592897:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55e7 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.592908:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784093698.592919:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093698.592941:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.592954:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.592980:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.592996:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593004:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593011:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593114:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593123:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593130:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093698.593715:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:0.0:1784093698.593725:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 859671302376ns, next at 860671299951ns, rc = 0 00010000:00010000:0.0:1784093698.593778:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593787:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593796:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593812:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593819:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593827:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593847:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093698.593866:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593873:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593881:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.593887:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093698.593889:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093698.593897:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.593901:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593906:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.593916:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093698.593921:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093698.593926:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093698.593931:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593932:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.593953:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593970:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9b56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.593975:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff907202e6b300) 00010000:00010000:2.0:1784093698.593980:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093698.593984:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593988:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.593991:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9b5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.593998:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.594006:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.594011:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093698.594013:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093698.594015:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.594022:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093698.594023:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093698.594027:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093698.594035:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:0.0:1784093698.594039:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093698.594042:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093698.594047:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9b48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093698.594057:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006eb7f764 reply state 000000001f394b1d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093698.594065:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093698.594167:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:37705:x1870757013662592:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1366us (1612us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1784093698.594175:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 461 00010000:00010000:1.0:1784093698.595450:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.595462:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.595469:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.595475:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093698.595479:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.595486:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.595495:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907202e6ba00) 00010000:00010000:1.0:1784093698.595498:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093698.595501:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.595508:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9b4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093698.602483:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093698.602490:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093698.602495:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093698.602542:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.602571:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.602583:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093698.602609:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024209280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093698.602676:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093698.602751:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209100780 going to sleep for 11 seconds 00000100:00100000:3.0:1784093698.602813:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209280 00000100:00100000:3.0:1784093698.602821:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209280 00000100:00100000:3.0:1784093698.602867:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1784093698.602878:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024209280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093698.602889:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093698.602902:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9b64 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.602923:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.602932:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093698.602941:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093698.603012:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024209280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093698.603025:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1784093698.603135:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024209280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093698.603151:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.603170:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093698.603188:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093698.603193:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093698.603210:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093699.321704:0:63429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcae73f6e0 20000000:00000080:3.0:1784093699.321725:0:63429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b7d400 uarg=0000000000000000 00010000:00010000:3.0:1784093699.321907:0:63429:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093699.321936:0:63429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:3.0:1784093699.321940:0:63429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093699.321950:0:63429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9aed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55d9 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.321972:0:63429:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093699.321987:0:63429:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093699.322000:0:63429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.322012:0:63429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.322020:0:63429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.322051:0:63429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.322061:0:63429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 18 pid: 5770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093699.322071:0:63429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63429:1870757024209408:0@lo:104: 00000100:00100000:3.0:1784093699.322119:0:63429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093699.322179:0:63429:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484840 going to sleep for 11 seconds 00000100:00100000:1.0:1784093699.322214:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209408 00000100:00100000:1.0:1784093699.322230:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209408 00000100:00100000:1.0:1784093699.322307:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784093699.322319:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:63429:x1870757024209408:12345-0@lo:104: 00010000:00010000:1.0:1784093699.322351:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093699.322497:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093699.322499:0:63429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63429:1870757024209408:0@lo:104: 00000100:00100000:1.0:1784093699.322516:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:63429:x1870757024209408:12345-0@lo:104: Request processed in 196us (392us total) trans 0 rc 0/0 00010000:00010000:3.0:1784093699.322523:0:63429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322528:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1784093699.322534:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00010000:0.0:1784093699.322539:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322556:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093699.322560:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322569:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093699.322575:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093699.322579:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093699.322618:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322624:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093699.322651:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322658:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13200/0x9ce98053214c9b64 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9b6b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093699.322666:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1784093699.322675:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093699.322679:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093699.322680:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024209536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093699.322683:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093699.322716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093699.322758:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209536 00000100:00100000:0.0:1784093699.322767:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209536 00010000:00010000:0.0:1784093699.322793:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 19 pid: 5770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093699.322826:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784093699.322836:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024209536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093699.322848:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093699.322853:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 19 pid: 5770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322866:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 19 pid: 5770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322879:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68800/0x9ce98053214c9b6b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9b64 expref: 19 pid: 5770 timeout: 1010 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322890:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322898:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322911:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322919:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322927:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322944:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322950:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093699.322954:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322962:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322978:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093699.322988:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093699.322995:0:63429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.323002:0:63429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093699.323006:0:63429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9b72 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093699.323037:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024209536:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093699.323046:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784093699.323088:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024209536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093699.448941:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093699.448991:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093699.448997:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662720 00000100:00100000:2.0:1784093699.449005:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662720 00000100:00100000:3.0:1784093699.449023:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093699.449057:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:3.0:1784093699.449063:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093699.449071:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013662720:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093699.449093:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013663104 00000100:00100000:0.0:1784093699.449097:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013663104 00000100:00100000:3.0:1784093699.449108:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662976 00000100:00100000:1.0:1784093699.449112:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013662848 00000100:00100000:3.0:1784093699.449114:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662976 00000100:00100000:1.0:1784093699.449119:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013662848 00000100:00100000:0.0:1784093699.449156:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:2.0:1784093699.449157:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013662720:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093699.449165:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:0.0:1784093699.449166:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013663104:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093699.449177:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00100000:1.0:1784093699.449188:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:2355:x1870757013662848:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093699.449199:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013663104:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093699.449203:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093699.449207:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093699.449214:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 363 00000100:00100000:0.0:1784093699.449222:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:3.0:1784093699.449229:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013662976:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093699.449230:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:2355:x1870757013662848:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093699.449243:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00100000:3.0:1784093699.449272:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013662976:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093699.449282:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 363 00010000:00010000:3.0:1784093699.561921:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093699.574838:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:3.0:1784093700.073829:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024209664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093700.073937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093700.073981:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024209792:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.074004:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024210176:0@lo:400:kworker.0 00000100:00100000:1.0:1784093700.074096:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024210048:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.074163:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093700.074188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093700.074222:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209664 00000100:00100000:3.0:1784093700.074231:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209664 00000100:00100000:2.0:1784093700.074257:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024210304:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.074292:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784093700.074303:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093700.074309:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024209664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093700.074348:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093700.074359:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209792 00000100:00100000:2.0:1784093700.074367:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209792 00000100:00100000:2.0:1784093700.074699:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1784093700.074701:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024209664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.074713:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024209792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.074716:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784093700.074789:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024209792:12345-0@lo:400:kworker.0 Request processed in 79us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.074799:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1784093700.074803:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024209664:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093700.074845:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093700.074880:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210176 00000100:00100000:2.0:1784093700.074880:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024209792:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.074888:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210176 00000100:00080000:2.0:1784093700.074916:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093700.074941:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1784093700.074951:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024209920:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.074952:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.075024:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024210176:12345-0@lo:400:kworker.0 Request processed in 68us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.075026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093700.075039:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1784093700.075064:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024210432:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.075086:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024210176:0@lo:400:kworker.0 00000100:00100000:2.0:1784093700.075098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093700.075161:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210432 00000100:00100000:3.0:1784093700.075168:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210432 00000100:00100000:2.0:1784093700.075176:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210304 00000100:00100000:2.0:1784093700.075182:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210304 00000100:00100000:3.0:1784093700.075215:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784093700.075225:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1784093700.075227:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024210432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093700.075242:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024210304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.075301:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024210432:12345-0@lo:400:kworker.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.075308:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024210304:12345-0@lo:400:kworker.0 Request processed in 72us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.075329:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1784093700.075335:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784093700.075346:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024209920 00000100:00100000:2.0:1784093700.075352:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024209920 00000100:00100000:2.0:1784093700.075387:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1784093700.075396:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024209920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093700.075408:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093700.075462:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024209920:12345-0@lo:400:kworker.0 Request processed in 67us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.075470:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1784093700.075494:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024209920:0@lo:400:kworker.0 00000100:00100000:2.0:1784093700.075521:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024210304:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.075531:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024210432:0@lo:400:kworker.0 00000100:00100000:1.0:1784093700.075723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093700.075825:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210048 00000100:00100000:3.0:1784093700.075831:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210048 00000100:00080000:2.0:1784093700.075886:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093700.075921:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1784093700.075934:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024210048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.075989:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024210048:12345-0@lo:400:kworker.0 Request processed in 59us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093700.076000:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1784093700.076027:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024210048:0@lo:400:kworker.0 00000100:00100000:3.0:1784093700.507493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093700.507663:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013663232 00000100:00100000:1.0:1784093700.507674:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013663232 00000100:00100000:1.0:1784093700.507953:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 462 00000100:00100000:1.0:1784093700.507965:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:37793:x1870757013663232:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093700.507987:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093700.508012:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf55fc expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093700.508074:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093700.508094:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093700.508109:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093700.508185:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:1.0:1784093700.508189:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093700.508217:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093700.508242:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9b79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55fc expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093700.508265:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55fc expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093700.508273:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:1.0:1784093700.508276:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093700.508289:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784093700.508361:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:37793:x1870757013663232:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 398us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093700.508369:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 462 00000100:00100000:3.0:1784093700.510667:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093700.510803:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013663488 00000100:00100000:0.0:1784093700.510811:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013663488 00000100:00100000:0.0:1784093700.510861:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:0.0:1784093700.510871:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:37793:x1870757013663488:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093700.510916:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093700.510937:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55fc expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.510952:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9aed) 00010000:00010000:0.0:1784093700.510955:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46400) 00010000:00010000:0.0:1784093700.510964:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093700.510986:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.510997:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.511006:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093700.523061:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093700.523068:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093700.523073:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093700.523117:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.523140:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.523152:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.523176:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024210560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093700.523245:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093700.523300:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093700.523490:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210560 00000100:00100000:2.0:1784093700.523497:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210560 00000100:00100000:2.0:1784093700.523536:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1784093700.523544:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024210560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093700.523555:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093700.523569:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9b8e expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.523588:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.523596:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.523602:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784093700.523633:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024210560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.523639:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1784093700.523861:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024210560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093700.523872:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.523879:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093700.523894:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093700.523898:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.523903:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093700.535499:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000004:00080000:1.0:1784093700.535514:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 37 committed 00000004:00010000:2.0:1784093700.535521:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ff280396 reply state 000000001de08896 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093700.535543:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093700.535641:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024210688:0@lo:6:osp-syn-0-0.0 00000004:00200000:2.0:1784093700.535659:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000100:00100000:3.0:1784093700.535705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784093700.535727:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784093700.535740:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37793:x1870757013663488:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 24870us (25173us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1784093700.535748:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:3.0:1784093700.535757:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210688 00000100:00100000:3.0:1784093700.535764:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210688 00000100:00100000:3.0:1784093700.535805:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1784093700.535814:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024210688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784093700.535838:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:15 count 1 00010000:00010000:3.0:1784093700.535861:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535861:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535883:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.535891:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 5 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535894:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.535908:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093700.535910:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093700.535915:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093700.535917:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.535922:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535928:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535947:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202e6b000) 00010000:00010000:3.0:1784093700.535951:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 5 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535952:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093700.535958:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.535968:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214c9b87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.535970:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 5 pid: 6572 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.535990:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024210816:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093700.536048:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219ec8000 going to sleep for 11 seconds 00000100:00100000:3.0:1784093700.540300:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024210816:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784093700.540327:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093700.540440:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093700.540482:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013663616 00000100:00100000:3.0:1784093700.540490:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013663616 00010000:00010000:3.0:1784093700.540539:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 6 pid: 6572 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784093700.540562:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093700.540575:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 225 00000100:00100000:3.0:1784093700.540586:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013663616:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093700.540600:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093700.540606:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 6 pid: 6572 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540620:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 6 pid: 6572 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540642:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214c9b41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf55f5 expref: 6 pid: 6572 timeout: 961 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540655:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093700.540659:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093700.540664:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540685:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540788:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093700.540820:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.540832:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.540840:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013663616:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 254us (417us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093700.540845:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.540853:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 225 00010000:00010000:0.0:1784093700.540860:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.540941:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093700.540966:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093700.540974:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540984:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093700.540990:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.540999:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.541013:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.541020:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214c9b9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.541040:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093700.541048:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093700.541050:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093700.542147:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024210688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6331us (6439us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1784093700.542158:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000004:00080000:3.0:1784093700.542175:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230dc7b80/2, rc 0, transno 4294967326 00000100:00100000:3.0:1784093700.542183:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024210688:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784093700.586523:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093700.882694:0:63627:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5679dcb0 20000000:00000080:3.0:1784093700.882708:0:63627:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b7dc00 uarg=0000000000000000 00010000:00010000:3.0:1784093700.883154:0:63627:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093700.883164:0:63627:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093700.883173:0:63627:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093700.883188:0:63627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.883204:0:63627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.883214:0:63627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.883251:0:63627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.883266:0:63627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 18 pid: 5770 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.883281:0:63627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63627:1870757024210944:0@lo:104: 00000100:00100000:3.0:1784093700.883340:0:63627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093700.883389:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024210944 00000100:00100000:3.0:1784093700.883395:0:63627:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093700.883398:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024210944 00000100:00100000:2.0:1784093700.883462:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784093700.883475:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:63627:x1870757024210944:12345-0@lo:104: 00010000:00010000:2.0:1784093700.883488:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883549:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093700.883555:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:63627:x1870757024210944:12345-0@lo:104: Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.883562:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00010000:0.0:1784093700.883573:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093700.883581:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.883587:0:63627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63627:1870757024210944:0@lo:104: 00010000:00010000:0.0:1784093700.883596:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093700.883602:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.883610:0:63627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.883612:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093700.883627:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093700.883643:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093700.883676:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.883683:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093700.883715:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093700.883724:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214c9b8e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9b95 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093700.883728:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024211072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093700.883752:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093700.883754:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093700.883758:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093700.883762:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093700.883809:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211072 00000100:00100000:2.0:1784093700.883815:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211072 00010000:00010000:2.0:1784093700.883846:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 19 pid: 5770 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093700.883874:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784093700.883881:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024211072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093700.883892:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093700.883897:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 19 pid: 5770 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883908:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 19 pid: 5770 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883919:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40400/0x9ce98053214c9b95 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9b8e expref: 19 pid: 5770 timeout: 1011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883943:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883950:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883962:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883968:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883975:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883981:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883986:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093700.883989:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.883995:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.884011:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093700.884020:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093700.884035:0:63627:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.884045:0:63627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093700.884051:0:63627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9ba3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093700.884066:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024211072:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093700.884080:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784093700.884099:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024211072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093701.609534:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093702.042938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093702.042975:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013663744 00000100:00100000:3.0:1784093702.042983:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013663744 00000100:00100000:3.0:1784093702.043039:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 464 00000100:00100000:3.0:1784093702.043048:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:37869:x1870757013663744:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093702.043069:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093702.043089:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5603 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043168:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043182:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784093702.043193:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784093702.043298:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043329:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043338:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043346:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043970:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9bbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043978:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.043984:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093702.044053:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:3.0:1784093702.044057:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093702.044156:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9bbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044170:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044177:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044185:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044202:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093702.044207:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044465:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044481:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093702.044485:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093702.044490:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044497:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044509:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044515:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044520:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044524:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093702.044525:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044529:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044545:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fcee00) 00010000:00010000:3.0:1784093702.044548:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093702.044551:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044557:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9bb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044588:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5603 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044604:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9bbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5603 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.044611:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093702.044613:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093702.044615:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784093702.044674:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013663744:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1627us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093702.044681:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 464 00000100:00100000:2.0:1784093702.046416:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093702.046689:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664000 00000100:00100000:1.0:1784093702.046698:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664000 00000100:00100000:1.0:1784093702.046747:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 465 00000100:00100000:1.0:1784093702.046766:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013664000:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093702.046786:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093702.046802:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9bc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf560a expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047023:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047038:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047050:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047066:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047074:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047082:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093702.047239:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00010000:00010000:1.0:1784093702.047258:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047265:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047272:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047287:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093702.047291:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047298:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047310:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093702.047314:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093702.047318:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047325:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9bcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047336:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047342:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047349:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047354:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093702.047358:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047364:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047380:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907202d46800) 00010000:00010000:1.0:1784093702.047383:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093702.047386:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047392:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9bd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047446:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9bc6 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf560a expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047458:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093702.047460:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093702.047465:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9bc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf560a expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093702.047474:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784093702.047527:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013664000:12345-192.168.204.57@tcp:101:touch.0 Request processed in 763us (1113us total) trans 0 rc 301/301 00000100:00100000:1.0:1784093702.047534:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 465 00000100:00100000:3.0:1784093702.049474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093702.049520:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664128 00000100:00100000:3.0:1784093702.049528:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664128 00000100:00100000:3.0:1784093702.049595:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 466 00000100:00100000:3.0:1784093702.049605:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013664128:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093702.049621:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093702.049636:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5611 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049694:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049706:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049717:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049730:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049738:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049745:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049930:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049938:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049945:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049951:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093702.049955:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049972:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049983:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093702.049987:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093702.049991:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.049998:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9be2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050011:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050018:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050024:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050030:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093702.050034:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050041:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050048:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907204fcea00) 00010000:00010000:3.0:1784093702.050051:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093702.050054:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050069:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050111:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9bdb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5611 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050123:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093702.050131:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093702.050138:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5611 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.050149:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784093702.050197:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013664128:12345-192.168.204.57@tcp:101:touch.0 Request processed in 593us (730us total) trans 0 rc 301/301 00000100:00100000:3.0:1784093702.050204:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 466 00000100:00100000:3.0:1784093702.051929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093702.051984:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664256 00000100:00100000:2.0:1784093702.051993:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664256 00000100:00100000:2.0:1784093702.052051:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 467 00000100:00100000:2.0:1784093702.052063:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013664256:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093702.052079:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093702.052114:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9bf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5618 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052165:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052179:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052189:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052203:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052211:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052217:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052349:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052361:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052367:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052372:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093702.052376:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052384:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052394:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:2.0:1784093702.052397:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093702.052401:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052408:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052442:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052450:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052457:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052463:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093702.052472:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052480:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052488:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff90721a781200) 00010000:00010000:2.0:1784093702.052491:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093702.052494:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052499:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214c9bfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052527:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9bf0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5618 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052536:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:2.0:1784093702.052538:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093702.052541:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9bf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5618 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.052549:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784093702.052591:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:37869:x1870757013664256:12345-192.168.204.57@tcp:101:touch.0 Request processed in 533us (670us total) trans 0 rc 301/301 00000100:00100000:2.0:1784093702.052596:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 467 00000100:00100000:1.0:1784093702.121569:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024211200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093702.121645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093702.121689:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211200 00000100:00100000:3.0:1784093702.121698:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211200 00000100:00100000:3.0:1784093702.121769:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00080000:0.0:1784093702.121777:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093702.121782:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024211200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093702.121821:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093702.121875:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024211200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093702.121883:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1784093702.121909:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024211200:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1784093702.377532:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093702.377542:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093702.377549:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093702.377605:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.377624:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.377638:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093702.377670:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024211328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093702.377759:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093702.377830:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784093702.377837:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211328 00000100:00100000:3.0:1784093702.377852:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211328 00000100:00100000:3.0:1784093702.377937:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1784093702.378021:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024211328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093702.378038:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093702.378059:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9c05 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.378097:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.378109:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.378118:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093702.378214:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024211328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093702.378223:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1784093702.378232:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024211328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093702.378253:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.378261:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093702.378281:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093702.378285:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.378291:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.633577:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093702.721383:0:63870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb21642c0 20000000:00000080:0.0:1784093702.721401:0:63870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072373d6400 uarg=0000000000000000 00010000:00010000:0.0:1784093702.721647:0:63870:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093702.721680:0:63870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce300) 00010000:00010000:0.0:1784093702.721684:0:63870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093702.721695:0:63870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9bbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5603 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.721716:0:63870:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093702.721731:0:63870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093702.721744:0:63870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.721757:0:63870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.721765:0:63870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.721802:0:63870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.721826:0:63870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 18 pid: 5771 timeout: 1013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093702.721843:0:63870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63870:1870757024211456:0@lo:104: 00000100:00100000:0.0:1784093702.721901:0:63870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093702.721943:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211456 00000100:00100000:2.0:1784093702.721952:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211456 00000100:00100000:0.0:1784093702.721955:0:63870:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af600 going to sleep for 11 seconds 00000100:00100000:2.0:1784093702.722003:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784093702.722012:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:63870:x1870757024211456:12345-0@lo:104: 00010000:00010000:2.0:1784093702.722031:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093702.722104:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093702.722110:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:63870:x1870757024211456:12345-0@lo:104: Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093702.722118:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784093702.722127:0:63870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63870:1870757024211456:0@lo:104: 00010000:00010000:3.0:1784093702.722134:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093702.722142:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.722149:0:63870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722152:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093702.722159:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722170:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093702.722177:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093702.722183:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093702.722221:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722228:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093702.722255:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722267:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41400/0x9ce98053214c9c05 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c0c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093702.722280:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024211584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093702.722284:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093702.722287:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093702.722289:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093702.722312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093702.722349:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211584 00000100:00100000:3.0:1784093702.722355:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211584 00010000:00010000:3.0:1784093702.722376:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 19 pid: 5771 timeout: 1013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093702.722416:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784093702.722622:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024211584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093702.722635:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093702.722641:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 19 pid: 5771 timeout: 1013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722653:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 19 pid: 5771 timeout: 1013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722667:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c0c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9c05 expref: 19 pid: 5771 timeout: 1013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722680:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722694:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722708:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722720:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722727:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722733:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722739:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093702.722743:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722751:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722770:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093702.722780:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093702.722826:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024211584:12345-0@lo:103:ldlm_bl.0 Request processed in 403us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093702.722833:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00010000:0.0:1784093702.722854:0:63870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.722862:0:63870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093702.722867:0:63870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214c9c13 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093702.722868:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024211584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093703.657643:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093703.851987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093703.852088:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664384 00000100:00100000:1.0:1784093703.852097:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664384 00000100:00100000:1.0:1784093703.852153:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 468 00000100:00100000:1.0:1784093703.852163:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:37955:x1870757013664384:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093703.852183:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093703.852205:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf561f expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.852276:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.852295:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.852308:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093703.852516:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:1.0:1784093703.852521:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093703.852613:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.852638:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214c9c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf561f expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.852659:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf561f expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.852668:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46800) 00010000:00010000:1.0:1784093703.852670:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093703.852673:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784093703.852733:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:37955:x1870757013664384:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 571us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093703.852748:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 468 00000100:00100000:3.0:1784093703.854155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093703.854240:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664640 00000100:00100000:0.0:1784093703.854248:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664640 00000100:00100000:0.0:1784093703.854297:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 469 00000100:00100000:0.0:1784093703.854306:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:37955:x1870757013664640:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093703.854343:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093703.854369:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214c9c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf561f expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093703.854382:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9bbf) 00010000:00010000:0.0:1784093703.854386:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46800) 00010000:00010000:0.0:1784093703.854395:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093703.854418:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093703.854447:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093703.854457:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093703.855050:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000dce65de3 reply state 00000000dc2c8133 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093703.855074:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093703.855152:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000100:00100000:0.0:1784093703.855228:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:37955:x1870757013664640:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 922us (1077us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1784093703.855235:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 469 00010000:00010000:1.0:1784093703.856466:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.856479:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.856487:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.856493:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093703.856498:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.856506:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.856519:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784093703.856522:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093703.856527:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093703.856534:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9c28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093704.169473:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093704.169480:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093704.169483:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093704.169521:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.169530:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.169538:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093704.169557:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024211712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093704.169613:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093704.169656:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211712 00000100:00100000:2.0:1784093704.169664:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784093704.169665:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211712 00000100:00100000:3.0:1784093704.169723:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1784093704.169735:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024211712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093704.169748:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093704.169773:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9c2f expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.169793:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.169800:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.169807:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093704.169851:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024211712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093704.169856:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1784093704.169893:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024211712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093704.169911:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.169921:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093704.169949:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093704.169954:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.169962:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093704.190599:0:64065:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7d5625d0 20000000:00000080:2.0:1784093704.190616:0:64065:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e312400 uarg=0000000000000000 00010000:00010000:2.0:1784093704.190832:0:64065:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093704.190848:0:64065:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093704.190860:0:64065:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093704.190877:0:64065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.190893:0:64065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.190902:0:64065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.190937:0:64065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093704.190953:0:64065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 18 pid: 5770 timeout: 1015 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093704.190967:0:64065:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64065:1870757024211840:0@lo:104: 00000100:00100000:2.0:1784093704.191035:0:64065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093704.191095:0:64065:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8b540 going to sleep for 11 seconds 00000100:00100000:0.0:1784093704.191103:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784093704.191116:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211840 00000100:00100000:0.0:1784093704.191123:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211840 00000100:00100000:0.0:1784093704.191170:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784093704.191180:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723745b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:64065:x1870757024211840:12345-0@lo:104: 00010000:00010000:0.0:1784093704.191193:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093704.191277:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093704.191283:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723745b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:64065:x1870757024211840:12345-0@lo:104: Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093704.191291:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:3.0:1784093704.191365:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093704.191373:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191382:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093704.191386:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191399:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093704.191418:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093704.191445:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1784093704.191456:0:64065:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64065:1870757024211840:0@lo:104: 00010000:00010000:3.0:1784093704.191479:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093704.191481:0:64065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191500:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093704.191528:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191536:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41000/0x9ce98053214c9c2f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c36 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191553:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093704.191553:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024211968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093704.191557:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093704.191560:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093704.191591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093704.191650:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024211968 00000100:00100000:3.0:1784093704.191655:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024211968 00010000:00010000:3.0:1784093704.191677:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 19 pid: 5770 timeout: 1015 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093704.191701:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784093704.191711:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024211968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093704.191722:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093704.191727:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 19 pid: 5770 timeout: 1015 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191738:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 19 pid: 5770 timeout: 1015 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191757:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214c9c36 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9c2f expref: 19 pid: 5770 timeout: 1015 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191769:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191777:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191788:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191795:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191801:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191807:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191813:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093704.191817:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191823:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191844:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093704.191862:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093704.191902:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024211968:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093704.191909:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784093704.192013:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024211968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093704.192616:0:64065:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093704.192633:0:64065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093704.192641:0:64065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214c9c3d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093704.575755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093704.575800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093704.575834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093704.575845:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665152 00000100:00100000:1.0:1784093704.575855:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665152 00000100:00100000:3.0:1784093704.575862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093704.575864:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664896 00000100:00100000:0.0:1784093704.575870:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664896 00000100:00100000:3.0:1784093704.575885:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013664768 00000100:00100000:3.0:1784093704.575888:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013664768 00000100:00100000:3.0:1784093704.575921:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:1.0:1784093704.575922:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665024 00000100:00100000:1.0:1784093704.575927:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665024 00000100:00100000:3.0:1784093704.575932:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013664768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093704.575938:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 556 00000100:00100000:0.0:1784093704.575950:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013664896:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093704.576002:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013664768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093704.576003:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013664896:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093704.576010:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:0.0:1784093704.576010:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 556 00000100:00080000:0.0:1784093704.576032:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093704.576037:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093704.576070:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 366 00000100:00100000:3.0:1784093704.576083:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013665152:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093704.576115:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013665152:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00080000:0.0:1784093704.576117:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093704.576122:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 367 00000100:00100000:3.0:1784093704.576133:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 366 00000100:00100000:1.0:1784093704.576138:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013665024:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093704.576175:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013665024:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093704.576184:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 367 00010000:00010000:0.0:1784093704.681607:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784093704.700944:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000100:00100000:1.0:1784093705.193556:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024212352:0@lo:400:kworker.0 00000100:00100000:0.0:1784093705.193623:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024212608:0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.193626:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024212224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093705.193637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093705.193688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093705.193690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093705.193713:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024212864:0@lo:400:kworker.0 00000100:00100000:0.0:1784093705.193723:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093705.193734:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024212480:0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.193741:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024212096:0@lo:400:kworker.0 00000100:00100000:1.0:1784093705.193749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093705.193799:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212352 00000100:00100000:3.0:1784093705.193804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093705.193806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093705.193809:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212352 00000100:00100000:3.0:1784093705.193861:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024212736:0@lo:400:kworker.0 00000100:00100000:0.0:1784093705.193862:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212608 00000100:00100000:1.0:1784093705.193863:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212480 00000100:00100000:0.0:1784093705.193868:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212608 00000100:00100000:1.0:1784093705.193870:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212480 00000100:00100000:3.0:1784093705.193900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093705.193912:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212864 00000100:00100000:0.0:1784093705.193917:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212864 00000100:00100000:0.0:1784093705.193945:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784093705.193955:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024212608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093705.194050:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024212608:12345-0@lo:400:kworker.0 Request processed in 96us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093705.194059:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784093705.194064:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212736 00000100:00100000:1.0:1784093705.194069:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212736 00000100:00100000:0.0:1784093705.194084:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1784093705.194088:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212224 00000100:00100000:3.0:1784093705.194094:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212224 00000100:00100000:1.0:1784093705.194098:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1784093705.194099:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024212864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093705.194109:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024212352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.194132:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1784093705.194141:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024212224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093705.194155:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024212864:12345-0@lo:400:kworker.0 Request processed in 62us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093705.194168:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1784093705.194169:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024212352:12345-0@lo:400:kworker.0 Request processed in 57us (533us total) trans 0 rc 0/0 00002000:00000024:3.0:1784093705.194174:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093705.194180:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00080000:0.0:1784093705.194190:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093705.194197:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093705.194200:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093705.194204:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1784093705.194215:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024212480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.194227:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024212224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093705.194235:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1784093705.194253:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024212480:12345-0@lo:400:kworker.0 Request processed in 41us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.194261:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1784093705.194271:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1784093705.194284:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024212736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093705.194317:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024212480:0@lo:400:kworker.0 00000100:00100000:1.0:1784093705.194319:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024212864:0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.194328:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024212736:12345-0@lo:400:kworker.0 Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093705.194337:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1784093705.194339:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000100:00100000:1.0:1784093705.194345:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024212352:0@lo:400:kworker.0 00000004:00080000:0.0:1784093705.194346:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230dc7b80, transno 4294967326 00000100:00100000:0.0:1784093705.194360:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024212608:0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.194365:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212096 00000100:00100000:3.0:1784093705.194371:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212096 00000100:00100000:3.0:1784093705.194404:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1784093705.194412:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024212096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.194481:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024212096:12345-0@lo:400:kworker.0 Request processed in 71us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093705.194489:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1784093705.194546:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024212224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093705.194557:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024212096:0@lo:400:kworker.0 00000100:00100000:3.0:1784093705.194568:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024212736:0@lo:400:kworker.0 00000100:00100000:0.0:1784093705.402548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.402630:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665280 00000100:00100000:1.0:1784093705.402641:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665280 00000100:00100000:1.0:1784093705.402688:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 470 00000100:00100000:1.0:1784093705.402698:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013665280:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093705.402778:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013665280:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.402784:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 470 00000100:00100000:2.0:1784093705.407154:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.407201:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665408 00000100:00100000:1.0:1784093705.407212:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665408 00000100:00100000:1.0:1784093705.407264:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 219 00000100:00100000:1.0:1784093705.407275:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013665408:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093705.407728:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013665408:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 454us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.407735:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 219 00000100:00100000:3.0:1784093705.409060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.409113:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665536 00000100:00100000:1.0:1784093705.409120:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665536 00000100:00100000:1.0:1784093705.409157:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 220 00000100:00100000:1.0:1784093705.409165:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013665536:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093705.409455:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013665536:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 289us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.409464:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 220 00000100:00100000:0.0:1784093705.410535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.411012:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665664 00000100:00100000:1.0:1784093705.411034:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665664 00000100:00100000:1.0:1784093705.411088:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:1.0:1784093705.411095:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013665664:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093705.411371:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013665664:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 275us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.411379:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:2.0:1784093705.413101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093705.413369:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665792 00000100:00100000:3.0:1784093705.413377:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665792 00000100:00100000:3.0:1784093705.413437:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 472 00000100:00100000:3.0:1784093705.413447:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013665792:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093705.413537:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013665792:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 92us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093705.413545:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 472 00000100:00100000:3.0:1784093705.414689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093705.414740:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013665920 00000100:00100000:0.0:1784093705.414747:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013665920 00000100:00100000:0.0:1784093705.414784:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 221 00000100:00100000:0.0:1784093705.414792:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013665920:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093705.415094:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013665920:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 302us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093705.415101:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 221 00000100:00100000:0.0:1784093705.417380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.417873:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666048 00000100:00100000:1.0:1784093705.417882:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666048 00000100:00100000:1.0:1784093705.417933:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 222 00000100:00100000:1.0:1784093705.417944:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013666048:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093705.418253:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:38039:x1870757013666048:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 310us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.418262:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 222 00000100:00100000:2.0:1784093705.419688:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.419788:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666176 00000100:00100000:1.0:1784093705.419796:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666176 00000100:00100000:1.0:1784093705.419885:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 473 00000100:00100000:1.0:1784093705.419895:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013666176:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093705.420242:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38039:x1870757013666176:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 348us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.420256:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 473 00000100:00100000:2.0:1784093705.445919:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.445996:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666304 00000100:00100000:1.0:1784093705.446005:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666304 00000100:00100000:1.0:1784093705.446074:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 474 00000100:00100000:1.0:1784093705.446084:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38043:x1870757013666304:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093705.446106:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093705.446130:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5626 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446194:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446208:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446221:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446234:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446242:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446249:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446762:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9c59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446781:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446789:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093705.446858:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:1.0:1784093705.446862:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093705.446930:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446942:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446949:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446955:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446962:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093705.446966:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446974:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.446985:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202d46200) 00010000:00010000:1.0:1784093705.446989:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093705.446993:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447008:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447019:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447025:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447043:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447048:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093705.447051:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447057:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447065:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907202d46300) 00010000:00010000:1.0:1784093705.447067:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093705.447070:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447075:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214c9c52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447104:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5626 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447118:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5626 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.447131:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46a00) 00010000:00010000:1.0:1784093705.447133:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093705.447135:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093705.447239:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:38043:x1870757013666304:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1157us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.447247:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 474 00000100:00100000:0.0:1784093705.449235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093705.449273:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666560 00000100:00100000:3.0:1784093705.449288:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666560 00000100:00100000:3.0:1784093705.449325:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 475 00000100:00100000:3.0:1784093705.449332:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:38043:x1870757013666560:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784093705.449345:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093705.449358:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf562d expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.449591:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.449601:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.449609:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.449617:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.449629:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.449633:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093705.450313:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00010000:00010000:3.0:1784093705.450549:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9c75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450560:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450568:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450600:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450607:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450613:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450619:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093705.450623:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450630:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450651:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46a00) 00010000:00010000:3.0:1784093705.450654:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093705.450657:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450678:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9c67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093705.450690:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000699fe57a reply state 0000000038ee8c02 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093705.450698:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784093705.450724:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf562d expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450738:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9c75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf562d expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093705.450745:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093705.450748:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093705.450750:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784093705.450814:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:38043:x1870757013666560:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1482us (1583us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1784093705.450821:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 475 00010000:00010000:0.0:1784093705.452340:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.452354:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.452361:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.452367:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093705.452371:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.452378:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.452388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907204fceb00) 00010000:00010000:0.0:1784093705.452390:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093705.452392:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.452396:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9c6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093705.454935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.455040:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666688 00000100:00100000:1.0:1784093705.455051:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666688 00000100:00100000:1.0:1784093705.455110:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 223 00000100:00100000:1.0:1784093705.455120:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:38043:x1870757013666688:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093705.455138:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093705.455157:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5634 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093705.455179:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784093705.455197:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=866s v=(0 0) 00010000:00010000:1.0:1784093705.455201:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093705.455208:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.455220:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.455229:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093705.455276:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38043:x1870757013666688:12345-192.168.204.57@tcp:101:dd.0 Request processed in 157us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.455297:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 223 00000100:00100000:2.0:1784093705.465704:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.466097:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666816 00000100:00100000:1.0:1784093705.466107:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666816 00002000:00100000:1.0:1784093705.466161:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xf:0x0] (0->1048575) req@ffff907230a50380 x1870757013666816/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:26/0 lens 488/0 e 0 to 0 dl 1784093716 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093705.466172:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230a50380 with x1870757013666816 ext(0->1048575) 00002000:00010000:1.0:1784093705.466178:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230a50380 00000100:00100000:1.0:1784093705.466326:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 10 00000100:00100000:1.0:1784093705.466337:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013666816:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784093705.477287:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013666816:12345-192.168.204.57@tcp:4:dd.0 Request processed in 10943us (11581us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1784093705.477299:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 10 00002000:00100000:1.0:1784093705.477309:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xf:0x0] (0->1048575) req@ffff907230a50380 x1870757013666816/t4294967325(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:26/0 lens 488/448 e 0 to 0 dl 1784093716 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093705.477317:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230a50380 with x1870757013666816 ext(0->1048575) 00002000:00010000:1.0:1784093705.477323:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230a50380 00000100:00100000:0.0:1784093705.479633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093705.480007:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013666944 00000100:00100000:1.0:1784093705.480017:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013666944 00000100:00100000:1.0:1784093705.480151:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 476 00000100:00100000:1.0:1784093705.480162:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:38043:x1870757013666944:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:3.0:1784093705.503516:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967484 is committed 00000001:00080000:3.0:1784093705.503538:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967485 is committed 00000100:00100000:1.0:1784093705.503645:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:38043:x1870757013666944:12345-192.168.204.57@tcp:44:dd.0 Request processed in 23476us (24011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093705.503661:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 476 00000100:00100000:2.0:1784093705.507395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093705.507584:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667072 00000100:00100000:0.0:1784093705.507600:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667072 00000100:00100000:0.0:1784093705.507677:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 224 00000100:00100000:0.0:1784093705.507689:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013667072:12345-192.168.204.57@tcp:16:dd.0 00000001:00080000:1.0:1784093705.528596:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:0.0:1784093705.528795:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013667072:12345-192.168.204.57@tcp:16:dd.0 Request processed in 21102us (21404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093705.528807:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 224 00000100:00100000:2.0:1784093705.531442:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093705.531480:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667328 00000100:00100000:0.0:1784093705.531489:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667328 00000100:00100000:0.0:1784093705.531646:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 53 00000100:00100000:0.0:1784093705.531656:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:38043:x1870757013667328:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:0.0:1784093705.532050:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:38043:x1870757013667328:12345-192.168.204.57@tcp:35:dd.0 Request processed in 395us (638us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1784093705.532058:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 53 00010000:00010000:3.0:1784093705.705849:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784093705.770205:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093705.770212:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093705.770216:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093705.770257:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.770268:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093705.770279:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093705.770304:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024212992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093705.770369:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093705.770636:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720780 going to sleep for 11 seconds 00000100:00100000:2.0:1784093705.770694:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024212992 00000100:00100000:2.0:1784093705.770701:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024212992 00000100:00100000:2.0:1784093705.770748:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1784093705.770757:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024212992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093705.770771:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093705.770784:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9c8a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093705.770806:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093705.770817:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093705.770827:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784093705.770884:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024212992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093705.770891:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1784093705.771072:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024212992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093705.771088:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.771097:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093705.771118:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093705.771123:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093705.771131:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784093706.068898:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967486 is committed 00000004:00080000:1.0:1784093706.587318:0:64311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 867664892751ns, next at 860671299951ns, rc = 0 00000004:00080000:1.0:1784093706.587409:0:64311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 867664985925ns, next at 836182987724ns, rc = 0 00000004:00080000:0.0:1784093706.588808:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 38 committed 00000004:00080000:0.0:1784093706.589642:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 36 committed 00010000:00010000:0.0:1784093706.729603:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093707.153407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093707.153529:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667456 00000100:00100000:2.0:1784093707.153538:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667456 00000100:00100000:2.0:1784093707.153664:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 477 00000100:00100000:2.0:1784093707.153677:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013667456:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093707.153780:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013667456:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 107us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093707.153789:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 477 00000100:00080000:3.0:1784093707.153947:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093707.155566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093707.155636:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667584 00000100:00100000:3.0:1784093707.155644:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667584 00000100:00100000:3.0:1784093707.155705:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 225 00000100:00100000:3.0:1784093707.155719:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:38235:x1870757013667584:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784093707.155719:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093707.156373:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:38235:x1870757013667584:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 657us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093707.156381:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 225 00000100:00100000:0.0:1784093707.158240:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093707.159028:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667712 00000100:00100000:1.0:1784093707.159039:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667712 00000100:00100000:1.0:1784093707.159109:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 226 00000100:00100000:1.0:1784093707.159118:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:38235:x1870757013667712:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784093707.159378:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093707.159480:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:38235:x1870757013667712:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 362us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093707.159488:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 226 00000100:00100000:0.0:1784093707.160799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093707.160914:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667840 00000100:00100000:3.0:1784093707.160922:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667840 00000100:00100000:3.0:1784093707.160971:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 478 00000100:00100000:3.0:1784093707.160979:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013667840:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093707.161371:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013667840:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 393us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093707.161377:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 478 00000100:00100000:3.0:1784093707.164543:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093707.164596:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013667968 00000100:00100000:1.0:1784093707.164608:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013667968 00000100:00100000:1.0:1784093707.164661:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 479 00000100:00100000:1.0:1784093707.164671:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013667968:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093707.164773:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013667968:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093707.164781:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 479 00000100:00100000:0.0:1784093707.166242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093707.169119:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668096 00000100:00100000:2.0:1784093707.169133:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668096 00000100:00100000:2.0:1784093707.169291:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 227 00000100:00100000:2.0:1784093707.169301:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38235:x1870757013668096:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093707.169664:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38235:x1870757013668096:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 362us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093707.169673:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 227 00000100:00100000:0.0:1784093707.172936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093707.173040:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668224 00000100:00100000:1.0:1784093707.173051:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668224 00000100:00100000:1.0:1784093707.173101:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 228 00000100:00100000:1.0:1784093707.173111:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38235:x1870757013668224:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093707.173488:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38235:x1870757013668224:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 377us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093707.173508:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 228 00000100:00100000:0.0:1784093707.175056:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093707.175142:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668352 00000100:00100000:1.0:1784093707.175151:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668352 00000100:00100000:1.0:1784093707.175224:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 480 00000100:00100000:1.0:1784093707.175233:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013668352:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093707.175662:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:38235:x1870757013668352:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 429us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093707.175674:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 480 00000100:00100000:0.0:1784093707.210163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093707.210252:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668608 00000100:00100000:3.0:1784093707.210262:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668608 00000100:00100000:3.0:1784093707.210331:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 481 00000100:00100000:3.0:1784093707.210341:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:38239:x1870757013668608:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784093707.210396:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093707.210418:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9c75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf562d expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210498:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093707.210508:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093707.210552:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210566:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210576:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210591:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210598:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210605:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210941:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210947:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.210952:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093707.211841:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 64 off9152 00000004:00080000:3.0:1784093707.211852:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 868289429311ns, next at 869289427160ns, rc = 0 00010000:00010000:3.0:1784093707.211944:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.211954:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.211969:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.211977:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.211983:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.211989:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212024:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093707.212045:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212052:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212059:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212063:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093707.212064:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093707.212069:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212073:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212076:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212092:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093707.212095:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093707.212099:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093707.212109:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212110:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212125:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9ca6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212128:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212148:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212157:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212158:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784093707.212165:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784093707.212168:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212171:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 1/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212173:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093707.212178:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212186:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214c9cad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212187:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093707.212208:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46a00) 00010000:00010000:3.0:1784093707.212210:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093707.212213:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093707.212214:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.212217:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093707.212220:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093707.212225:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9c98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093707.212237:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000000fcfc72a reply state 000000008f09ce38 transno 4294967487 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093707.212256:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093707.212336:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:38239:x1870757013668608:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1991us (2177us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784093707.212343:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 481 00010000:00010000:1.0:1784093707.214150:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.214163:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.214170:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.214175:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093707.214179:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.214186:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.214198:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907204fce700) 00010000:00010000:1.0:1784093707.214201:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093707.214204:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093707.214230:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9c9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093707.241652:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024213120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093707.241723:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093707.242077:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024213120 00000100:00100000:3.0:1784093707.242084:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024213120 00000100:00080000:0.0:1784093707.242130:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093707.242144:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784093707.242154:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024213120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093707.242202:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093707.242251:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024213120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093707.242258:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784093707.242291:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024213120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093707.753549:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784093708.121664:0:64456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 869199238786ns, next at 860671299951ns, rc = 0 00000004:00080000:1.0:1784093708.121844:0:64456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 869199421246ns, next at 869289427160ns, rc = 0 00000004:00080000:1.0:1784093708.143612:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 38 committed 00000004:00080000:1.0:1784093708.143640:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 39 committed 00000001:00080000:1.0:1784093708.143658:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967487 is committed 00000004:00080000:1.0:1784093708.143663:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 37 committed 00000100:00100000:0.0:1784093708.144508:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093708.144529:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024213248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784093708.144600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093708.144664:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024213248 00000100:00100000:1.0:1784093708.144672:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024213248 00000100:00100000:1.0:1784093708.144736:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784093708.144745:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024213248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784093708.144774:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:15 count 1 00010000:00010000:1.0:1784093708.144797:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.144817:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.144826:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xf:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1784093708.144831:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093708.144835:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784093708.144850:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093708.144881:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.144895:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 5 pid: 53396 timeout: 969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093708.144907:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024213376:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784093708.144969:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720683da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784093708.146360:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024213376:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784093708.146389:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093708.147217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093708.147350:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668736 00000100:00100000:3.0:1784093708.147358:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668736 00010000:00010000:3.0:1784093708.147393:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 6 pid: 53396 timeout: 969 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093708.147456:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 229 00000100:00100000:1.0:1784093708.147465:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013668736:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093708.147475:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093708.147480:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 6 pid: 53396 timeout: 969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.147491:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 6 pid: 53396 timeout: 969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.147516:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c28e39/0x9ce98053214c9c83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5634 expref: 6 pid: 53396 timeout: 969 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.147549:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093708.147554:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093708.147559:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.147569:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093708.147594:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093708.147628:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093708.147640:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013668736:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 174us (424us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093708.147644:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093708.147651:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 229 00010000:00010000:2.0:1784093708.147665:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093708.147683:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093708.147711:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093708.147783:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093708.147795:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093708.147805:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093708.147809:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093708.147818:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093708.147834:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093708.147839:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b14ec9df/0x9ce98053214c9cb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093708.147852:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093708.147853:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093708.147854:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093708.148368:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024213248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3621us (3765us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1784093708.148380:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000004:00080000:0.0:1784093708.148411:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230d24a80/2, rc 0, transno 4294967326 00000100:00100000:0.0:1784093708.148448:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024213248:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1784093708.777684:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093709.688662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093709.688710:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093709.688744:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668864 00000100:00100000:3.0:1784093709.688759:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668864 00000100:00100000:0.0:1784093709.688768:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093709.688778:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013668992 00000100:00100000:1.0:1784093709.688788:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013668992 00000100:00100000:0.0:1784093709.688847:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093709.688854:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:3.0:1784093709.688867:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013668864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093709.688877:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:0.0:1784093709.688888:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669120 00000100:00100000:0.0:1784093709.688894:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669120 00000100:00100000:1.0:1784093709.688900:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013668992:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093709.688935:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669248 00000100:00100000:0.0:1784093709.688940:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669248 00000100:00100000:3.0:1784093709.688980:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013668864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093709.688989:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013668992:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093709.688992:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:3.0:1784093709.689000:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:1.0:1784093709.689009:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:0.0:1784093709.689014:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013669120:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:1.0:1784093709.689036:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093709.689042:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093709.689048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093709.689074:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013669120:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 64us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093709.689078:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 371 00000100:00100000:0.0:1784093709.689089:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:1.0:1784093709.689092:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013669248:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093709.689121:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013669248:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093709.689132:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 371 00010000:00010000:1.0:1784093709.803071:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093710.313651:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024213504:0@lo:400:kworker.0 00000100:00100000:0.0:1784093710.313662:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024213760:0@lo:400:kworker.0 00000100:00100000:2.0:1784093710.313684:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024213888:0@lo:400:kworker.0 00000100:00100000:0.0:1784093710.313744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093710.313747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093710.313749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093710.313790:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024213632:0@lo:400:kworker.0 00000100:00100000:3.0:1784093710.313823:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024214016:0@lo:400:kworker.0 00000100:00100000:2.0:1784093710.313827:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093710.313840:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024214272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093710.313862:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024213760 00000100:00100000:1.0:1784093710.313872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093710.313873:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024213760 00000100:00100000:2.0:1784093710.313886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093710.313890:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024213888 00000100:00100000:3.0:1784093710.313895:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024213888 00000100:00100000:1.0:1784093710.313965:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024214144:0@lo:400:kworker.0 00000100:00100000:0.0:1784093710.313967:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024213632 00000100:00100000:0.0:1784093710.313973:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024213632 00000100:00100000:3.0:1784093710.313974:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1784093710.313993:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024213888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093710.314004:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1784093710.314011:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024213760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093710.314053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093710.314060:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214272 00000100:00100000:2.0:1784093710.314067:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214272 00000100:00100000:0.0:1784093710.314090:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024213760:12345-0@lo:400:kworker.0 Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093710.314096:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024213888:12345-0@lo:400:kworker.0 Request processed in 103us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093710.314101:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784093710.314123:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1784093710.314128:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784093710.314128:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1784093710.314139:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024213504 00000100:00100000:0.0:1784093710.314140:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024213632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093710.314148:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214144 00000100:00100000:2.0:1784093710.314150:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024214272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093710.314152:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024213504 00000100:00100000:3.0:1784093710.314155:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214144 00000100:00100000:0.0:1784093710.314179:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024213632:12345-0@lo:400:kworker.0 Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093710.314184:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1784093710.314219:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784093710.314228:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024213760:0@lo:400:kworker.0 00000100:00100000:1.0:1784093710.314238:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1784093710.314239:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1870757024214144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093710.314260:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024213504:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093710.314278:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093710.314285:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093710.314289:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093710.314294:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1870757024214144:12345-0@lo:400:kworker.0 Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093710.314304:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784093710.314319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093710.314336:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024213504:12345-0@lo:400:kworker.0 Request processed in 78us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093710.314347:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214016 00000100:00100000:1.0:1784093710.314347:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1784093710.314358:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214016 00000100:00100000:0.0:1784093710.314365:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024213504:0@lo:400:kworker.0 00002000:00000024:2.0:1784093710.314456:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784093710.314465:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1784093710.314480:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024214016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093710.314490:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024213632:0@lo:400:kworker.0 00000100:00100000:2.0:1784093710.314517:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024214272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 373us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093710.314525:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024214144:0@lo:400:kworker.0 00000100:00100000:2.0:1784093710.314530:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1784093710.314561:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024214016:12345-0@lo:400:kworker.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093710.314569:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00080000:2.0:1784093710.314579:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093710.314597:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024214016:0@lo:400:kworker.0 00000100:00100000:1.0:1784093710.314907:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024214272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093710.314931:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024213888:0@lo:400:kworker.0 00010000:00010000:0.0:1784093710.825677:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093711.849635:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093712.361795:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024214400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093712.361908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093712.362802:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214400 00000100:00100000:2.0:1784093712.362835:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214400 00000100:00100000:2.0:1784093712.362921:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784093712.362936:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024214400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093712.362993:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093712.363071:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024214400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093712.363081:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1784093712.363112:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093712.363878:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024214400:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1784093712.380289:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00010000:00010000:0.0:1784093712.874613:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093713.898418:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093714.808489:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093714.808529:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093714.808558:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669376 00000100:00100000:0.0:1784093714.808569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093714.808570:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669376 00000100:00100000:1.0:1784093714.808592:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669504 00000100:00100000:1.0:1784093714.808599:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669504 00000100:00100000:2.0:1784093714.808626:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 622 00000100:00100000:0.0:1784093714.808635:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093714.808654:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013669376:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093714.808660:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 564 00000100:00100000:0.0:1784093714.808666:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669632 00000100:00100000:1.0:1784093714.808672:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013669504:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093714.808677:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669632 00000100:00100000:0.0:1784093714.808722:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669760 00000100:00100000:0.0:1784093714.808726:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669760 00000100:00100000:2.0:1784093714.808732:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013669376:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093714.808740:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013669504:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093714.808747:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 622 00000100:00100000:1.0:1784093714.808766:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 564 00000100:00100000:3.0:1784093714.808779:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 374 00000100:00100000:3.0:1784093714.808794:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013669632:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784093714.808794:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093714.808801:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093714.808834:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013669632:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093714.808844:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 374 00000100:00100000:0.0:1784093714.808995:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 375 00000100:00100000:0.0:1784093714.809002:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013669760:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093714.809046:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013669760:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093714.809054:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 375 00000100:00080000:2.0:1784093714.809486:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784093714.922289:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093715.433643:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093715.433653:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024214656:0@lo:400:kworker.0 00000100:00100000:3.0:1784093715.433722:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093715.433729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093715.433798:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214528 00000100:00100000:2.0:1784093715.433805:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214528 00000100:00100000:1.0:1784093715.433809:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214656 00000100:00100000:1.0:1784093715.433815:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214656 00000100:00100000:2.0:1784093715.433889:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784093715.433889:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1784093715.433897:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024214784:0@lo:400:kworker.0 00000100:00100000:2.0:1784093715.433907:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024214528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093715.433908:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024214656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093715.433935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784093715.433951:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093715.433967:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784093715.433976:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024214656:12345-0@lo:400:kworker.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093715.433977:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024214912:0@lo:400:kworker.0 00000100:00100000:1.0:1784093715.433991:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1784093715.433997:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024214528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093715.434007:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1784093715.434013:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784093715.434046:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093715.434055:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214784 00000100:00100000:0.0:1784093715.434059:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214784 00000100:00100000:1.0:1784093715.434062:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024215040:0@lo:400:kworker.0 00000100:00100000:2.0:1784093715.434087:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024214912 00000100:00100000:2.0:1784093715.434093:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024214912 00000100:00100000:1.0:1784093715.434099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093715.434101:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1784093715.434120:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024214784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093715.434136:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1784093715.434144:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000100:00100000:2.0:1784093715.434146:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024214912:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1784093715.434152:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230d24a80, transno 4294967326 00000100:00100000:0.0:1784093715.434169:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024214784:12345-0@lo:400:kworker.0 Request processed in 52us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093715.434175:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093715.434180:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1784093715.434191:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024214912:12345-0@lo:400:kworker.0 Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093715.434198:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093715.434200:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1784093715.434210:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024215168:0@lo:400:kworker.0 00000100:00100000:0.0:1784093715.434221:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024214912:0@lo:400:kworker.0 00000100:00080000:2.0:1784093715.434226:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093715.434237:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024214784:0@lo:400:kworker.0 00000100:00100000:1.0:1784093715.434244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093715.434252:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215040 00000100:00100000:2.0:1784093715.434257:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215040 00000100:00100000:1.0:1784093715.434284:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215168 00000100:00100000:1.0:1784093715.434289:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215168 00000100:00100000:2.0:1784093715.434305:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1784093715.434315:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024215040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093715.434327:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1784093715.434336:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024215168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093715.434358:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024215040:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093715.434365:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:2.0:1784093715.434391:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093715.434392:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024215168:12345-0@lo:400:kworker.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093715.434396:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093715.434401:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1784093715.434465:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024215168:0@lo:400:kworker.0 00000100:00100000:1.0:1784093715.434476:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024215040:0@lo:400:kworker.0 00000100:00100000:3.0:1784093715.434594:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024214656:0@lo:400:kworker.0 00010000:00010000:2.0:1784093715.946584:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093716.969726:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093717.481699:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024215296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093717.481771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093717.481879:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215296 00000100:00100000:1.0:1784093717.481887:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215296 00000100:00100000:1.0:1784093717.481981:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784093717.481994:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024215296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093717.482032:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093717.482085:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024215296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093717.482093:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784093717.482153:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024215296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784093717.482175:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784093717.993700:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093719.017642:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093719.929053:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093719.929134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093719.929167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093719.929211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093719.929240:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670272 00000100:00100000:3.0:1784093719.929252:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670272 00000100:00100000:2.0:1784093719.929287:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670016 00000100:00100000:2.0:1784093719.929294:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670016 00000100:00100000:1.0:1784093719.929295:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013669888 00000100:00100000:1.0:1784093719.929302:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013669888 00000100:00100000:3.0:1784093719.929324:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670144 00000100:00100000:3.0:1784093719.929328:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670144 00000100:00100000:2.0:1784093719.929359:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 568 00000100:00100000:1.0:1784093719.929359:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:3.0:1784093719.929366:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 377 00000100:00100000:1.0:1784093719.929381:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013669888:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093719.929382:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013670016:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093719.929383:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013670272:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093719.929726:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 378 00000100:00100000:0.0:1784093719.929735:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013670144:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093719.929996:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013669888:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 623us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093719.930002:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:2.0:1784093719.930008:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013670016:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 632us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093719.930018:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 568 00000100:00100000:3.0:1784093719.930083:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013670272:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 707us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093719.930089:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 377 00000100:00080000:3.0:1784093719.930118:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093719.930121:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093719.930123:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093719.930146:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013670144:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 411us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093719.930154:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 378 00010000:00010000:2.0:1784093720.041637:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093720.553695:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024215424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093720.553738:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024215552:0@lo:400:kworker.0 00000100:00100000:1.0:1784093720.553765:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024215680:0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.553784:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024215808:0@lo:400:kworker.0 00000100:00100000:1.0:1784093720.554496:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093720.554539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093720.554562:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024216192:0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.554582:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024216064:0@lo:400:kworker.0 00000100:00100000:1.0:1784093720.554608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093720.554615:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093720.554656:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093720.554656:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215680 00000100:00100000:1.0:1784093720.554670:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215680 00000100:00100000:0.0:1784093720.554670:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215552 00000100:00100000:0.0:1784093720.554677:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215552 00000100:00100000:2.0:1784093720.554684:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093720.554692:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024215936:0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.554725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093720.554728:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216064 00000100:00100000:0.0:1784093720.554729:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1784093720.554733:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216064 00000100:00100000:0.0:1784093720.554759:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024215552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.554773:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215808 00000100:00100000:2.0:1784093720.554779:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215808 00000100:00100000:1.0:1784093720.554784:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1784093720.554796:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024215680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.554813:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1784093720.554819:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024215552:12345-0@lo:400:kworker.0 Request processed in 72us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093720.554827:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024216064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.554833:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1784093720.554847:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024215680:12345-0@lo:400:kworker.0 Request processed in 53us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093720.554855:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1784093720.554875:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024216064:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093720.554878:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1784093720.554886:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1784093720.554891:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024215808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.554893:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024216064:0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.554906:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216192 00000100:00100000:2.0:1784093720.554909:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216192 00000100:00100000:0.0:1784093720.554924:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024215552:0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.554938:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215936 00000100:00100000:2.0:1784093720.554941:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215936 00000100:00100000:1.0:1784093720.554944:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024215808:12345-0@lo:400:kworker.0 Request processed in 55us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093720.554953:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1784093720.554977:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1784093720.554984:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024216192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.554990:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1784093720.555001:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024215936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093720.555011:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024216192:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093720.555016:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1784093720.555039:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024215808:0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.555047:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024215936:12345-0@lo:400:kworker.0 Request processed in 47us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093720.555054:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024215936:0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.555058:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:2.0:1784093720.555099:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093720.555102:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093720.555104:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093720.555159:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024216192:0@lo:400:kworker.0 00000100:00100000:0.0:1784093720.555170:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024215680:0@lo:400:kworker.0 00000100:00100000:3.0:1784093720.555342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093720.555469:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024215424 00000100:00100000:2.0:1784093720.555481:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024215424 00000100:00100000:2.0:1784093720.555552:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784093720.555562:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024215424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784093720.555609:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093720.555677:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024215424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093720.555684:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784093720.555804:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024215424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784093721.065558:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093722.092045:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093722.601657:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024216320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093722.601752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093722.601881:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216320 00000100:00100000:0.0:1784093722.601889:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216320 00000100:00100000:0.0:1784093722.601962:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784093722.601975:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024216320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093722.602020:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784093722.602092:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093722.602119:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024216320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093722.602128:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1784093722.602255:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024216320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093723.113780:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093724.137624:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093725.048782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093725.048835:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093725.048872:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093725.048913:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093725.048944:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670656 00000100:00100000:1.0:1784093725.048953:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670656 00000100:00100000:0.0:1784093725.049003:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670784 00000100:00100000:1.0:1784093725.049019:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 381 00000100:00100000:0.0:1784093725.049022:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670784 00000100:00100000:1.0:1784093725.049032:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013670656:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093725.049057:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 382 00000100:00100000:0.0:1784093725.049064:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013670784:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093725.049100:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013670784:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093725.049105:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 382 00000100:00100000:3.0:1784093725.049181:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670400 00000100:00100000:3.0:1784093725.049185:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670400 00000100:00100000:3.0:1784093725.049214:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 626 00000100:00100000:3.0:1784093725.049221:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013670400:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093725.049363:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013670656:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 333us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093725.049370:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 381 00000100:00080000:1.0:1784093725.049387:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093725.049391:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093725.049648:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670528 00000100:00100000:2.0:1784093725.049652:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670528 00000100:00080000:1.0:1784093725.049689:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093725.049698:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:2.0:1784093725.049705:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013670528:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093725.049740:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013670528:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093725.049746:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:3.0:1784093725.049915:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013670400:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 693us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093725.049923:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 626 00010000:00010000:0.0:1784093725.161613:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093725.673679:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024216704:0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.673711:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024216448:0@lo:400:kworker.0 00000100:00100000:2.0:1784093725.673746:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093725.673746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093725.673845:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024216832:0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.673845:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024216960:0@lo:400:kworker.0 00000100:00100000:2.0:1784093725.673847:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784093725.673854:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024216576:0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.673875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093725.673897:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093725.673902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093725.673916:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024217088:0@lo:400:kworker.0 00000100:00100000:2.0:1784093725.673943:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093725.673955:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093725.673967:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024217216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093725.673972:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216704 00000100:00100000:2.0:1784093725.673974:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216832 00000100:00100000:2.0:1784093725.673979:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216832 00000100:00100000:0.0:1784093725.673979:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216704 00000100:00100000:1.0:1784093725.673997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093725.674031:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217088 00000100:00100000:0.0:1784093725.674031:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216960 00000100:00100000:2.0:1784093725.674035:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217088 00000100:00100000:0.0:1784093725.674035:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216960 00000100:00080000:1.0:1784093725.674042:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093725.674048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093725.674051:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093725.674057:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216576 00000100:00100000:0.0:1784093725.674061:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216576 00000100:00100000:2.0:1784093725.674066:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1784093725.674071:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1784093725.674084:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024216704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093725.674090:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024216832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093725.674092:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024216448 00000100:00100000:3.0:1784093725.674096:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024216448 00000100:00100000:3.0:1784093725.674126:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1784093725.674133:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024216448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093725.674146:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024216704:12345-0@lo:400:kworker.0 Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093725.674154:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024216832:12345-0@lo:400:kworker.0 Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093725.674162:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1784093725.674167:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024216448:12345-0@lo:400:kworker.0 Request processed in 35us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093725.674178:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1784093725.674184:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024217088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.674190:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1784093725.674196:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024216960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093725.674200:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1784093725.674212:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024217088:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093725.674220:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784093725.674229:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:0.0:1784093725.674230:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024216960:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093725.674240:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1784093725.674244:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024216576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.674259:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217216 00000100:00100000:0.0:1784093725.674264:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217216 00000100:00100000:2.0:1784093725.674269:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024216832:0@lo:400:kworker.0 00000100:00100000:1.0:1784093725.674289:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024216576:12345-0@lo:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093725.674299:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1784093725.674300:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1784093725.674301:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024216576:0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.674306:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024217216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093725.674318:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024217088:0@lo:400:kworker.0 00000100:00100000:2.0:1784093725.674327:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024216704:0@lo:400:kworker.0 00002000:00000024:0.0:1784093725.674332:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093725.674378:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024217216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093725.674387:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024216448:0@lo:400:kworker.0 00000100:00100000:0.0:1784093725.674387:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1784093725.674393:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024217216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093725.674409:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024216960:0@lo:400:kworker.0 00000100:00100000:3.0:1784093725.674461:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1784093726.003817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093726.003888:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013670912 00000100:00100000:2.0:1784093726.003899:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013670912 00000100:00100000:2.0:1784093726.003971:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 482 00000100:00100000:2.0:1784093726.003982:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013670912:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093726.004083:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013670912:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 103us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093726.004091:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 482 00000100:00100000:0.0:1784093726.005396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093726.005528:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671040 00000100:00100000:1.0:1784093726.005536:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671040 00000100:00100000:1.0:1784093726.005577:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 230 00000100:00100000:1.0:1784093726.005586:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671040:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093726.005963:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671040:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 378us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093726.005978:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 230 00000100:00100000:1.0:1784093726.007593:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093726.007703:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671168 00000100:00100000:2.0:1784093726.007711:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671168 00000100:00100000:2.0:1784093726.007799:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 231 00000100:00100000:2.0:1784093726.007809:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671168:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093726.008084:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671168:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 276us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093726.008092:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 231 00000100:00100000:0.0:1784093726.009998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093726.010060:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671296 00000100:00100000:1.0:1784093726.010067:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671296 00000100:00100000:1.0:1784093726.010119:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 483 00000100:00100000:1.0:1784093726.010128:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013671296:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093726.010531:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013671296:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 405us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093726.010538:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 483 00000100:00100000:3.0:1784093726.012262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093726.012632:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671424 00000100:00100000:1.0:1784093726.012654:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671424 00000100:00100000:1.0:1784093726.012704:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 484 00000100:00100000:1.0:1784093726.012714:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013671424:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093726.012783:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013671424:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 70us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093726.012790:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 484 00000100:00100000:3.0:1784093726.013760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093726.013859:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671552 00000100:00100000:2.0:1784093726.013865:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671552 00000100:00100000:2.0:1784093726.013897:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 232 00000100:00100000:2.0:1784093726.013904:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671552:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093726.014200:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671552:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 292us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093726.014207:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 232 00000100:00100000:0.0:1784093726.014976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093726.015042:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671680 00000100:00100000:2.0:1784093726.015049:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671680 00000100:00100000:2.0:1784093726.015087:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 233 00000100:00100000:2.0:1784093726.015096:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671680:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093726.015656:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:38577:x1870757013671680:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 561us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093726.015669:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 233 00000100:00100000:3.0:1784093726.016519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093726.016569:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671808 00000100:00100000:2.0:1784093726.016576:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671808 00000100:00100000:2.0:1784093726.016674:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 485 00000100:00100000:2.0:1784093726.016683:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013671808:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093726.017007:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:38577:x1870757013671808:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 324us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093726.017025:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 485 00010000:00010000:1.0:1784093726.186502:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093726.989050:0:64859:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfa405970 20000000:00000080:0.0:1784093726.989066:0:64859:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e147c00 uarg=0000000000000000 00010000:00010000:0.0:1784093726.989702:0:64859:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093726.989736:0:64859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202d46a00) 00010000:00010000:0.0:1784093726.989740:0:64859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093726.989751:0:64859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9c59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5626 expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.989774:0:64859:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093726.989788:0:64859:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093726.989801:0:64859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.989813:0:64859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.989821:0:64859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.989855:0:64859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.989869:0:64859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 18 pid: 5772 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093726.989890:0:64859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64859:1870757024217344:0@lo:104: 00000100:00100000:0.0:1784093726.989948:0:64859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093726.990055:0:64859:0:(client.c:2702:ptlrpc_set_wait()) set ffff907226004e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093726.990097:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217344 00000100:00100000:2.0:1784093726.990104:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217344 00000100:00100000:2.0:1784093726.990189:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784093726.990200:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:64859:x1870757024217344:12345-0@lo:104: 00010000:00010000:2.0:1784093726.990213:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093726.990277:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093726.990284:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:64859:x1870757024217344:12345-0@lo:104: Request processed in 87us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093726.990291:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00010000:3.0:1784093726.990331:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093726.990337:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990345:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093726.990350:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990358:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093726.990365:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093726.990371:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093726.990399:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990408:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093726.990517:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990524:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214c9c8a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9c91 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093726.990554:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784093726.990564:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024217472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093726.990594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093726.990632:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217472 00000100:00100000:3.0:1784093726.990637:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217472 00010000:00010000:3.0:1784093726.990655:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 19 pid: 5772 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093726.990675:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784093726.990681:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024217472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093726.990690:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093726.990694:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 19 pid: 5772 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990704:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 19 pid: 5772 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990717:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990725:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990737:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990749:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990757:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990764:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990769:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093726.990773:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990780:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990788:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093726.990798:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093726.990823:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024217472:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093726.990830:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784093726.990865:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024217472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093726.990882:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093726.990884:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093726.990886:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093726.990968:0:64859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40800/0x9ce98053214c9c91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9c8a expref: 18 pid: 5772 timeout: 1038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093726.990979:0:64859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64859:1870757024217344:0@lo:104: 00010000:00010000:0.0:1784093726.990994:0:64859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.991002:0:64859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.991008:0:64859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093726.991014:0:64859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214c9cbb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093727.210572:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093727.721560:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024217600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093727.721645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093727.721692:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217600 00000100:00100000:1.0:1784093727.721701:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217600 00000100:00080000:0.0:1784093727.721734:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093727.721752:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784093727.721763:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024217600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093727.721796:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093727.721853:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024217600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093727.721860:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1784093727.722071:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024217600:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784093728.233486:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093728.233492:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093728.233503:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093728.233549:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.233559:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.233571:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093728.233611:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024217728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093728.233679:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093728.233729:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907237b79540 going to sleep for 11 seconds 00000100:00100000:0.0:1784093728.233749:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217728 00000100:00100000:0.0:1784093728.233757:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217728 00000100:00100000:0.0:1784093728.233811:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1784093728.233823:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024217728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093728.233846:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093728.233860:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9cc2 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.233884:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.233896:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.233905:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784093728.233956:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024217728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093728.233964:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1784093728.233978:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024217728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093728.233994:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.234004:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093728.234023:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093728.234028:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.234035:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.234496:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093728.293515:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093728.293649:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013671936 00000100:00100000:2.0:1784093728.293659:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013671936 00000100:00080000:1.0:1784093728.293721:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093728.293744:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 486 00000100:00100000:2.0:1784093728.293759:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:38664:x1870757013671936:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093728.293789:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093728.293956:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf563b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.294020:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.294032:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.294042:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093728.294262:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:2.0:1784093728.294266:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093728.294545:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.294572:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf563b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.294605:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf563b expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.294616:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784093728.294619:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093728.294622:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784093728.294677:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:38664:x1870757013671936:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 923us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093728.294688:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 486 00000100:00100000:1.0:1784093728.297129:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093728.297607:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013672192 00000100:00100000:0.0:1784093728.297617:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013672192 00000100:00100000:0.0:1784093728.297811:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 487 00000100:00100000:0.0:1784093728.297823:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38664:x1870757013672192:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093728.297869:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093728.297896:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214c9cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf563b expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.297913:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9c59) 00010000:00010000:0.0:1784093728.297917:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093728.297932:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093728.297955:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.297975:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.297989:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093728.314033:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e1ca3fb8 reply state 00000000a4b13762 transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093728.314052:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784093728.314079:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967488 is committed 00000004:00200000:0.0:1784093728.314182:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00010000:00080000:0.0:1784093728.314277:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093728.314303:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:38664:x1870757013672192:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 16479us (17175us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1784093728.314313:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 487 00010000:00010000:2.0:1784093728.314386:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.314396:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.314404:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.314411:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093728.314416:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.314522:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.314538:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202e6be00) 00010000:00010000:2.0:1784093728.314541:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093728.314546:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.314553:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9cde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093728.686915:0:65058:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc17cb6ba0 20000000:00000080:3.0:1784093728.686939:0:65058:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e10a000 uarg=0000000000000000 00010000:00010000:3.0:1784093728.687475:0:65058:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093728.687491:0:65058:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093728.687505:0:65058:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093728.687525:0:65058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.687540:0:65058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.687548:0:65058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.687584:0:65058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.687658:0:65058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 18 pid: 5770 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093728.687672:0:65058:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65058:1870757024217856:0@lo:104: 00000100:00100000:3.0:1784093728.687739:0:65058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093728.687787:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217856 00000100:00100000:2.0:1784093728.687794:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217856 00000100:00100000:2.0:1784093728.687839:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784093728.687844:0:65058:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072374f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1784093728.687849:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:65058:x1870757024217856:12345-0@lo:104: 00010000:00010000:2.0:1784093728.687859:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093728.687933:0:65058:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65058:1870757024217856:0@lo:104: 00010000:00010000:3.0:1784093728.687951:0:65058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093728.688031:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1784093728.688034:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784093728.688040:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:65058:x1870757024217856:12345-0@lo:104: Request processed in 193us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093728.688043:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093728.688053:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00010000:00010000:0.0:1784093728.688056:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093728.688062:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.688071:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093728.688078:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093728.688084:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093728.688158:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.688165:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093728.688199:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.688208:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214c9cc2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9cc9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093728.688222:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1784093728.688224:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093728.688228:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093728.688230:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093728.688238:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024217984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093728.688278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093728.688327:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024217984 00000100:00100000:3.0:1784093728.688333:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024217984 00010000:00010000:3.0:1784093728.688352:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 19 pid: 5770 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093728.688391:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784093728.688400:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024217984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093728.688410:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093728.688416:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 19 pid: 5770 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688500:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 19 pid: 5770 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688514:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214c9cc9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9cc2 expref: 19 pid: 5770 timeout: 1039 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688529:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688537:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688551:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688559:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688567:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688574:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688602:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093728.688607:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.688614:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.688746:0:65058:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093728.688754:0:65058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.689313:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.689323:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214c9ce5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093728.689336:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093728.689580:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024217984:12345-0@lo:103:ldlm_bl.0 Request processed in 1182us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093728.689597:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784093728.689667:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024217984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093729.257955:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093729.933509:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093729.934336:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013672320 00000100:00100000:2.0:1784093729.934348:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013672320 00000100:00100000:1.0:1784093729.934454:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 488 00000100:00100000:1.0:1784093729.934466:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:38740:x1870757013672320:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784093729.934493:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093729.934514:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9cec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5642 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.934587:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.934600:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.934613:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.934627:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.934633:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.934640:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935080:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935095:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935103:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093729.935320:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:1.0:1784093729.935324:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093729.935410:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935443:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935451:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935459:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935465:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093729.935470:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935477:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935488:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784093729.935492:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093729.935496:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935513:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935529:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935537:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935542:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935548:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093729.935551:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935557:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935576:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907219c12300) 00010000:00010000:1.0:1784093729.935580:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093729.935583:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935590:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214c9cfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935623:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5642 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935639:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5642 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.935654:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093729.935656:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093729.935658:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093729.935724:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38740:x1870757013672320:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1260us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093729.935731:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 488 00000100:00100000:3.0:1784093729.937638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093729.937962:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013672576 00000100:00100000:2.0:1784093729.937970:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013672576 00000100:00100000:2.0:1784093729.938084:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 489 00000100:00100000:2.0:1784093729.938095:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:38740:x1870757013672576:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093729.938119:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093729.938137:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9d08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5649 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.938450:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.938465:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.938475:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.938489:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.938496:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.938503:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093729.939366:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:2.0:1784093729.940346:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c9d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940361:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c9d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940370:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c9d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940414:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940439:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940447:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940454:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093729.940458:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940466:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940478:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907219c12400) 00010000:00010000:2.0:1784093729.940482:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093729.940486:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940493:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093729.940504:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000050b58bc6 reply state 0000000023182ea0 transno 4294967489 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093729.940513:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093729.940544:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9d08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5649 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940582:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c9d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5649 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.940589:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093729.940591:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093729.940594:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093729.940670:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:38740:x1870757013672576:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 2577us (3037us total) trans 4294967489 rc 0/0 00000100:00100000:2.0:1784093729.940678:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 489 00010000:00010000:3.0:1784093729.945844:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093729.945860:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093729.945868:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093729.945875:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093729.945880:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093729.945893:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093729.945910:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff90721a781e00) 00010000:00010000:3.0:1784093729.945913:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093729.945917:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093729.945924:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214c9d16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093729.947442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093729.947475:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013672832 00000100:00100000:0.0:1784093729.947486:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013672832 00000100:00100000:0.0:1784093729.947540:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 490 00000100:00100000:0.0:1784093729.947551:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:38740:x1870757013672832:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:0.0:1784093729.947614:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093729.947636:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214c9d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5649 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.947651:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff90721a781f00) 00010000:00010000:0.0:1784093729.947660:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093729.947704:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.947723:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.947734:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093729.947860:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000097e6cc24 reply state 000000000e6865f6 transno 4294967490 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093729.947870:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093729.947955:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:38740:x1870757013672832:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 404us (515us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1784093729.947963:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 490 00000100:00100000:3.0:1784093729.950438:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:1.0:1784093729.950548:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950557:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950563:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950578:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093729.950583:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950595:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950610:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff907202e6b100) 00010000:00010000:1.0:1784093729.950613:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093729.950617:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950624:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214c9d2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093729.950672:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013672960 00000100:00100000:1.0:1784093729.950680:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013672960 00000100:00100000:1.0:1784093729.950731:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:1.0:1784093729.950741:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:38740:x1870757013672960:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784093729.950763:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093729.950780:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5650 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950830:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5650 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950845:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5650 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.950865:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784093729.950868:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093729.950870:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093729.950921:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:38740:x1870757013672960:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 182us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093729.950927:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:1.0:1784093729.952735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093729.952776:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013673088 00000100:00100000:0.0:1784093729.952785:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013673088 00000100:00080000:1.0:1784093729.952826:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093729.952841:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 234 00000100:00100000:0.0:1784093729.952851:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013673088:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:0.0:1784093729.953185:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013673088:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 334us (452us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1784093729.953194:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 234 00000100:00100000:3.0:1784093729.955508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093729.955738:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013673344 00000100:00100000:1.0:1784093729.955746:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013673344 00000100:00100000:1.0:1784093729.955796:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 54 00000100:00100000:1.0:1784093729.955805:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:38740:x1870757013673344:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:1.0:1784093729.956145:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:38740:x1870757013673344:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 340us (643us total) trans 4294967491 rc 0/0 00000100:00100000:1.0:1784093729.956152:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 54 00000100:00100000:1.0:1784093729.980769:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093729.981109:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013673472 00000100:00100000:2.0:1784093729.981124:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013673472 00000100:00100000:2.0:1784093729.981204:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 492 00000100:00100000:2.0:1784093729.981229:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:38744:x1870757013673472:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784093729.981266:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093729.981294:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5657 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981381:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981397:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981410:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981457:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981483:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981491:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981634:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981644:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981653:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093729.981694:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 0 00000004:00200000:2.0:1784093729.981699:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093729.981728:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981741:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981751:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981757:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981765:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981781:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093729.981786:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981795:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981809:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907219c12400) 00010000:00010000:2.0:1784093729.981812:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093729.981818:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981824:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981840:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981847:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981853:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981858:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093729.981861:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981866:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981882:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff90721a781000) 00010000:00010000:2.0:1784093729.981884:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093729.981886:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981892:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981939:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214c9d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5657 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981953:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5657 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.981961:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff907219c12100) 00010000:00010000:2.0:1784093729.981963:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093729.981966:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784093729.982045:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:38744:x1870757013673472:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 820us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093729.982054:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 492 00000100:00100000:2.0:1784093729.985603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093729.985891:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013673600 00000100:00100000:1.0:1784093729.985905:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013673600 00000100:00100000:1.0:1784093729.985970:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 235 00000100:00100000:1.0:1784093729.985980:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013673600:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784093729.985998:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093729.986018:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf565e expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093729.986045:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x6a571c22, atime: 0x6a571c22, ctime: 0x6a571c22, blocks: 0x1 00010000:00010000:1.0:1784093729.986064:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=891s v=(0 0) 00010000:00010000:1.0:1784093729.986068:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093729.986077:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.986095:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093729.986109:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093729.986174:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013673600:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 195us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093729.986181:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 235 00000100:00100000:3.0:1784093729.989636:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093729.989701:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013673856 00000100:00100000:0.0:1784093729.989711:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013673856 00000100:00100000:0.0:1784093729.989767:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 493 00000100:00100000:0.0:1784093729.989776:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:38744:x1870757013673856:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784093729.989824:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093729.989851:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5657 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.989998:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214c9d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5650 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990030:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff907219c12100) 00010000:00010000:0.0:1784093729.990041:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093729.990064:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990077:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990086:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990101:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990107:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990114:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990221:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990230:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.990237:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093729.991162:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:0.0:1784093729.991174:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 891068751258ns, next at 892068748398ns, rc = 0 00010000:00010000:0.0:1784093729.991232:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991243:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991251:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991258:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991264:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991270:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991402:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093729.991440:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991446:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991452:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991457:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093729.991466:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991474:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991483:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093729.991486:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093729.991490:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991497:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214c9d6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991512:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991518:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991524:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991530:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093729.991533:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991539:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991546:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907219c12400) 00010000:00010000:0.0:1784093729.991549:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093729.991558:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093729.991579:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214c9d5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093729.991590:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000297bd837 reply state 000000005a34a48a transno 4294967492 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093729.991599:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093729.991686:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:38744:x1870757013673856:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1909us (2053us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1784093729.991694:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 493 00010000:00010000:2.0:1784093729.991942:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093729.991948:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.991954:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093729.991957:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.991970:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.991977:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff907202e6b300) 00010000:00010000:2.0:1784093729.991979:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093729.991981:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.991984:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214c9d71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.991994:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093729.991995:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093729.991996:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093729.994576:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.994592:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.994600:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.994607:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093729.994611:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.994620:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.994634:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907202e6ba00) 00010000:00010000:2.0:1784093729.994650:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093729.994656:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093729.994662:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214c9d63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093730.025538:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093730.025544:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093730.025548:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093730.025612:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.025624:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.025637:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093730.025663:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024218112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093730.025732:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093730.025830:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a76e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784093730.026154:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218112 00000100:00100000:2.0:1784093730.026162:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218112 00000100:00100000:2.0:1784093730.026214:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1784093730.026225:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024218112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093730.026238:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093730.026252:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9d78 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093730.026275:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093730.026286:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093730.026296:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093730.026346:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024218112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093730.026353:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1784093730.026458:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024218112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093730.026474:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.026484:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093730.026505:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093730.026510:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.026519:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093730.168882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093730.168919:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093730.168949:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013674112 00000100:00100000:2.0:1784093730.168959:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013674112 00000100:00100000:2.0:1784093730.169037:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 385 00000100:00100000:2.0:1784093730.169049:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013674112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093730.169139:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013674112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093730.169142:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013673984 00000100:00100000:1.0:1784093730.169147:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013673984 00000100:00100000:2.0:1784093730.169161:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 385 00000100:00100000:1.0:1784093730.169184:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00100000:1.0:1784093730.169193:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013673984:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093730.169234:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013673984:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093730.169241:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00080000:3.0:1784093730.169414:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784093730.282535:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093730.786582:0:65301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdaba6b510 20000000:00000080:1.0:1784093730.786599:0:65301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e147c00 uarg=0000000000000000 00010000:00010000:1.0:1784093730.786818:0:65301:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093730.786853:0:65301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093730.786857:0:65301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093730.786867:0:65301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214c9d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5642 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.786892:0:65301:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093730.786907:0:65301:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093730.786921:0:65301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.786934:0:65301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.786941:0:65301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.786977:0:65301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.787002:0:65301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 18 pid: 5771 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093730.787017:0:65301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65301:1870757024218240:0@lo:104: 00000100:00100000:1.0:1784093730.787076:0:65301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093730.787132:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218240 00000100:00100000:2.0:1784093730.787139:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218240 00000100:00100000:1.0:1784093730.787179:0:65301:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784093730.787182:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784093730.787191:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:65301:x1870757024218240:12345-0@lo:104: 00010000:00010000:2.0:1784093730.787202:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093730.787265:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093730.787271:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:65301:x1870757024218240:12345-0@lo:104: Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093730.787278:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1784093730.787286:0:65301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65301:1870757024218240:0@lo:104: 00010000:00010000:1.0:1784093730.787305:0:65301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093730.787611:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093730.787619:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093730.787627:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093730.787631:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093730.787639:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093730.787646:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093730.787651:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093730.787680:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093730.787696:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093730.787727:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093730.787733:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214c9d78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9d7f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093730.787755:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093730.787757:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093730.787758:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093730.787803:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024218368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093730.787833:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093730.787915:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218368 00000100:00100000:3.0:1784093730.787920:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218368 00010000:00010000:3.0:1784093730.787941:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 19 pid: 5771 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093730.788006:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1784093730.788014:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024218368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093730.788025:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093730.788030:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 19 pid: 5771 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788052:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 19 pid: 5771 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788066:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214c9d7f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9d78 expref: 19 pid: 5771 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788078:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788089:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788102:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788109:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788117:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788123:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788129:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093730.788133:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788141:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788167:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093730.788177:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093730.788185:0:65301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.788193:0:65301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093730.788201:0:65301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214c9d86 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093730.788220:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024218368:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093730.788228:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784093730.788278:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024218368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093730.794399:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024218752:0@lo:400:kworker.0 00000100:00100000:3.0:1784093730.794492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093730.794531:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093730.794538:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024218880:0@lo:400:kworker.0 00000100:00100000:3.0:1784093730.794577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093730.794612:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218752 00000100:00100000:3.0:1784093730.794619:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218752 00000100:00100000:3.0:1784093730.794671:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1784093730.794680:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024218752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093730.794735:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024218752:12345-0@lo:400:kworker.0 Request processed in 56us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093730.794743:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00080000:3.0:1784093730.794765:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093730.794795:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024218752:0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.794871:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024218496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093730.794905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093730.794935:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024219008:0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.794956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093730.794976:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784093730.794981:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024218624:0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795004:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093730.795018:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024219136:0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093730.795078:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219008 00000100:00100000:2.0:1784093730.795083:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219008 00000100:00100000:2.0:1784093730.795112:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218624 00000100:00100000:2.0:1784093730.795115:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218624 00000100:00100000:2.0:1784093730.795132:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1784093730.795138:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024219008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795172:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024219008:12345-0@lo:400:kworker.0 Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093730.795178:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1784093730.795192:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1784093730.795198:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024218624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795229:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024218624:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093730.795235:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1784093730.795254:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218880 00000100:00100000:2.0:1784093730.795258:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218880 00000100:00100000:2.0:1784093730.795283:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219136 00000100:00100000:2.0:1784093730.795286:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219136 00000100:00100000:2.0:1784093730.795306:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784093730.795312:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024218880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795342:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024218880:12345-0@lo:400:kworker.0 Request processed in 31us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093730.795348:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784093730.795358:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784093730.795364:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024219136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795390:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024219136:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093730.795403:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784093730.795464:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024218624:0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795474:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024219136:0@lo:400:kworker.0 00000100:00100000:2.0:1784093730.795483:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024219008:0@lo:400:kworker.0 00000100:00100000:3.0:1784093730.795670:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024218496 00000100:00100000:3.0:1784093730.795675:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024218496 00000100:00100000:3.0:1784093730.795748:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1784093730.795757:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024218496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093730.795785:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093730.795839:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024218496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093730.795846:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784093730.795897:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024218496:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093730.795932:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093730.795935:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093730.795938:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093730.795963:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024218880:0@lo:400:kworker.0 00010000:00010000:3.0:1784093731.305606:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093732.017640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093732.017705:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013674240 00000100:00100000:2.0:1784093732.017715:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013674240 00000100:00100000:2.0:1784093732.017789:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 494 00000100:00100000:2.0:1784093732.017800:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:38831:x1870757013674240:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093732.017823:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093732.017846:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5665 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.017907:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.017920:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.017931:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784093732.017986:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1784093732.017999:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:2.0:1784093732.018004:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093732.018029:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.018054:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5665 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.018077:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5665 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.018086:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784093732.018089:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093732.018093:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093732.018146:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:38831:x1870757013674240:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 348us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093732.018154:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 494 00000100:00100000:2.0:1784093732.020181:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093732.020235:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013674496 00000100:00100000:0.0:1784093732.020243:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013674496 00000100:00100000:0.0:1784093732.020300:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 495 00000100:00100000:0.0:1784093732.020310:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:38831:x1870757013674496:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093732.020348:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093732.020371:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5665 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.020385:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9d01) 00010000:00010000:0.0:1784093732.020389:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781600) 00010000:00010000:0.0:1784093732.020400:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093732.020442:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.020451:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.020458:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784093732.042698:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967493 is committed 00000004:00010000:0.0:1784093732.042703:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a3a5d604 reply state 0000000097e09bba transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093732.042715:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 40 committed 00000100:00100000:0.0:1784093732.042717:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093732.042874:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000100:00100000:3.0:1784093732.042903:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024219264:0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1784093732.042973:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093732.042981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093732.042991:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:38831:x1870757013674496:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 22680us (22811us total) trans 4294967493 rc 0/0 00010000:00010000:1.0:1784093732.043001:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093732.043001:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 495 00010000:00010000:1.0:1784093732.043015:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093732.043023:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093732.043031:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093732.043044:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093732.043053:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093732.043070:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907202e6b900) 00010000:00010000:1.0:1784093732.043073:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093732.043078:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093732.043085:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9d9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093732.043241:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219264 00000100:00100000:2.0:1784093732.043249:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219264 00000100:00080000:3.0:1784093732.043280:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093732.043309:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784093732.043319:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024219264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784093732.043344:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00010000:00010000:2.0:1784093732.043367:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.043385:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.043401:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093732.043407:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093732.043412:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.043462:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.043478:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 6 pid: 6572 timeout: 993 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093732.043491:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024219392:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093732.043549:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072049e20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093732.045029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093732.045090:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013674624 00000100:00100000:3.0:1784093732.045098:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013674624 00010000:00010000:3.0:1784093732.045150:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 7 pid: 6572 timeout: 993 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093732.045231:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 233 00000100:00100000:3.0:1784093732.045241:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013674624:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093732.045254:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093732.045259:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 7 pid: 6572 timeout: 993 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045270:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 7 pid: 6572 timeout: 993 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784093732.045272:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784093732.045292:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093732.045295:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093732.045305:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045312:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045327:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093732.045371:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013674624:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 131us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093732.045380:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 233 00010000:00010000:0.0:1784093732.045470:0:53396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214c9d55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf565e expref: 6 pid: 6572 timeout: 993 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093732.045498:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024219392:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093732.045547:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.045561:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.045569:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.045582:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.045591:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.045641:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093732.045654:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093732.045661:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045671:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093732.045676:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045686:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045699:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045707:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214c9da2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.045742:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093732.045747:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093732.045750:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093732.046277:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024219264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2958us (3296us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1784093732.046288:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000004:00080000:3.0:1784093732.046460:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907101252680/2, rc 0, transno 4294967328 00000100:00100000:3.0:1784093732.046469:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024219264:0@lo:6:osp-syn-0-0.0 10000000:01000000:3.0:1784093732.201503:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093732.201511:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093732.201517:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093732.201575:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.201587:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.201599:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093732.201624:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024219520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093732.201691:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093732.201744:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1784093732.201853:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219520 00000100:00100000:0.0:1784093732.201862:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219520 00000100:00100000:0.0:1784093732.201915:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1784093732.201925:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024219520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093732.201943:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093732.201957:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9da9 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.201981:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.201992:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.202002:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784093732.202048:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024219520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093732.202056:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1784093732.202372:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024219520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093732.202389:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.202398:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093732.202453:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093732.202459:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.202466:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.329615:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093732.403831:0:65496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff929270d0 20000000:00000080:2.0:1784093732.403848:0:65496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720b844400 uarg=0000000000000000 00010000:00010000:2.0:1784093732.404309:0:65496:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093732.404324:0:65496:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093732.404336:0:65496:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093732.404354:0:65496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.404371:0:65496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.404388:0:65496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.404458:0:65496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.404473:0:65496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 18 pid: 5771 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093732.404490:0:65496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65496:1870757024219648:0@lo:104: 00000100:00100000:2.0:1784093732.404565:0:65496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093732.404622:0:65496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072049e2540 going to sleep for 11 seconds 00000100:00100000:1.0:1784093732.404622:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219648 00000100:00100000:1.0:1784093732.404632:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219648 00000100:00100000:1.0:1784093732.404684:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1784093732.404695:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:65496:x1870757024219648:12345-0@lo:104: 00010000:00010000:1.0:1784093732.404708:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093732.404768:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093732.404778:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:65496:x1870757024219648:12345-0@lo:104: Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093732.404786:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784093732.404798:0:65496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65496:1870757024219648:0@lo:104: 00010000:00010000:0.0:1784093732.404801:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093732.404810:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.404817:0:65496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.404838:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093732.404843:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.404852:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093732.404859:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093732.404866:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093732.404898:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.404905:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093732.404927:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093732.404935:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9da9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9db0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093732.404939:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093732.404953:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024219776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093732.404955:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093732.404959:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093732.404962:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093732.404989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093732.405029:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219776 00000100:00100000:2.0:1784093732.405034:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219776 00010000:00010000:2.0:1784093732.405051:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 19 pid: 5771 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093732.405076:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784093732.405083:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024219776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093732.405093:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093732.405098:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 19 pid: 5771 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405108:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 19 pid: 5771 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405125:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214c9db0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9da9 expref: 19 pid: 5771 timeout: 1043 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405137:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405144:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405155:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405162:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405169:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405175:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405180:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093732.405184:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405191:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405207:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093732.405224:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093732.405242:0:65496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.405252:0:65496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093732.405259:0:65496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40800/0x9ce98053214c9db7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093732.405264:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024219776:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093732.405275:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784093732.405335:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024219776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093732.842353:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024219904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093732.842454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093732.842547:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024219904 00000100:00100000:2.0:1784093732.842555:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024219904 00000100:00100000:2.0:1784093732.842604:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784093732.842616:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024219904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093732.842652:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093732.842707:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024219904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093732.842716:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784093732.842776:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024219904:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1784093732.861904:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00000001:00080000:2.0:1784093732.861916:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00010000:00010000:3.0:1784093733.353593:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093733.669554:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093733.669610:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013674752 00000100:00100000:3.0:1784093733.669620:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013674752 00000100:00100000:3.0:1784093733.669683:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 496 00000100:00100000:3.0:1784093733.669694:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:38907:x1870757013674752:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093733.669719:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093733.669741:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf566c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.669813:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.669826:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.669838:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.669858:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.669865:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.669873:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670354:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670364:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670372:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093733.670490:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:3.0:1784093733.670507:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093733.670589:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670611:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670618:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670624:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670632:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093733.670636:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670644:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670656:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784093733.670659:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093733.670663:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670670:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670683:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670689:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670695:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670707:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093733.670710:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670717:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670726:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce000) 00010000:00010000:3.0:1784093733.670729:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093733.670732:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670738:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214c9dcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670772:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf566c expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670789:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf566c expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093733.670797:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784093733.670799:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093733.670801:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784093733.670859:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38907:x1870757013674752:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1167us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093733.670866:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 496 10000000:01000000:3.0:1784093734.121589:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093734.121603:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093734.121608:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093734.121651:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.121664:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.121681:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093734.121709:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024220032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093734.121775:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093734.121827:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784093734.121828:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220032 00000100:00100000:1.0:1784093734.121837:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220032 00000100:00100000:1.0:1784093734.121900:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1784093734.121910:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024220032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093734.121923:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093734.121942:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9dda expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093734.121966:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9dda expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093734.121978:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9dda expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093734.121987:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13600, rc 0) 00000100:00100000:1.0:1784093734.122037:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024220032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093734.122043:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1784093734.122775:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024220032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093734.122794:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.122805:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093734.122825:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093734.122830:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.122838:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093734.367965:0:65741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed0f0b520 20000000:00000080:2.0:1784093734.367983:0:65741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237551c00 uarg=0000000000000000 00010000:00010000:2.0:1784093734.368199:0:65741:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784093734.368598:0:65741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fceb00) 00010000:00010000:2.0:1784093734.368603:0:65741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093734.368613:0:65741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214c9dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf566c expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.368648:0:65741:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784093734.368745:0:65741:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093734.368757:0:65741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.368768:0:65741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9dda expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.368774:0:65741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.368804:0:65741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9dda expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.368814:0:65741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9dda expref: 18 pid: 5770 timeout: 1045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093734.368824:0:65741:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65741:1870757024220160:0@lo:104: 00000100:00100000:2.0:1784093734.368871:0:65741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093734.368911:0:65741:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093734.369148:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220160 00000100:00100000:0.0:1784093734.369156:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220160 00000100:00100000:0.0:1784093734.369196:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784093734.369204:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:65741:x1870757024220160:12345-0@lo:104: 00010000:00010000:0.0:1784093734.369220:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093734.369267:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093734.369272:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:65741:x1870757024220160:12345-0@lo:104: Request processed in 69us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093734.369277:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00010000:3.0:1784093734.369340:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093734.369348:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093734.369361:0:65741:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65741:1870757024220160:0@lo:104: 00010000:00010000:3.0:1784093734.369370:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093734.369376:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369381:0:65741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.369386:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093734.369396:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093734.369403:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093734.369457:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.369465:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093734.369505:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093734.369505:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024220288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093734.369518:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9dda lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9de1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093734.369536:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093734.369540:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093734.369542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784093734.369544:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093734.369576:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220288 00000100:00100000:2.0:1784093734.369582:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220288 00010000:00010000:2.0:1784093734.369602:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9dda expref: 19 pid: 5770 timeout: 1045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093734.369640:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784093734.369648:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024220288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093734.369674:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093734.369680:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9dda expref: 19 pid: 5770 timeout: 1045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369690:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9dda expref: 19 pid: 5770 timeout: 1045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369701:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214c9de1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9dda expref: 19 pid: 5770 timeout: 1045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369712:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369720:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369731:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369739:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369746:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369752:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369767:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093734.369771:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369776:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369790:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093734.369800:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093734.369816:0:65741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093734.369824:0:65741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093734.369830:0:65741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40e00/0x9ce98053214c9de8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093734.369832:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024220288:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093734.369839:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784093734.369862:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024220288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093734.378522:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093735.289295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093735.289347:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093735.289382:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093735.289416:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093735.289477:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675264 00000100:00100000:1.0:1784093735.289479:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013674880 00000100:00100000:1.0:1784093735.289489:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013674880 00000100:00100000:3.0:1784093735.289490:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675264 00000100:00100000:3.0:1784093735.289544:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675136 00000100:00100000:1.0:1784093735.289547:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:3.0:1784093735.289549:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675136 00000100:00100000:1.0:1784093735.289561:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013674880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093735.289577:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 388 00000100:00100000:3.0:1784093735.289586:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013675264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093735.289637:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675008 00000100:00100000:1.0:1784093735.289643:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013674880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 82us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093735.289644:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013675264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 55us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093735.289644:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675008 00000100:00100000:1.0:1784093735.289659:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:3.0:1784093735.289661:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 388 00000100:00100000:3.0:1784093735.289684:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 389 00000100:00100000:0.0:1784093735.289690:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:3.0:1784093735.289696:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013675136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093735.289704:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013675008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093735.289732:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013675136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093735.289741:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 389 00000100:00100000:0.0:1784093735.289746:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013675008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093735.289754:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00080000:2.0:1784093735.289813:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093735.289818:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093735.289820:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784093735.402918:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093735.569501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093735.569539:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675392 00000100:00100000:2.0:1784093735.569550:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675392 00000100:00100000:2.0:1784093735.569607:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 497 00000100:00100000:2.0:1784093735.569618:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:38994:x1870757013675392:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093735.569641:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093735.569743:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5673 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093735.569817:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093735.569832:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093735.569845:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093735.570044:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:2.0:1784093735.570050:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093735.570158:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093735.570186:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214c9def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5673 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093735.570211:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5673 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093735.570221:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093735.570225:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093735.570229:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784093735.570293:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:38994:x1870757013675392:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 676us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093735.570301:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 497 00000100:00100000:1.0:1784093735.572292:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093735.572540:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675648 00000100:00100000:3.0:1784093735.572550:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675648 00000100:00100000:3.0:1784093735.572598:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 498 00000100:00100000:3.0:1784093735.572609:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:38994:x1870757013675648:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093735.572653:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093735.572678:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5673 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.572694:0:5809:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9dd3) 00010000:00010000:3.0:1784093735.572697:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781300) 00010000:00010000:3.0:1784093735.572707:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093735.572729:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.572744:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.572755:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093735.573218:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c04d0969 reply state 00000000e8a614b5 transno 4294967494 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093735.573229:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093735.573322:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000100:00100000:3.0:1784093735.573402:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:38994:x1870757013675648:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 794us (1111us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1784093735.573410:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 498 00010000:00010000:3.0:1784093735.576400:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.576418:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.576628:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.576636:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093735.576641:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.576650:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.576666:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784093735.576670:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093735.576674:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.576681:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214c9dfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093735.657500:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093735.657507:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093735.657511:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093735.657553:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.657565:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.657576:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093735.657604:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024220416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093735.657735:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093735.657799:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14b600 going to sleep for 11 seconds 00000100:00100000:1.0:1784093735.657876:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220416 00000100:00100000:1.0:1784093735.657884:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220416 00000100:00100000:1.0:1784093735.657991:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1784093735.658002:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024220416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093735.658018:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093735.658033:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9e04 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.658057:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.658069:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.658079:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784093735.658132:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024220416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093735.658139:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1784093735.658229:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024220416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093735.658249:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.658259:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093735.658279:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093735.658284:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.658289:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093735.914292:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024220544:0@lo:400:kworker.0 00000100:00100000:1.0:1784093735.914342:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024220672:0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.914374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093735.914400:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024220800:0@lo:400:kworker.0 00000100:00100000:1.0:1784093735.914538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093735.914568:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024221056:0@lo:400:kworker.0 00000100:00100000:1.0:1784093735.914572:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784093735.914580:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024220928:0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.914606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093735.914613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093735.914834:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220800 00000100:00100000:3.0:1784093735.914842:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093735.914843:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220800 00000100:00100000:3.0:1784093735.914852:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024221184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093735.914883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093735.914923:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221056 00000100:00100000:1.0:1784093735.914934:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221056 00000100:00100000:1.0:1784093735.914972:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1784093735.914981:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024220800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093735.915033:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024220800:12345-0@lo:400:kworker.0 Request processed in 54us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093735.915042:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1784093735.915065:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220544 00000100:00100000:1.0:1784093735.915066:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784093735.915071:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220544 00000100:00100000:1.0:1784093735.915078:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024221056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.915109:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220928 00000100:00100000:3.0:1784093735.915114:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220928 00000100:00100000:1.0:1784093735.915122:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024221056:12345-0@lo:400:kworker.0 Request processed in 45us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093735.915130:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784093735.915148:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1784093735.915159:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024220544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093735.915164:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1784093735.915175:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024220928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.915198:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024220544:12345-0@lo:400:kworker.0 Request processed in 41us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093735.915205:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1784093735.915220:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024220928:12345-0@lo:400:kworker.0 Request processed in 45us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093735.915228:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221184 00000100:00100000:1.0:1784093735.915228:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1784093735.915233:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221184 00000100:00080000:1.0:1784093735.915250:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093735.915256:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093735.915259:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093735.915270:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784093735.915279:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093735.915315:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024220672 00000100:00100000:1.0:1784093735.915320:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024220672 00000100:00100000:3.0:1784093735.915343:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024221184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093735.915355:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1784093735.915364:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024220672:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784093735.915371:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093735.915516:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024220672:12345-0@lo:400:kworker.0 Request processed in 152us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093735.915527:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1784093735.915529:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024221184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 248us (643us total) trans 0 rc 0/0 00000100:00080000:1.0:1784093735.915553:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093735.915582:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024220672:0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.915676:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784093735.915751:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024220928:0@lo:400:kworker.0 00000100:00100000:1.0:1784093735.915764:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:1.0:1784093735.915770:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907101252680, transno 4294967328 00000100:00100000:1.0:1784093735.915783:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024220800:0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.915793:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024221184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093735.915815:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024221056:0@lo:400:kworker.0 00000100:00100000:3.0:1784093735.915830:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024220544:0@lo:400:kworker.0 00000020:00000080:1.0:1784093735.937319:0:65937:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdba0fa660 20000000:00000080:1.0:1784093735.937339:0:65937:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e10a000 uarg=0000000000000000 00010000:00010000:1.0:1784093735.937687:0:65937:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093735.937703:0:65937:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093735.937717:0:65937:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093735.937735:0:65937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.937806:0:65937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.937813:0:65937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.937844:0:65937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.937855:0:65937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 18 pid: 5770 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093735.937866:0:65937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65937:1870757024221312:0@lo:104: 00000100:00100000:1.0:1784093735.938029:0:65937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093735.938132:0:65937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8480 going to sleep for 11 seconds 00000100:00100000:3.0:1784093735.938154:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221312 00000100:00100000:3.0:1784093735.938162:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221312 00000100:00100000:3.0:1784093735.938210:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1784093735.938220:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:65937:x1870757024221312:12345-0@lo:104: 00010000:00010000:3.0:1784093735.938232:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.938298:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093735.938304:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:65937:x1870757024221312:12345-0@lo:104: Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093735.938311:0:65937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65937:1870757024221312:0@lo:104: 00000100:00100000:3.0:1784093735.938312:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00010000:00010000:1.0:1784093735.938328:0:65937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093735.938915:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093735.938921:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093735.938927:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093735.938931:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093735.938947:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093735.938955:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093735.938960:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093735.939205:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093735.939211:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093735.939230:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093735.939241:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214c9e04 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9e0b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093735.939251:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024221440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093735.939255:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093735.939258:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093735.939259:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093735.939287:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093735.939401:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221440 00000100:00100000:3.0:1784093735.939407:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221440 00010000:00010000:3.0:1784093735.939465:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 19 pid: 5770 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093735.939490:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784093735.939497:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024221440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093735.939508:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093735.939513:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 19 pid: 5770 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939524:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 19 pid: 5770 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939536:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214c9e0b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9e04 expref: 19 pid: 5770 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939555:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939563:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939576:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939583:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939590:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939598:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939604:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093735.939609:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939616:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939630:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093735.939650:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093735.939693:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024221440:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093735.939707:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00010000:00010000:1.0:1784093735.939716:0:65937:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093735.939719:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024221440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093735.939731:0:65937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093735.939738:0:65937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214c9e12 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093736.425690:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093737.065605:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093737.065621:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093737.065626:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093737.065664:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.065676:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.065687:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093737.065711:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024221568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093737.065769:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093737.065879:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093737.066164:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221568 00000100:00100000:1.0:1784093737.066172:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221568 00000100:00100000:1.0:1784093737.066226:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1784093737.067286:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024221568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093737.067301:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093737.067328:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9e19 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.067352:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.067363:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.067388:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784093737.067472:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024221568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.067480:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1784093737.067507:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024221568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093737.067528:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093737.067539:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093737.067558:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093737.067563:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093737.067576:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093737.197557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093737.197602:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675776 00000100:00100000:3.0:1784093737.197611:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675776 00000100:00080000:1.0:1784093737.197656:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093737.197670:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:3.0:1784093737.197678:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013675776:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093737.197766:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013675776:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 88us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093737.197774:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:2.0:1784093737.199801:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093737.199939:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013675904 00000100:00100000:3.0:1784093737.199948:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013675904 00000100:00100000:3.0:1784093737.200011:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 237 00000100:00100000:3.0:1784093737.200020:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013675904:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:1.0:1784093737.200158:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093737.201721:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013675904:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 1697us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093737.201732:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 237 00000100:00100000:0.0:1784093737.204915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.205191:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676032 00000100:00100000:1.0:1784093737.205200:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676032 00000100:00100000:1.0:1784093737.205253:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 238 00000100:00100000:1.0:1784093737.205261:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013676032:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:2.0:1784093737.205373:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093737.205659:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013676032:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 398us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.205665:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 238 00000100:00100000:1.0:1784093737.206903:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093737.206953:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676160 00000100:00100000:3.0:1784093737.206961:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676160 00000100:00100000:3.0:1784093737.206997:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 500 00000100:00100000:3.0:1784093737.207003:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013676160:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093737.207303:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013676160:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 298us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093737.207312:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 500 00000100:00100000:2.0:1784093737.211153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.211244:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676288 00000100:00100000:1.0:1784093737.211253:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676288 00000100:00100000:1.0:1784093737.211307:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 501 00000100:00100000:1.0:1784093737.211317:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013676288:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093737.211504:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013676288:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 188us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.211513:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 501 00000100:00100000:0.0:1784093737.212783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.212940:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676416 00000100:00100000:1.0:1784093737.212948:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676416 00000100:00100000:1.0:1784093737.212987:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 239 00000100:00100000:1.0:1784093737.213008:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013676416:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093737.213312:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013676416:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 306us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.213319:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 239 00000100:00100000:2.0:1784093737.215243:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093737.215295:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676544 00000100:00100000:3.0:1784093737.215303:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676544 00000100:00100000:3.0:1784093737.215352:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 240 00000100:00100000:3.0:1784093737.215362:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013676544:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093737.215699:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:39078:x1870757013676544:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 338us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093737.215707:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 240 00000100:00100000:2.0:1784093737.216892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.216981:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676672 00000100:00100000:1.0:1784093737.216988:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676672 00000100:00100000:1.0:1784093737.217033:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 502 00000100:00100000:1.0:1784093737.217042:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013676672:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093737.217457:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39078:x1870757013676672:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 377us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.217466:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 502 00000100:00100000:0.0:1784093737.241627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093737.241681:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013676800 00000100:00100000:3.0:1784093737.241690:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013676800 00000100:00100000:3.0:1784093737.241763:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:3.0:1784093737.241774:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39082:x1870757013676800:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784093737.241795:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093737.241819:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf567a expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.241912:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.241924:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.241937:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.241948:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.241954:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.241961:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242359:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242368:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242383:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093737.242520:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:3.0:1784093737.242525:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093737.242603:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242627:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242633:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242640:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242646:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093737.242650:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242657:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242668:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093737.242671:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093737.242676:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242682:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242694:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242700:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242706:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242718:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093737.242721:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242728:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242737:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff907204fce300) 00010000:00010000:3.0:1784093737.242739:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093737.242742:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242748:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214c9e35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242779:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214c9e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf567a expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242794:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf567a expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.242801:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093737.242803:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093737.242806:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093737.242881:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:39082:x1870757013676800:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1104us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093737.242888:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:2.0:1784093737.245854:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.246040:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677056 00000100:00100000:1.0:1784093737.246049:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677056 00000100:00100000:1.0:1784093737.246098:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 504 00000100:00100000:1.0:1784093737.246105:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:39082:x1870757013677056:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784093737.246121:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093737.246140:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9e43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5681 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.246412:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.246522:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.246533:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.246591:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.246596:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.246601:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093737.247205:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:1.0:1784093737.247474:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.247484:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.247492:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.247527:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.247534:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248356:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248368:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093737.248373:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248394:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248408:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784093737.248411:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093737.248416:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248452:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9e4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093737.248469:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000002d657f10 reply state 0000000098243bfb transno 4294967495 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093737.248477:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093737.248514:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214c9e43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5681 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248525:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5681 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.248530:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093737.248531:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093737.248533:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093737.248603:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:39082:x1870757013677056:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 2499us (2758us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1784093737.248609:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 504 00010000:00010000:3.0:1784093737.250235:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.250258:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.250265:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.250272:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093737.250277:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.250283:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.250296:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907219c12300) 00010000:00010000:3.0:1784093737.250309:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093737.250314:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093737.250320:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093737.254136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.254303:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677184 00000100:00100000:1.0:1784093737.254323:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677184 00000100:00100000:1.0:1784093737.254384:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 241 00000100:00100000:1.0:1784093737.254394:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:39082:x1870757013677184:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784093737.254413:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093737.254530:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5688 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093737.254558:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784093737.254580:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=898s v=(0 0) 00010000:00010000:1.0:1784093737.254585:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093737.254594:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.254612:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093737.254624:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784093737.255277:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39082:x1870757013677184:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 882us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.255286:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 241 00000100:00100000:0.0:1784093737.267782:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093737.267896:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677312 00000100:00100000:2.0:1784093737.267906:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677312 00002000:00100000:2.0:1784093737.267954:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x10:0x0] (0->1048575) req@ffff90723d3d6d80 x1870757013677312/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:58/0 lens 488/0 e 0 to 0 dl 1784093748 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093737.267962:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d3d6d80 with x1870757013677312 ext(0->1048575) 00002000:00010000:2.0:1784093737.267968:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d3d6d80 00000100:00100000:2.0:1784093737.267998:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 11 00000100:00100000:2.0:1784093737.268007:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013677312:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:1.0:1784093737.281242:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013677312:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 13226us (13459us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1784093737.281255:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 11 00002000:00100000:1.0:1784093737.281268:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x10:0x0] (0->1048575) req@ffff90723d3d6d80 x1870757013677312/t4294967327(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:58/0 lens 488/448 e 0 to 0 dl 1784093748 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093737.281278:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d3d6d80 with x1870757013677312 ext(0->1048575) 00002000:00010000:1.0:1784093737.281294:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d3d6d80 00000100:00100000:2.0:1784093737.282830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.282895:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677440 00000100:00100000:1.0:1784093737.282904:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677440 00000100:00100000:1.0:1784093737.282960:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 505 00000100:00100000:1.0:1784093737.282971:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:39082:x1870757013677440:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:0.0:1784093737.302671:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967495 is committed 00000100:00100000:1.0:1784093737.302846:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:39082:x1870757013677440:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 19870us (20014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.302857:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 505 00000100:00100000:2.0:1784093737.309552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.309663:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677568 00000100:00100000:1.0:1784093737.309672:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677568 00000100:00100000:1.0:1784093737.309728:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 242 00000100:00100000:1.0:1784093737.309739:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013677568:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:2.0:1784093737.327218:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967327 is committed 00000100:00100000:1.0:1784093737.327330:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013677568:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 17586us (17779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093737.327341:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 242 00000100:00100000:0.0:1784093737.329573:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093737.329662:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677824 00000100:00100000:1.0:1784093737.329672:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677824 00000100:00100000:1.0:1784093737.329726:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 55 00000100:00100000:1.0:1784093737.329737:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:39082:x1870757013677824:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093737.330162:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:39082:x1870757013677824:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 426us (596us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1784093737.330170:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 55 00010000:00010000:0.0:1784093737.449582:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093737.877821:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967496 is committed 00000100:00100000:2.0:1784093737.962264:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024221696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093737.962331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093737.962410:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221696 00000100:00100000:0.0:1784093737.962461:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221696 00000100:00080000:2.0:1784093737.962493:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093737.962528:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1784093737.962538:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024221696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093737.962573:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093737.962979:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024221696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093737.962988:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1784093737.963022:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024221696:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1784093738.411935:0:66183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899489510222ns, next at 892068748398ns, rc = 0 00000004:00080000:2.0:1784093738.412062:0:66183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899489639438ns, next at 869289427160ns, rc = 0 00000004:00080000:0.0:1784093738.413826:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 39 committed 00000004:00080000:0.0:1784093738.413886:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 41 committed 00010000:00010000:0.0:1784093738.473534:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093739.040476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093739.040564:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013677952 00000100:00100000:3.0:1784093739.040575:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013677952 00000100:00100000:3.0:1784093739.040647:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 506 00000100:00100000:3.0:1784093739.040658:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013677952:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093739.040763:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013677952:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093739.040771:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 506 00000100:00080000:2.0:1784093739.040822:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093739.042762:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093739.042810:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678080 00000100:00100000:1.0:1784093739.042820:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678080 00000100:00100000:1.0:1784093739.042887:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 243 00000100:00080000:2.0:1784093739.042898:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093739.042899:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:39274:x1870757013678080:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093739.043662:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:39274:x1870757013678080:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 764us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093739.043671:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 243 00000100:00100000:1.0:1784093739.045963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093739.046013:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678208 00000100:00100000:2.0:1784093739.046023:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678208 00000100:00100000:2.0:1784093739.046089:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 244 00000100:00100000:2.0:1784093739.046100:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39274:x1870757013678208:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093739.046542:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39274:x1870757013678208:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 444us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093739.046551:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 244 00000100:00080000:1.0:1784093739.046590:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093739.048782:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093739.049158:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678336 00000100:00100000:1.0:1784093739.049168:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678336 00000100:00100000:1.0:1784093739.049224:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 507 00000100:00100000:1.0:1784093739.049233:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013678336:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093739.049684:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013678336:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 450us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093739.049691:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 507 00000100:00100000:3.0:1784093739.052200:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093739.053471:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678464 00000100:00100000:1.0:1784093739.053484:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678464 00000100:00100000:1.0:1784093739.053550:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 508 00000100:00100000:1.0:1784093739.053561:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013678464:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093739.053676:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013678464:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 117us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093739.053684:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 508 00000100:00100000:1.0:1784093739.056741:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093739.056799:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678592 00000100:00100000:3.0:1784093739.056809:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678592 00000100:00100000:3.0:1784093739.056867:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 245 00000100:00100000:3.0:1784093739.056879:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39274:x1870757013678592:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093739.057291:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39274:x1870757013678592:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 413us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093739.057298:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 245 00000100:00100000:0.0:1784093739.058607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093739.058659:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678720 00000100:00100000:2.0:1784093739.058668:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678720 00000100:00100000:2.0:1784093739.058724:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 246 00000100:00100000:2.0:1784093739.058736:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39274:x1870757013678720:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093739.059175:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39274:x1870757013678720:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 440us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093739.059185:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 246 00000100:00100000:3.0:1784093739.060131:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093739.060181:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013678848 00000100:00100000:1.0:1784093739.060190:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013678848 00000100:00100000:1.0:1784093739.060243:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 509 00000100:00100000:1.0:1784093739.060253:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013678848:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093739.060677:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:39274:x1870757013678848:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 424us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093739.060692:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 509 00000100:00100000:3.0:1784093739.086557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093739.086591:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679104 00000100:00100000:0.0:1784093739.086601:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679104 00000100:00100000:0.0:1784093739.086663:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 510 00000100:00100000:0.0:1784093739.086680:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:39278:x1870757013679104:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784093739.086735:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093739.086764:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214c9e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5681 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.086782:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff907219c12400) 00010000:00010000:0.0:1784093739.086850:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093739.086874:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.086889:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.086899:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.086916:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.086924:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.086931:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.087277:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.087287:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.087296:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093739.088386:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9216 00000004:00080000:0.0:1784093739.088411:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 900165987974ns, next at 901165985361ns, rc = 0 00010000:00010000:0.0:1784093739.088657:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088670:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088679:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088688:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088694:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088701:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088722:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093739.088743:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088746:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093739.088749:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088755:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088757:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088772:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093739.088774:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093739.088778:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088788:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088797:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088802:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088813:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784093739.088817:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093739.088821:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088825:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff907202e6b800) 00010000:00010000:3.0:1784093739.088830:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093739.088831:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214c9e7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088835:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088844:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214c9e82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088851:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088859:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093739.088859:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088865:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088869:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093739.088871:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.088875:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093739.088875:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088882:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784093739.088884:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093739.088885:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093739.088894:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.088898:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214c9e6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093739.088906:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000086cc8c35 reply state 00000000b7144d58 transno 4294967497 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093739.088912:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093739.088979:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:39278:x1870757013679104:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 2301us (2431us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784093739.088986:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 510 00010000:00010000:0.0:1784093739.091222:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.091237:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.091245:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.091251:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093739.091255:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.091262:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.091276:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff907202e6b900) 00010000:00010000:0.0:1784093739.091279:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093739.091284:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093739.091296:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214c9e74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.498747:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784093739.983246:0:66329:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901060820761ns, next at 892068748398ns, rc = 0 00000004:00080000:0.0:1784093739.983350:0:66329:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901060927199ns, next at 901165985361ns, rc = 0 00000004:00080000:0.0:1784093739.996151:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 42 committed 00000001:00080000:0.0:1784093739.996177:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000004:00080000:0.0:1784093739.996181:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 40 committed 00000100:00100000:2.0:1784093739.996460:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024221824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784093739.996556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093739.996712:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024221824 00000100:00100000:3.0:1784093739.996721:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024221824 00000100:00080000:1.0:1784093739.996775:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093739.996793:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784093739.996803:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024221824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784093739.996834:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:16 count 1 00010000:00010000:3.0:1784093739.996858:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.996880:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.996889:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x10:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1784093739.996894:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093739.996899:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.996929:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093739.996945:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 5 pid: 6572 timeout: 1001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093739.996957:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6572:1870757024221952:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093739.997027:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14b600 going to sleep for 11 seconds 00000004:00080000:1.0:1784093739.997716:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00000100:00100000:2.0:1784093739.999469:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6572:1870757024221952:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093739.999496:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093740.000756:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093740.000841:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679232 00000100:00100000:3.0:1784093740.000866:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679232 00010000:00010000:3.0:1784093740.000901:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 6 pid: 6572 timeout: 1001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093740.000937:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 237 00000100:00100000:3.0:1784093740.000945:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013679232:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093740.000959:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093740.000965:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 6 pid: 6572 timeout: 1001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093740.000978:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 6 pid: 6572 timeout: 1001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093740.001002:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214c9e66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5688 expref: 6 pid: 6572 timeout: 1001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093740.001019:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093740.001023:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093740.001028:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093740.001038:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093740.001064:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093740.001098:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093740.001109:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093740.001129:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013679232:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 182us (375us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093740.001129:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093740.001143:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093740.001158:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 237 00010000:00010000:2.0:1784093740.001172:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093740.001210:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093740.001218:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093740.001229:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093740.001234:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093740.001244:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093740.001263:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093740.001270:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214c9e89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093740.001289:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093740.001290:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093740.001292:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093740.001793:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024221824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4990us (5236us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1784093740.001803:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000004:00080000:3.0:1784093740.001830:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d4d1f80/2, rc 0, transno 4294967328 00000100:00100000:3.0:1784093740.001856:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024221824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784093740.409810:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093740.409882:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093740.409986:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679488 00000100:00100000:1.0:1784093740.409986:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679360 00000100:00100000:2.0:1784093740.409997:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679488 00000100:00100000:1.0:1784093740.410004:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679360 00000100:00100000:2.0:1784093740.410060:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:1.0:1784093740.410068:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:2.0:1784093740.410071:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013679488:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093740.410082:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013679360:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093740.410199:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013679488:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093740.410206:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:1.0:1784093740.410222:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013679360:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 143us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093740.410231:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:0.0:1784093740.410243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093740.410288:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679616 00000100:00100000:1.0:1784093740.410292:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679616 00000100:00100000:1.0:1784093740.410326:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 392 00000100:00100000:0.0:1784093740.410332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093740.410338:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013679616:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093740.410357:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679744 00000100:00100000:2.0:1784093740.410363:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679744 00000100:00100000:1.0:1784093740.410396:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013679616:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093740.410406:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 393 00000100:00100000:1.0:1784093740.410413:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 392 00000100:00100000:2.0:1784093740.410418:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013679744:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093740.410476:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013679744:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093740.410483:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 393 00010000:00010000:0.0:1784093740.521756:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093741.033618:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093741.033641:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024222080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093741.033706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093741.033739:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093741.033818:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024222336:0@lo:400:kworker.0 00000100:00100000:1.0:1784093741.033844:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222080 00000100:00100000:1.0:1784093741.033853:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222080 00000100:00100000:0.0:1784093741.033857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093741.033875:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024222592:0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.033879:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024222208:0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.033906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093741.033907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093741.033917:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1784093741.033929:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024222080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093741.033934:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093741.033934:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784093741.033942:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024222464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.033942:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024222720:0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.033965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1784093741.033966:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784093741.033971:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222592 00000100:00100000:3.0:1784093741.033976:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222592 00000100:00080000:0.0:1784093741.034000:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093741.034004:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093741.034009:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1784093741.034018:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024222592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.034018:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222336 00000100:00100000:0.0:1784093741.034022:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222336 00000100:00100000:1.0:1784093741.034025:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024222080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093741.034034:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784093741.034052:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222720 00000100:00100000:3.0:1784093741.034056:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024222592:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093741.034056:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222720 00000100:00100000:3.0:1784093741.034063:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1784093741.034067:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222208 00000100:00100000:1.0:1784093741.034073:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222208 00000100:00100000:0.0:1784093741.034093:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1784093741.034105:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1784093741.034108:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1784093741.034116:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024222720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093741.034121:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024222208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093741.034158:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024222080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093741.034167:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024222720:12345-0@lo:400:kworker.0 Request processed in 55us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093741.034174:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024222208:12345-0@lo:400:kworker.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093741.034179:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1784093741.034189:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1784093741.034198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093741.034215:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024222720:0@lo:400:kworker.0 00000100:00100000:3.0:1784093741.034227:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071036d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024222208:0@lo:400:kworker.0 00000100:00100000:2.0:1784093741.034227:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024222592:0@lo:400:kworker.0 00000100:00100000:2.0:1784093741.034249:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222464 00000100:00100000:2.0:1784093741.034252:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222464 00000100:00080000:1.0:1784093741.034258:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093741.034278:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1784093741.034286:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024222464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093741.034323:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024222464:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093741.034329:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1784093741.034337:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024222464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.034379:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024222336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093741.034415:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024222336:12345-0@lo:400:kworker.0 Request processed in 315us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093741.034443:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1784093741.034445:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024222336:0@lo:400:kworker.0 00010000:00010000:3.0:1784093741.545880:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093742.570054:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093743.081584:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024222848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093743.081671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093743.081718:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222848 00000100:00100000:0.0:1784093743.081728:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222848 00000100:00100000:0.0:1784093743.081868:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784093743.081877:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024222848:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784093743.081898:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784093743.081930:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093743.081980:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024222848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093743.081988:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784093743.082014:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024222848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093743.593626:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784093744.123896:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967328 is committed 00010000:00010000:1.0:1784093744.618556:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093745.528601:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093745.528650:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093745.528688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093745.528710:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680000 00000100:00100000:0.0:1784093745.528719:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680000 00000100:00100000:2.0:1784093745.528724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093745.528752:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680256 00000100:00080000:2.0:1784093745.528754:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093745.528760:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680256 00000100:00100000:0.0:1784093745.528793:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:0.0:1784093745.528804:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013680000:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093745.528812:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680128 00000100:00100000:3.0:1784093745.528818:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680128 00000100:00100000:2.0:1784093745.528818:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 395 00000100:00100000:2.0:1784093745.528833:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013680256:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093745.528866:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 396 00000100:00100000:3.0:1784093745.528873:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013680128:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093745.528888:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013680000:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093745.528897:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:1.0:1784093745.528920:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013679872 00000100:00100000:1.0:1784093745.528925:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013679872 00000100:00100000:1.0:1784093745.528960:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 638 00000100:00100000:1.0:1784093745.528968:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013679872:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093745.529023:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013680256:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 195us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093745.529030:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 395 00000100:00080000:2.0:1784093745.529059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093745.529062:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093745.529136:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013680128:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 204us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093745.529149:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 396 00000100:00100000:1.0:1784093745.529149:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013679872:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 179us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093745.529160:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 638 00010000:00010000:3.0:1784093745.641690:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093746.153625:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784093746.153650:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024222976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093746.153718:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093746.154399:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024222976 00000100:00100000:1.0:1784093746.154408:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024222976 00000100:00080000:2.0:1784093746.154524:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093746.154559:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1784093746.154571:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024222976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093746.154596:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024223104:0@lo:400:kworker.0 00002000:00000024:1.0:1784093746.154616:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093746.154634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093746.154752:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024223232:0@lo:400:kworker.0 00000100:00100000:3.0:1784093746.154787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093746.154809:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093746.154815:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024223360:0@lo:400:kworker.0 00000100:00100000:3.0:1784093746.154836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093746.154864:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223232 00000100:00100000:3.0:1784093746.154867:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223232 00000100:00100000:3.0:1784093746.154895:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223360 00000100:00100000:3.0:1784093746.154898:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223360 00000100:00100000:3.0:1784093746.154925:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1784093746.154932:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024223232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093746.154938:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024222976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 369us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093746.154939:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:0.0:1784093746.154947:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d4d1f80, transno 4294967328 00000100:00100000:1.0:1784093746.154951:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1784093746.154969:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024223232:12345-0@lo:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093746.154976:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024222976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093746.154977:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223104 00000100:00100000:1.0:1784093746.154983:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223104 00000100:00100000:3.0:1784093746.154988:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1784093746.154993:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093746.155001:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024223488:0@lo:400:kworker.0 00000100:00100000:3.0:1784093746.155006:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1784093746.155008:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1784093746.155014:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024223360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093746.155014:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024223104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093746.155027:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093746.155078:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024223104:0@lo:400:kworker.0 00000100:00100000:0.0:1784093746.155115:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223488 00000100:00100000:0.0:1784093746.155118:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223488 00000100:00100000:0.0:1784093746.155139:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1784093746.155143:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093746.155355:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024223360:12345-0@lo:400:kworker.0 Request processed in 342us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093746.155355:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024223104:12345-0@lo:400:kworker.0 Request processed in 340us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093746.155363:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1784093746.155363:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1784093746.155393:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024223360:0@lo:400:kworker.0 00000100:00080000:1.0:1784093746.155396:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093746.155400:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093746.155403:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024223232:0@lo:400:kworker.0 00000100:00100000:2.0:1784093746.155520:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024223616:0@lo:400:kworker.0 00000100:00100000:2.0:1784093746.155556:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093746.155566:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024223488:12345-0@lo:400:kworker.0 Request processed in 421us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093746.155572:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1784093746.155579:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024223488:0@lo:400:kworker.0 00000100:00100000:2.0:1784093746.155599:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223616 00000100:00100000:2.0:1784093746.155602:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223616 00000100:00100000:2.0:1784093746.155647:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1784093746.155655:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024223616:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093746.155707:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093746.155708:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024223616:12345-0@lo:400:kworker.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093746.155715:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1784093746.155741:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024223616:0@lo:400:kworker.0 00010000:00010000:3.0:1784093746.665960:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093747.689716:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093748.201702:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024223744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093748.201773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093748.201903:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223744 00000100:00100000:1.0:1784093748.201911:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223744 00000100:00100000:1.0:1784093748.201980:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1784093748.201990:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024223744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093748.202023:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784093748.202132:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093748.202192:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024223744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093748.202198:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784093748.202273:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024223744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093748.715296:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093749.737682:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093750.648694:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093750.648750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093750.648793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093750.648795:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680512 00000100:00100000:1.0:1784093750.648806:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680512 00000100:00100000:2.0:1784093750.648820:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680384 00000100:00100000:2.0:1784093750.648827:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680384 00000100:00100000:2.0:1784093750.648879:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:2.0:1784093750.648890:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013680384:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093750.648961:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013680384:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093750.648969:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:1.0:1784093750.648982:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:1.0:1784093750.648995:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013680512:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093750.649036:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013680512:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093750.649043:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00080000:0.0:1784093750.649051:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093750.649086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093750.649166:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680768 00000100:00100000:3.0:1784093750.649171:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680768 00000100:00100000:1.0:1784093750.649271:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680640 00000100:00100000:1.0:1784093750.649277:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680640 00000100:00100000:3.0:1784093750.649326:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 398 00000100:00100000:3.0:1784093750.649334:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013680768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093750.649380:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013680768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093750.649389:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 398 00000100:00080000:0.0:1784093750.649551:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093750.649555:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093750.649588:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 399 00000100:00100000:1.0:1784093750.649597:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013680640:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093750.649650:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013680640:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093750.649657:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 399 00010000:00010000:3.0:1784093750.761775:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093751.273588:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024223872:0@lo:400:kworker.0 00000100:00100000:0.0:1784093751.273589:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024224000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093751.273594:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024224128:0@lo:400:kworker.0 00000100:00100000:2.0:1784093751.273635:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024224256:0@lo:400:kworker.0 00000100:00100000:1.0:1784093751.273679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093751.273680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093751.273693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093751.273739:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024224384:0@lo:400:kworker.0 00000100:00100000:3.0:1784093751.273740:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024224640:0@lo:400:kworker.0 00000100:00100000:2.0:1784093751.273750:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224128 00000100:00100000:2.0:1784093751.273759:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224128 00000100:00100000:1.0:1784093751.273783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093751.273788:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093751.273817:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224256 00000100:00100000:2.0:1784093751.273823:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224256 00000100:00100000:0.0:1784093751.273831:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024224512:0@lo:400:kworker.0 00000100:00100000:1.0:1784093751.273838:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024223872 00000100:00100000:1.0:1784093751.273843:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024223872 00000100:00100000:3.0:1784093751.273847:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1784093751.273863:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024224128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093751.273865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093751.273875:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1784093751.273877:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224512 00000100:00100000:2.0:1784093751.273882:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224512 00000100:00100000:1.0:1784093751.273884:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024223872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093751.273904:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224000 00000100:00100000:2.0:1784093751.273909:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1784093751.273909:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224000 00000100:00100000:2.0:1784093751.273922:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024224256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093751.273933:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024223872:12345-0@lo:400:kworker.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093751.273944:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1784093751.273944:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1784093751.273955:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024224000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093751.273977:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024224256:12345-0@lo:400:kworker.0 Request processed in 58us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093751.273984:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1784093751.273996:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1784093751.273997:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024224512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093751.273999:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024224128:12345-0@lo:400:kworker.0 Request processed in 140us (318us total) trans 0 rc 0/0 00002000:00000024:0.0:1784093751.274006:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093751.274019:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1784093751.274041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093751.274049:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024224512:12345-0@lo:400:kworker.0 Request processed in 55us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093751.274049:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024224000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093751.274057:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1784093751.274058:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784093751.274068:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024224256:0@lo:400:kworker.0 00000100:00100000:2.0:1784093751.274084:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024224128:0@lo:400:kworker.0 00000100:00100000:0.0:1784093751.274085:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224384 00000100:00100000:0.0:1784093751.274101:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224384 00000100:00100000:3.0:1784093751.274102:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224640 00000100:00100000:1.0:1784093751.274104:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024224512:0@lo:400:kworker.0 00000100:00100000:3.0:1784093751.274108:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224640 00000100:00100000:1.0:1784093751.274122:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024224000:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093751.274124:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093751.274130:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093751.274134:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093751.274138:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1784093751.274147:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024224384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093751.274152:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1784093751.274178:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093751.274180:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024223872:0@lo:400:kworker.0 00000100:00100000:0.0:1784093751.274196:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024224384:12345-0@lo:400:kworker.0 Request processed in 51us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093751.274202:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024224384:0@lo:400:kworker.0 00000100:00100000:0.0:1784093751.274203:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1784093751.274236:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024224640:12345-0@lo:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093751.274242:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1784093751.274450:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024224640:0@lo:400:kworker.0 00010000:00010000:2.0:1784093751.785615:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093752.809647:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093753.321668:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093753.321692:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024224768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093753.321760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093753.321818:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224768 00000100:00100000:2.0:1784093753.321827:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224768 00000100:00080000:0.0:1784093753.321868:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093753.321886:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1784093753.321897:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024224768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093753.321934:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093753.321985:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024224768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093753.321992:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1784093753.322042:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024224768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093753.833616:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093754.857605:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093755.770712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093755.770758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093755.770788:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681024 00000100:00100000:2.0:1784093755.770799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093755.770799:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681024 00000100:00100000:2.0:1784093755.770846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093755.770868:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 595 00000100:00100000:1.0:1784093755.770877:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013681024:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093755.770900:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681280 00000100:00100000:2.0:1784093755.770906:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681280 00000100:00100000:3.0:1784093755.770921:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681152 00000100:00100000:3.0:1784093755.770935:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681152 00000100:00100000:1.0:1784093755.770948:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013681024:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093755.770960:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 402 00000100:00100000:1.0:1784093755.770960:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 595 00000100:00100000:2.0:1784093755.770978:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013681280:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093755.771018:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 403 00000100:00100000:2.0:1784093755.771025:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013681280:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093755.771036:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013681152:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093755.771044:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 402 00000100:00100000:0.0:1784093755.771093:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013680896 00000100:00100000:0.0:1784093755.771100:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013680896 00000100:00080000:2.0:1784093755.771103:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093755.771109:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093755.771112:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093755.771146:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:0.0:1784093755.771155:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013680896:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093755.771187:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013680896:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 34us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093755.771195:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:3.0:1784093755.771352:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013681152:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 321us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093755.771363:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 403 00010000:00010000:2.0:1784093755.881688:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093756.340724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093756.340837:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681408 00000100:00100000:2.0:1784093756.340852:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681408 00000100:00100000:2.0:1784093756.340935:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 511 00000100:00100000:2.0:1784093756.340944:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013681408:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093756.341050:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013681408:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 107us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093756.341057:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 511 00000100:00100000:0.0:1784093756.343700:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093756.343770:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681536 00000100:00100000:3.0:1784093756.343780:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681536 00000100:00100000:3.0:1784093756.343835:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 248 00000100:00100000:3.0:1784093756.343844:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013681536:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093756.344238:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013681536:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 394us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093756.344263:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 248 00000100:00100000:0.0:1784093756.346814:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093756.346875:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681664 00000100:00100000:1.0:1784093756.346885:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681664 00000100:00100000:1.0:1784093756.346935:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 249 00000100:00100000:1.0:1784093756.346946:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013681664:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093756.347367:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013681664:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 422us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.347374:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 249 00000100:00100000:2.0:1784093756.348545:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093756.348656:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681792 00000100:00100000:1.0:1784093756.348662:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681792 00000100:00100000:1.0:1784093756.348723:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 512 00000100:00100000:1.0:1784093756.348732:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013681792:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093756.349029:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013681792:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 294us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.349043:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 512 00000100:00100000:0.0:1784093756.350726:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093756.350794:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013681920 00000100:00100000:1.0:1784093756.350805:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013681920 00000100:00100000:1.0:1784093756.350852:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00100000:1.0:1784093756.350861:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013681920:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093756.350950:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013681920:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.350958:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00100000:0.0:1784093756.351796:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093756.351853:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013682048 00000100:00100000:3.0:1784093756.351864:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013682048 00000100:00100000:3.0:1784093756.351906:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 250 00000100:00100000:3.0:1784093756.351914:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013682048:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093756.352220:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013682048:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 306us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093756.352228:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 250 00000100:00100000:2.0:1784093756.353020:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093756.353084:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013682176 00000100:00100000:3.0:1784093756.353090:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013682176 00000100:00100000:3.0:1784093756.353123:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 251 00000100:00100000:3.0:1784093756.353130:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013682176:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093756.353371:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:39586:x1870757013682176:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 242us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093756.353379:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 251 00000100:00100000:0.0:1784093756.354451:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093756.354505:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013682304 00000100:00100000:2.0:1784093756.354512:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013682304 00000100:00100000:2.0:1784093756.354553:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 514 00000100:00100000:2.0:1784093756.354562:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013682304:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093756.354885:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:39586:x1870757013682304:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 324us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093756.354893:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 514 00000100:00100000:0.0:1784093756.366941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093756.367086:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013682432 00000100:00100000:1.0:1784093756.367099:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013682432 00000100:00100000:1.0:1784093756.367153:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 515 00000100:00100000:1.0:1784093756.367162:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:39587:x1870757013682432:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093756.367182:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093756.367205:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf568f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.367272:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.367286:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.367301:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093756.367513:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00000004:00200000:1.0:1784093756.367517:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093756.367594:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.367627:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf568f expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.367649:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf568f expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.367659:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784093756.367662:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093756.367666:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784093756.368848:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:39587:x1870757013682432:12345-192.168.204.57@tcp:101:rm.0 Request processed in 578us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.368866:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 515 00000100:00100000:3.0:1784093756.371395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093756.371473:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013682688 00000100:00100000:1.0:1784093756.371484:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013682688 00000100:00100000:1.0:1784093756.371539:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 516 00000100:00100000:1.0:1784093756.371549:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:39587:x1870757013682688:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093756.371566:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093756.371807:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5696 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093756.372106:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 7680 00010000:00010000:1.0:1784093756.372328:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5696 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.372343:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093756.372346:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784093756.372358:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214c9e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5696 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093756.372375:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784093756.372447:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:39587:x1870757013682688:12345-192.168.204.57@tcp:101:rm.0 Request processed in 900us (1060us total) trans 4294967498 rc 301/301 00000100:00100000:1.0:1784093756.372454:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 516 00000100:00100000:0.0:1784093756.374697:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093756.374742:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013682816 00000100:00100000:1.0:1784093756.374750:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013682816 00000100:00100000:1.0:1784093756.374791:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 56 00000100:00100000:1.0:1784093756.374801:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:39587:x1870757013682816:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784093756.377924:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:39587:x1870757013682816:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3115us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.377939:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 56 00000100:00100000:3.0:1784093756.380626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093756.380758:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683072 00000100:00100000:2.0:1784093756.380768:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683072 00000100:00100000:2.0:1784093756.380818:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 57 00000100:00100000:2.0:1784093756.380827:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:39587:x1870757013683072:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784093756.381365:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:39587:x1870757013683072:12345-192.168.204.57@tcp:35:rm.0 Request processed in 537us (746us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1784093756.381372:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 57 00000100:00100000:0.0:1784093756.383348:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093756.383406:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683328 00000100:00100000:2.0:1784093756.383413:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683328 00000100:00100000:2.0:1784093756.383478:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 517 00000100:00100000:2.0:1784093756.383485:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:39587:x1870757013683328:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784093756.383531:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784093756.383560:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214c9e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf568f expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383579:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214c9e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf567a expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383587:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9a99) 00010000:00010000:2.0:1784093756.383592:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784093756.383603:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093756.383628:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383641:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383649:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383668:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383673:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383677:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383983:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383991:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.383998:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384130:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384136:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384141:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384145:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093756.384148:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384153:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384164:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093756.384165:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093756.384168:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384172:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214c9eba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384198:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384204:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384210:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384216:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093756.384219:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384225:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384231:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093756.384233:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093756.384236:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384242:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214c9eac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384263:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384269:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384276:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384281:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093756.384284:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384290:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384298:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff90721a781a00) 00010000:00010000:2.0:1784093756.384300:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093756.384302:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093756.384308:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214c9eb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093756.384374:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:39587:x1870757013683328:12345-192.168.204.57@tcp:36:rm.0 Request processed in 888us (1031us total) trans 0 rc -13/-13 00000100:00100000:2.0:1784093756.384381:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 517 00000100:00100000:3.0:1784093756.393661:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024225152:0@lo:400:kworker.0 00000100:00100000:0.0:1784093756.393677:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024225280:0@lo:400:kworker.0 00000100:00100000:2.0:1784093756.393690:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024225024:0@lo:400:kworker.0 00000100:00100000:0.0:1784093756.393796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093756.393870:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225280 00000100:00100000:0.0:1784093756.393876:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225280 00000100:00100000:1.0:1784093756.393913:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024224896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093756.393929:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1784093756.393941:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024225280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.393949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093756.393979:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024225408:0@lo:400:kworker.0 00000100:00100000:0.0:1784093756.394004:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024225280:12345-0@lo:400:kworker.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.394012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093756.394016:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1784093756.394049:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024224896 00000100:00100000:0.0:1784093756.394053:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024224896 00000100:00100000:1.0:1784093756.394054:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225408 00000100:00100000:1.0:1784093756.394060:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225408 00000100:00100000:1.0:1784093756.394107:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1784093756.394120:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093756.394120:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1784093756.394132:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024224896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093756.394163:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093756.394165:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024225408:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.394174:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1784093756.394210:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024224896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093756.394219:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1784093756.394223:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024224896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093756.394251:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024225280:0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.394257:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024225408:0@lo:400:kworker.0 00000100:00080000:1.0:1784093756.394297:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093756.394301:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093756.394304:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093756.394785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093756.394789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093756.394849:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225152 00000100:00100000:1.0:1784093756.394854:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225152 00000100:00100000:0.0:1784093756.394865:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225024 00000100:00100000:0.0:1784093756.394870:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225024 00000100:00100000:1.0:1784093756.394894:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1784093756.394904:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024225152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093756.394933:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1784093756.394951:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024225152:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093756.394959:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024225024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.394965:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1784093756.394983:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024225536:0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.395015:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024225152:0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.395032:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024225664:0@lo:400:kworker.0 00000100:00100000:2.0:1784093756.395125:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093756.395172:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024225024:12345-0@lo:400:kworker.0 Request processed in 230us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.395180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093756.395182:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1784093756.395212:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024225024:0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.395226:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225664 00000100:00100000:1.0:1784093756.395231:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225664 00000100:00100000:0.0:1784093756.395265:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225536 00000100:00100000:0.0:1784093756.395271:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225536 00000100:00100000:1.0:1784093756.395277:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1784093756.395286:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024225664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093756.395322:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1784093756.395330:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024225536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093756.395342:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024225664:12345-0@lo:400:kworker.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.395351:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00080000:3.0:1784093756.395356:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093756.395380:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024225536:12345-0@lo:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093756.395385:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024225664:0@lo:400:kworker.0 00000100:00100000:0.0:1784093756.395399:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1784093756.395487:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024225536:0@lo:400:kworker.0 00010000:00010000:1.0:1784093756.905576:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093757.006002:0:66643:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc27aa0f90 20000000:00000080:2.0:1784093757.006019:0:66643:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d997c00 uarg=0000000000000000 00010000:00010000:2.0:1784093757.008023:0:66643:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093757.008036:0:66643:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093757.008081:0:66643:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093757.008096:0:66643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008108:0:66643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008114:0:66643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008144:0:66643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008154:0:66643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 18 pid: 5772 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093757.008164:0:66643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66643:1870757024225792:0@lo:104: 00000100:00100000:2.0:1784093757.008223:0:66643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093757.008318:0:66643:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66780 going to sleep for 11 seconds 00000100:00100000:1.0:1784093757.008359:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784093757.008371:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225792 00000100:00100000:1.0:1784093757.008377:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225792 00000100:00100000:1.0:1784093757.008518:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784093757.008526:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:66643:x1870757024225792:12345-0@lo:104: 00010000:00010000:1.0:1784093757.008535:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.008592:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093757.008598:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:66643:x1870757024225792:12345-0@lo:104: Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093757.008604:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784093757.008607:0:66643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66643:1870757024225792:0@lo:104: 00010000:00010000:2.0:1784093757.008630:0:66643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.008667:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093757.008673:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.008678:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093757.008681:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.008686:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093757.008690:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093757.008694:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093757.008721:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.008727:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784093757.008760:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024225920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093757.008784:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093757.008787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784093757.008792:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214c9e19 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9e20 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.008805:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093757.008807:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093757.008809:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093757.008841:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024225920 00000100:00100000:2.0:1784093757.008846:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024225920 00010000:00010000:2.0:1784093757.008864:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 19 pid: 5772 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093757.008881:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784093757.008885:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024225920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093757.008892:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093757.008895:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 19 pid: 5772 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008901:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 19 pid: 5772 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008909:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214c9e20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9e19 expref: 19 pid: 5772 timeout: 1068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008917:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008922:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008929:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008933:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008946:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008950:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008953:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093757.008956:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008960:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008972:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093757.008981:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093757.008992:0:66643:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.009000:0:66643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.009007:0:66643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40000/0x9ce98053214c9ec1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093757.009012:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024225920:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093757.009019:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784093757.009047:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024225920:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784093757.369332:0:66691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe871709b0 20000000:00000080:1.0:1784093757.369346:0:66691:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3a7c00 uarg=0000000000000000 00010000:00010000:1.0:1784093757.369634:0:66691:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093757.369651:0:66691:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093757.369669:0:66691:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093757.369688:0:66691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369704:0:66691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369720:0:66691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369727:0:66691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369734:0:66691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369742:0:66691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369750:0:66691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093757.369754:0:66691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369762:0:66691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369774:0:66691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369781:0:66691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093757.369788:0:66691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214c9ec8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093757.740124:0:66739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7c082270 20000000:00000080:0.0:1784093757.740147:0:66739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e10a800 uarg=0000000000000000 00010000:00010000:0.0:1784093757.740367:0:66739:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093757.740383:0:66739:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093757.740402:0:66739:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093757.740484:0:66739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740501:0:66739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740512:0:66739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740519:0:66739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740527:0:66739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740533:0:66739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740539:0:66739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093757.740544:0:66739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740553:0:66739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740566:0:66739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740587:0:66739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093757.740594:0:66739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214c9ecf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093757.929620:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784093758.185668:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093758.185675:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093758.185680:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093758.185729:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093758.185740:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093758.185752:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093758.185777:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024226048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093758.185862:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093758.185926:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072103d3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784093758.185944:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226048 00000100:00100000:2.0:1784093758.185953:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226048 00000100:00100000:2.0:1784093758.186001:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1784093758.186012:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024226048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093758.186027:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093758.186052:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9ed6 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093758.186075:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093758.186092:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093758.186098:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784093758.186136:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024226048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093758.186143:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1784093758.186163:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024226048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093758.186177:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093758.186186:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093758.186202:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093758.186206:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093758.186211:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093758.441706:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093758.441802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093758.442001:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226176 00000100:00100000:0.0:1784093758.442015:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226176 00000100:00080000:3.0:1784093758.442095:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093758.442107:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784093758.442121:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093758.442159:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093758.442298:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093758.442306:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784093758.442389:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024226176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093758.953696:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093759.318593:0:66934:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbbb378d0 20000000:00000080:1.0:1784093759.318607:0:66934:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072375d4800 uarg=0000000000000000 00010000:00010000:1.0:1784093759.318769:0:66934:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093759.318785:0:66934:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093759.318799:0:66934:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093759.318815:0:66934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093759.318828:0:66934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093759.318834:0:66934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093759.318864:0:66934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093759.318878:0:66934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 18 pid: 5771 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093759.318893:0:66934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66934:1870757024226304:0@lo:104: 00000100:00100000:1.0:1784093759.318950:0:66934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093759.319037:0:66934:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784093759.319081:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226304 00000100:00100000:0.0:1784093759.319088:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226304 00000100:00100000:0.0:1784093759.319170:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784093759.319183:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:66934:x1870757024226304:12345-0@lo:104: 00010000:00010000:0.0:1784093759.319197:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093759.319256:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093759.319262:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:66934:x1870757024226304:12345-0@lo:104: Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093759.319269:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784093759.319278:0:66934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66934:1870757024226304:0@lo:104: 00010000:00010000:1.0:1784093759.319298:0:66934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093759.319308:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093759.319318:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093759.319328:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093759.319331:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093759.319341:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093759.319349:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093759.319354:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093759.319395:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093759.319413:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093759.319465:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093759.319472:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13e00/0x9ce98053214c9ed6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9edd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093759.319474:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093759.319489:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024226432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093759.319494:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093759.319498:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093759.319501:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093759.319521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093759.319615:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226432 00000100:00100000:3.0:1784093759.319620:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226432 00010000:00010000:3.0:1784093759.319637:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 19 pid: 5771 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093759.319664:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784093759.319670:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024226432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093759.319678:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093759.319682:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 19 pid: 5771 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319692:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 19 pid: 5771 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319703:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41200/0x9ce98053214c9edd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9ed6 expref: 19 pid: 5771 timeout: 1070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319713:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319720:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319729:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319746:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319759:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319764:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319768:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093759.319771:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319776:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319787:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093759.319794:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093759.319807:0:66934:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093759.319827:0:66934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093759.319829:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024226432:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (307us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093759.319842:0:66934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214c9ee4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093759.319847:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784093759.319849:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024226432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093759.978331:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093760.506690:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000001:00080000:1.0:1784093760.506756:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967499 is committed 00000100:00100000:2.0:1784093760.888569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093760.888654:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093760.888692:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093760.888719:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093760.888745:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683456 00000100:00100000:2.0:1784093760.888768:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683456 00000100:00100000:2.0:1784093760.888821:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:2.0:1784093760.888842:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013683456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093760.888911:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013683456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093760.888918:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:2.0:1784093760.888947:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683840 00000100:00100000:2.0:1784093760.888951:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683840 00000100:00100000:2.0:1784093760.888997:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683712 00000100:00100000:2.0:1784093760.889001:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683712 00000100:00100000:0.0:1784093760.889017:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 406 00000100:00100000:0.0:1784093760.889036:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013683840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093760.889065:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013683840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093760.889696:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 407 00000100:00100000:2.0:1784093760.889711:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013683712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093760.889740:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013683712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 32us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093760.889746:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 407 00000100:00080000:3.0:1784093760.889889:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093760.889893:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093760.890079:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 406 00000100:00100000:1.0:1784093760.890154:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683584 00000100:00100000:1.0:1784093760.890161:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683584 00000100:00100000:1.0:1784093760.890211:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 599 00000100:00100000:1.0:1784093760.890219:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013683584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093760.890258:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013683584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093760.890264:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 599 00000100:00080000:3.0:1784093760.890463:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784093761.001518:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784093761.323248:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093761.323256:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093761.323261:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093761.323309:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093761.323321:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093761.323332:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093761.323359:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024226560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093761.323480:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093761.323553:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784093761.325048:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226560 00000100:00100000:2.0:1784093761.325060:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226560 00000100:00100000:2.0:1784093761.325122:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1784093761.325134:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024226560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093761.325150:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093761.325168:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9eeb expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093761.325195:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093761.325207:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093761.325216:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093761.325289:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024226560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093761.325297:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1784093761.325335:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024226560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093761.325355:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093761.325366:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093761.325390:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093761.325396:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093761.325405:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093761.513599:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024226944:0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.513599:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024227072:0@lo:400:kworker.0 00000100:00100000:3.0:1784093761.513610:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024226688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093761.513685:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093761.513685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093761.513686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093761.513733:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024227328:0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.513743:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784093761.513753:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024226816:0@lo:400:kworker.0 00000100:00100000:2.0:1784093761.513758:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227072 00000100:00100000:3.0:1784093761.513761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093761.513766:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227072 00000100:00100000:1.0:1784093761.513800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093761.513812:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227328 00000100:00100000:3.0:1784093761.513817:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227328 00000100:00100000:1.0:1784093761.513826:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024227200:0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.513850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093761.513874:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1784093761.513877:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226688 00000100:00100000:1.0:1784093761.513882:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226688 00000100:00100000:3.0:1784093761.513887:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024227328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.513915:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1784093761.513924:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024226688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093761.513954:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024227328:12345-0@lo:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00002000:00000024:1.0:1784093761.513960:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093761.513965:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1784093761.513987:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1784093761.513998:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024227072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093761.514006:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226944 00000100:00100000:3.0:1784093761.514012:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226944 00000100:00100000:1.0:1784093761.514014:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024226688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093761.514023:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1784093761.514058:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024227072:12345-0@lo:400:kworker.0 Request processed in 62us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093761.514058:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024226816 00000100:00100000:3.0:1784093761.514060:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227200 00000100:00100000:1.0:1784093761.514064:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024226816 00000100:00100000:3.0:1784093761.514067:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227200 00000100:00100000:2.0:1784093761.514071:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1784093761.514102:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1784093761.514109:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1784093761.514114:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024226944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093761.514122:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024226816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.514162:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024226944:12345-0@lo:400:kworker.0 Request processed in 52us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093761.514169:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024226816:12345-0@lo:400:kworker.0 Request processed in 49us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093761.514178:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1784093761.514184:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1784093761.514192:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024227200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093761.514192:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00080000:1.0:1784093761.514223:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093761.514228:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093761.514230:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093761.514235:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024227200:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093761.514242:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1784093761.514281:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024226688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093761.514293:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024227328:0@lo:400:kworker.0 00000100:00100000:2.0:1784093761.514337:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024226944:0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.514346:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024226816:0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.514362:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024227200:0@lo:400:kworker.0 00000100:00100000:1.0:1784093761.514372:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024227072:0@lo:400:kworker.0 00010000:00010000:3.0:1784093762.026016:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093763.049988:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784093763.320081:0:67278:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 18: test nodemap mapped_noadmin fileops ========================================================== 01:36:02 (1784093762) 00000100:00100000:3.0:1784093763.562664:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093763.562685:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024227456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093763.562748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093763.562806:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227456 00000100:00100000:3.0:1784093763.562813:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227456 00000100:00100000:3.0:1784093763.562864:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784093763.562874:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024227456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093763.562918:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093763.562980:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024227456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093763.562989:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1784093763.563003:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093763.563051:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024227456:0@lo:13:osp-pre-0-0.0 00000004:00000400:2.0:1784093763.840728:0:67326:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1784093763.844474:0:67326:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1784093764.074195:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093764.248306:0:67375:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3d3e73b0 20000000:00000080:0.0:1784093764.248322:0:67375:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e10b000 uarg=0000000000000000 10000000:01000000:0.0:1784093764.249019:0:67375:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093764.249036:0:67375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093764.249050:0:67375:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093764.249059:0:67375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093764.249100:0:67375:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093764.249114:0:67375:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 18 pid: 5771 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093764.249128:0:67375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67375:1870757024227584:0@lo:104: 00000100:00100000:0.0:1784093764.249189:0:67375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093764.249309:0:67375:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14b600 going to sleep for 11 seconds 00000100:00100000:3.0:1784093764.249396:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227584 00000100:00100000:3.0:1784093764.249404:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227584 00000100:00100000:3.0:1784093764.249572:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1784093764.249582:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:67375:x1870757024227584:12345-0@lo:104: 00010000:00010000:3.0:1784093764.249596:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.249693:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093764.249701:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:67375:x1870757024227584:12345-0@lo:104: Request processed in 121us (512us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093764.249704:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784093764.249710:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00010000:1.0:1784093764.249714:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.249731:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093764.249734:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.249751:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093764.249757:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093764.249761:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:0.0:1784093764.249769:0:67375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67375:1870757024227584:0@lo:104: 00010000:00010000:0.0:1784093764.249790:0:67375:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.249795:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.249812:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093764.249849:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.249858:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12200/0x9ce98053214c9eeb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9ef2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.249875:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093764.249877:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093764.249879:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093764.249904:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024227712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093764.249945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093764.250022:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227712 00000100:00100000:2.0:1784093764.250027:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227712 00010000:00010000:2.0:1784093764.250049:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 19 pid: 5771 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093764.250081:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784093764.250088:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024227712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093764.250098:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093764.250103:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 19 pid: 5771 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250113:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 19 pid: 5771 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250126:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40a00/0x9ce98053214c9ef2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9eeb expref: 19 pid: 5771 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250147:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250157:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250171:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250178:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250184:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250190:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250195:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093764.250199:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250206:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250228:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093764.250240:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093764.250273:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024227712:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093764.250289:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784093764.250318:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024227712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093764.250364:0:67375:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.250373:0:67375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093764.250380:0:67375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214c9ef9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093764.626241:0:67423:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef2400d60 20000000:00000080:3.0:1784093764.626261:0:67423:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b7d400 uarg=0000000000000000 10000000:01000000:3.0:1784093764.626668:0:67423:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093764.626692:0:67423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626708:0:67423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626718:0:67423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626732:0:67423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626739:0:67423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626746:0:67423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626752:0:67423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093764.626756:0:67423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626763:0:67423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626777:0:67423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626785:0:67423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093764.626790:0:67423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f00 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093765.010130:0:67471:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebc5a4c90 20000000:00000080:0.0:1784093765.010146:0:67471:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072373d7c00 uarg=0000000000000000 10000000:01000000:0.0:1784093765.010334:0:67471:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093765.010358:0:67471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010374:0:67471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010386:0:67471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010393:0:67471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010400:0:67471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010407:0:67471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010414:0:67471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093765.010418:0:67471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010450:0:67471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010463:0:67471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010478:0:67471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.010483:0:67471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214c9f07 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.097672:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093765.365044:0:67519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc718735c0 20000000:00000080:3.0:1784093765.365061:0:67519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b7c800 uarg=0000000000000000 10000000:01000000:3.0:1784093765.365246:0:67519:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093765.365267:0:67519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365289:0:67519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365300:0:67519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365307:0:67519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365314:0:67519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365321:0:67519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365328:0:67519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093765.365332:0:67519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365340:0:67519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365351:0:67519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365358:0:67519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093765.365364:0:67519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f0e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093765.700780:0:67568:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe264958f0 20000000:00000080:0.0:1784093765.700794:0:67568:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072373d4800 uarg=0000000000000000 10000000:01000000:0.0:1784093765.701203:0:67568:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093765.701224:0:67568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701239:0:67568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701250:0:67568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701257:0:67568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701264:0:67568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701271:0:67568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701277:0:67568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093765.701282:0:67568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701300:0:67568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701315:0:67568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701324:0:67568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.701330:0:67568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214c9f15 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093765.994178:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093765.994187:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093765.994192:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093765.994251:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093765.994264:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093765.994277:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093765.994314:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024227840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093765.994387:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093765.994499:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b935900 going to sleep for 11 seconds 00000100:00100000:0.0:1784093765.994583:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227840 00000100:00100000:0.0:1784093765.994591:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227840 00000100:00100000:0.0:1784093765.994647:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1784093765.994657:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024227840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093765.994672:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093765.994685:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9f1c expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.994708:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.994718:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093765.994726:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784093765.994774:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024227840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093765.994797:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1784093765.994805:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024227840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093765.994837:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093765.994846:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093765.994867:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093765.994872:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093765.994903:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093766.008790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093766.008837:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093766.008862:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013683968 00000100:00100000:2.0:1784093766.008874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093766.008877:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013683968 00000100:00100000:0.0:1784093766.008922:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684224 00000100:00100000:0.0:1784093766.008927:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684224 00000100:00100000:2.0:1784093766.008929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093766.008965:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:3.0:1784093766.008978:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013683968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093766.008978:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684352 00000100:00100000:0.0:1784093766.008984:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684352 00000100:00100000:2.0:1784093766.008995:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 410 00000100:00100000:2.0:1784093766.009007:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013684224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093766.009015:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 411 00000100:00100000:0.0:1784093766.009027:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013684352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093766.009054:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013683968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093766.009060:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:1.0:1784093766.009108:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684096 00000100:00100000:1.0:1784093766.009125:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684096 00000100:00100000:1.0:1784093766.009170:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 603 00000100:00100000:1.0:1784093766.009179:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013684096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093766.009650:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013684352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 625us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093766.009654:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013684096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 473us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093766.009671:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 411 00000100:00100000:2.0:1784093766.009675:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013684224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 654us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093766.009675:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 603 00000100:00100000:2.0:1784093766.009697:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 410 00000100:00080000:0.0:1784093766.009710:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093766.009719:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093766.009722:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1784093766.080151:0:67616:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd651b9870 20000000:00000080:3.0:1784093766.080164:0:67616:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e108400 uarg=0000000000000000 10000000:01000000:3.0:1784093766.080348:0:67616:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093766.080368:0:67616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.080386:0:67616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.080396:0:67616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.080456:0:67616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.080468:0:67616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 18 pid: 5770 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093766.080480:0:67616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67616:1870757024227968:0@lo:104: 00000100:00100000:3.0:1784093766.080532:0:67616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093766.080576:0:67616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1784093766.080644:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024227968 00000100:00100000:0.0:1784093766.080650:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024227968 00000100:00100000:0.0:1784093766.080686:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784093766.080692:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:67616:x1870757024227968:12345-0@lo:104: 00010000:00010000:0.0:1784093766.080702:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093766.080750:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093766.080754:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:67616:x1870757024227968:12345-0@lo:104: Request processed in 63us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093766.080759:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784093766.080812:0:67616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67616:1870757024227968:0@lo:104: 00010000:00010000:3.0:1784093766.080826:0:67616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093766.080897:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093766.080905:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093766.080913:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093766.080916:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093766.080925:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093766.080931:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093766.080937:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093766.080979:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093766.080986:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093766.081013:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093766.081021:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214c9f1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093766.081039:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093766.081039:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024228096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093766.081043:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093766.081047:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093766.081072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093766.081095:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228096 00000100:00100000:3.0:1784093766.081101:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228096 00010000:00010000:3.0:1784093766.081119:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 19 pid: 5770 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093766.081143:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1784093766.081149:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024228096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093766.081159:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093766.081164:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 19 pid: 5770 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081174:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 19 pid: 5770 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081186:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214c9f23 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9f1c expref: 19 pid: 5770 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081197:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081206:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081228:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081235:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081247:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081254:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081260:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093766.081264:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081270:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081293:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093766.081301:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093766.081332:0:67616:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093766.081343:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024228096:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093766.081353:0:67616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093766.081358:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00010000:0.0:1784093766.081366:0:67616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214c9f2a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093766.081373:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710196ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024228096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093766.121659:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093766.633676:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024228224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093766.633694:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024228352:0@lo:400:kworker.0 00000100:00100000:1.0:1784093766.633845:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024228480:0@lo:400:kworker.0 00000100:00100000:0.0:1784093766.633906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093766.633916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093766.633975:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024228864:0@lo:400:kworker.0 00000100:00100000:3.0:1784093766.633989:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228352 00000100:00100000:3.0:1784093766.633998:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228352 00000100:00100000:2.0:1784093766.634010:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024228736:0@lo:400:kworker.0 00000100:00100000:0.0:1784093766.634022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093766.634070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093766.634076:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1784093766.634092:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024228352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093766.634095:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228224 00000100:00100000:0.0:1784093766.634104:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228224 00000100:00100000:2.0:1784093766.634135:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228736 00000100:00100000:2.0:1784093766.634144:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228736 00000100:00100000:0.0:1784093766.634161:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784093766.634177:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024228352:12345-0@lo:400:kworker.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093766.634178:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024228224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093766.634192:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1784093766.634204:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00002000:00000024:0.0:1784093766.634216:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093766.634218:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710196ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024228736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093766.634259:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228864 00000100:00100000:0.0:1784093766.634277:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024228224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093766.634279:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228864 00000100:00100000:2.0:1784093766.634289:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710196ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024228736:12345-0@lo:400:kworker.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093766.634290:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1784093766.634306:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1784093766.634319:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1784093766.634321:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024228608:0@lo:400:kworker.0 00000100:00100000:3.0:1784093766.634339:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024228864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093766.634370:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093766.634394:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024228736:0@lo:400:kworker.0 00000100:00100000:1.0:1784093766.634409:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093766.634474:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024228224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093766.634514:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228480 00000100:00100000:1.0:1784093766.634519:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228480 00000100:00100000:2.0:1784093766.634529:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228608 00000100:00100000:1.0:1784093766.634549:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1784093766.634550:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228608 00000100:00100000:1.0:1784093766.634556:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024228480:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093766.634577:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093766.634584:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093766.634586:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093766.634603:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024228480:12345-0@lo:400:kworker.0 Request processed in 44us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093766.634611:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1784093766.634613:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1784093766.634626:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024228608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093766.634671:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024228608:12345-0@lo:400:kworker.0 Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093766.634685:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1784093766.634691:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024228480:0@lo:400:kworker.0 00000100:00100000:2.0:1784093766.634716:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024228608:0@lo:400:kworker.0 00000100:00100000:1.0:1784093766.634751:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024228352:0@lo:400:kworker.0 00000100:00100000:3.0:1784093766.634937:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024228864:12345-0@lo:400:kworker.0 Request processed in 608us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093766.634944:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1784093766.635013:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024228864:0@lo:400:kworker.0 00010000:00010000:1.0:1784093767.145635:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784093767.210495:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093767.210502:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093767.210507:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093767.210549:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093767.210566:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093767.210578:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093767.210602:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024228992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093767.210666:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093767.210712:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072374da300 going to sleep for 11 seconds 00000100:00100000:0.0:1784093767.210720:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024228992 00000100:00100000:0.0:1784093767.210729:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024228992 00000100:00100000:0.0:1784093767.210796:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1784093767.210807:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024228992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093767.210831:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093767.210846:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9f31 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.210887:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.210898:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.210908:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784093767.210954:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024228992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093767.210961:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1784093767.210995:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024228992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093767.211013:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093767.211022:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093767.211041:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093767.211045:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093767.211052:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093767.227551:0:67763:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4cdcea40 20000000:00000080:2.0:1784093767.227567:0:67763:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103874400 uarg=0000000000000000 10000000:01000000:2.0:1784093767.227757:0:67763:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093767.227776:0:67763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093767.227794:0:67763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093767.227803:0:67763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093767.227839:0:67763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093767.227853:0:67763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 18 pid: 5770 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093767.227880:0:67763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67763:1870757024229120:0@lo:104: 00000100:00100000:2.0:1784093767.227939:0:67763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093767.227983:0:67763:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2540 going to sleep for 11 seconds 00000100:00100000:3.0:1784093767.227988:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229120 00000100:00100000:3.0:1784093767.227997:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229120 00000100:00100000:3.0:1784093767.228046:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1784093767.228056:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:67763:x1870757024229120:12345-0@lo:104: 00010000:00010000:3.0:1784093767.228074:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228146:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093767.228151:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:67763:x1870757024229120:12345-0@lo:104: Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093767.228156:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00010000:0.0:1784093767.228205:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093767.228213:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.228222:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093767.228227:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.228236:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093767.228248:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093767.228252:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1784093767.228257:0:67763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67763:1870757024229120:0@lo:104: 00010000:00010000:2.0:1784093767.228277:0:67763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.228287:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.228296:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093767.228317:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093767.228325:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214c9f31 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093767.228329:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024229248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093767.228342:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093767.228345:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093767.228346:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093767.228370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093767.228447:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229248 00000100:00100000:3.0:1784093767.228452:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229248 00010000:00010000:3.0:1784093767.228474:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 19 pid: 5770 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093767.228504:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784093767.228514:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024229248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093767.228525:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093767.228535:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 19 pid: 5770 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228548:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 19 pid: 5770 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228567:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214c9f38 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9f31 expref: 19 pid: 5770 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228580:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228588:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228599:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228606:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228613:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228619:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228625:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093767.228628:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228641:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228662:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093767.228674:0:67763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093767.228689:0:67763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.228691:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093767.228704:0:67763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214c9f3f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093767.228728:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024229248:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093767.228736:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784093767.228825:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024229248:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784093767.572029:0:67811:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7ccdb520 20000000:00000080:3.0:1784093767.572048:0:67811:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071031c9000 uarg=0000000000000000 10000000:01000000:3.0:1784093767.572246:0:67811:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093767.572271:0:67811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572287:0:67811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572298:0:67811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572305:0:67811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572313:0:67811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572320:0:67811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572326:0:67811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093767.572331:0:67811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572340:0:67811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572359:0:67811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572367:0:67811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093767.572372:0:67811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214c9f46 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093768.169585:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093768.681581:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093768.681587:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093768.681592:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00000100:00100000:2.0:1784093768.681607:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024229376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093768.681624:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093768.681639:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093768.681651:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093768.681668:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024229504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093768.681715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093768.681740:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093768.681779:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229376 00000100:00100000:1.0:1784093768.681788:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229376 00000100:00100000:3.0:1784093768.681816:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8480 going to sleep for 11 seconds 00000100:00100000:1.0:1784093768.681868:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1784093768.681880:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024229376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093768.681919:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093768.682001:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229504 00000100:00100000:2.0:1784093768.682009:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229504 00000100:00080000:3.0:1784093768.682011:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093768.682021:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024229376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093768.682031:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784093768.682092:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1784093768.682097:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024229376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093768.682106:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024229504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093768.682130:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093768.682158:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9f4d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093768.682193:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093768.682209:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093768.682222:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093768.682276:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024229504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093768.682285:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1784093768.682293:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024229504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093768.682313:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093768.682334:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093768.682356:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093768.682362:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093768.682369:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093769.062177:0:68006:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed87f5460 20000000:00000080:1.0:1784093769.062196:0:68006:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90710282bc00 uarg=0000000000000000 00010000:00010000:1.0:1784093769.062445:0:68006:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093769.062463:0:68006:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093769.062480:0:68006:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093769.062499:0:68006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093769.062514:0:68006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093769.062523:0:68006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093769.062562:0:68006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093769.062573:0:68006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 18 pid: 5771 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093769.062585:0:68006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68006:1870757024229632:0@lo:104: 00000100:00100000:1.0:1784093769.062646:0:68006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093769.062699:0:68006:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784093769.062719:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229632 00000100:00100000:0.0:1784093769.062727:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229632 00000100:00100000:0.0:1784093769.062782:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784093769.062792:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:68006:x1870757024229632:12345-0@lo:104: 00010000:00010000:0.0:1784093769.062806:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093769.062893:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093769.062901:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:68006:x1870757024229632:12345-0@lo:104: Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093769.062907:0:68006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230dc6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68006:1870757024229632:0@lo:104: 00000100:00100000:0.0:1784093769.062912:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00010000:1.0:1784093769.062931:0:68006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093769.063659:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093769.063675:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093769.063695:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093769.063699:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093769.063707:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093769.063715:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093769.063721:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093769.063755:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093769.063762:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093769.063788:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093769.063795:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214c9f4d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093769.063812:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093769.063815:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093769.063816:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1784093769.063819:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093769.063840:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024229760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093769.063875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093769.063921:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229760 00000100:00100000:3.0:1784093769.063927:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229760 00010000:00010000:3.0:1784093769.063949:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 19 pid: 5771 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093769.063976:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784093769.063983:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024229760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093769.063993:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093769.063999:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 19 pid: 5771 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064009:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 19 pid: 5771 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064021:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214c9f54 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9f4d expref: 19 pid: 5771 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064044:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064058:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064072:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064080:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064087:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064094:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064100:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093769.064104:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064111:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064139:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093769.064149:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093769.064157:0:68006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093769.064168:0:68006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093769.064176:0:68006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12200/0x9ce98053214c9f5b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093769.064209:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024229760:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093769.064217:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1784093769.064231:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024229760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093769.193741:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093770.218950:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093770.502109:0:68201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd19b5b740 20000000:00000080:3.0:1784093770.502126:0:68201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df7800 uarg=0000000000000000 00010000:00010000:3.0:1784093770.502350:0:68201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093770.502361:0:68201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093770.502371:0:68201:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093770.502392:0:68201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502408:0:68201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502419:0:68201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502481:0:68201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502487:0:68201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502491:0:68201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502495:0:68201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093770.502498:0:68201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502503:0:68201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502513:0:68201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502526:0:68201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093770.502531:0:68201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214c9f62 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093770.844662:0:68250:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0c8cefc0 20000000:00000080:1.0:1784093770.844679:0:68250:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072054d8000 uarg=0000000000000000 00010000:00010000:1.0:1784093770.845154:0:68250:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093770.845168:0:68250:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093770.845181:0:68250:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093770.845200:0:68250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845215:0:68250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845237:0:68250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845243:0:68250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845250:0:68250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845258:0:68250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845264:0:68250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093770.845267:0:68250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845274:0:68250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845285:0:68250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845293:0:68250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.845298:0:68250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f69 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093770.857495:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093770.857502:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093770.857508:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093770.857556:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.857565:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.857574:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093770.857593:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024229888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093770.857646:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093770.857680:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024229888 00000100:00100000:0.0:1784093770.857686:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024229888 00000100:00100000:1.0:1784093770.857689:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907225ccb840 going to sleep for 11 seconds 00000100:00100000:0.0:1784093770.857733:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1784093770.857741:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024229888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093770.857752:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093770.857763:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9f70 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093770.857783:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093770.857805:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093770.857822:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784093770.857870:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024229888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093770.857878:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1784093770.857904:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024229888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093770.857918:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.857925:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093770.857940:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784093770.857944:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093770.857952:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093771.131491:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093771.131533:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093771.131572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093771.131610:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684480 00000100:00100000:2.0:1784093771.131628:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684480 00000100:00100000:1.0:1784093771.131638:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093771.131650:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684608 00000100:00100000:0.0:1784093771.131656:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684864 00000100:00100000:0.0:1784093771.131662:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684864 00000100:00100000:3.0:1784093771.131663:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684608 00000100:00100000:1.0:1784093771.131702:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684736 00000100:00100000:1.0:1784093771.131713:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684736 00000100:00100000:2.0:1784093771.131746:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 652 00000100:00100000:0.0:1784093771.131761:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 414 00000100:00100000:3.0:1784093771.131762:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:2.0:1784093771.131774:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013684480:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093771.131803:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013684864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093771.131804:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013684608:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093771.131903:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 415 00000100:00100000:0.0:1784093771.131910:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013684864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 126us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093771.131919:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013684736:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093771.131922:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 414 00000100:00100000:2.0:1784093771.132370:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013684480:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 610us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093771.132384:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013684736:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 459us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093771.132388:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013684608:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 598us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093771.132401:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 652 00000100:00100000:1.0:1784093771.132410:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 415 00000100:00100000:3.0:1784093771.132417:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00080000:3.0:1784093771.132470:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093771.132477:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093771.132480:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784093771.241706:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093771.753594:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024230144:0@lo:400:kworker.0 00000100:00100000:1.0:1784093771.753614:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024230272:0@lo:400:kworker.0 00000100:00100000:1.0:1784093771.753673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093771.753693:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024230016:0@lo:400:kworker.0 00000100:00100000:1.0:1784093771.753738:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093771.753745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093771.753790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093771.753793:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024230528:0@lo:400:kworker.0 00000100:00100000:3.0:1784093771.753796:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230272 00000100:00100000:3.0:1784093771.753803:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230272 00000100:00100000:0.0:1784093771.753824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093771.753850:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093771.753854:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230016 00000100:00100000:0.0:1784093771.753857:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024230400:0@lo:400:kworker.0 00000100:00100000:1.0:1784093771.753860:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230016 00000100:00100000:3.0:1784093771.753863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230528 00000100:00100000:3.0:1784093771.753868:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230528 00000100:00100000:0.0:1784093771.753887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093771.753898:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1784093771.753908:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093771.753919:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230784 00000100:00100000:0.0:1784093771.753922:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230784 00000100:00100000:0.0:1784093771.753954:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784093771.753960:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024230784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093771.753962:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024230272:12345-0@lo:400:kworker.0 Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093771.753969:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1784093771.753985:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00002000:00000024:0.0:1784093771.753988:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093771.753990:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024230528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093771.754023:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024230528:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093771.754023:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024230784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093771.754030:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1784093771.754031:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00080000:3.0:1784093771.754047:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093771.754051:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093771.754053:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230400 00000100:00100000:0.0:1784093771.754057:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230400 00000100:00100000:1.0:1784093771.754065:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1784093771.754079:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024230016:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093771.754087:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093771.754088:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1784093771.754097:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024230400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093771.754121:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024230016:12345-0@lo:400:kworker.0 Request processed in 46us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093771.754130:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1784093771.754139:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024230400:12345-0@lo:400:kworker.0 Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093771.754146:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1784093771.754188:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024230272:0@lo:400:kworker.0 00000100:00100000:0.0:1784093771.754233:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024230400:0@lo:400:kworker.0 00000100:00100000:0.0:1784093771.754239:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024230016:0@lo:400:kworker.0 00000100:00100000:0.0:1784093771.754245:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024230528:0@lo:400:kworker.0 00000100:00100000:2.0:1784093771.754298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093771.754306:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024230784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093771.754332:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024230656:0@lo:400:kworker.0 00000100:00100000:3.0:1784093771.754339:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230144 00000100:00100000:3.0:1784093771.754343:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230144 00000100:00100000:2.0:1784093771.754369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093771.754440:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230656 00000100:00100000:3.0:1784093771.754450:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1784093771.754451:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230656 00000100:00100000:3.0:1784093771.754461:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024230144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093771.754513:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024230144:12345-0@lo:400:kworker.0 Request processed in 55us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093771.754520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1784093771.754534:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1784093771.754543:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024230656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093771.754558:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024230144:0@lo:400:kworker.0 00000100:00100000:1.0:1784093771.754588:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024230656:12345-0@lo:400:kworker.0 Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093771.754593:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1784093771.754598:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024230656:0@lo:400:kworker.0 00010000:00010000:2.0:1784093772.265614:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093773.057911:0:68542:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6ab43a60 20000000:00000080:2.0:1784093773.057924:0:68542:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103875400 uarg=0000000000000000 00010000:00010000:2.0:1784093773.058099:0:68542:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093773.058109:0:68542:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093773.058119:0:68542:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093773.058134:0:68542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093773.058147:0:68542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093773.058153:0:68542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093773.058184:0:68542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093773.058193:0:68542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 18 pid: 5770 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093773.058213:0:68542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68542:1870757024230912:0@lo:104: 00000100:00100000:2.0:1784093773.058268:0:68542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093773.058321:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024230912 00000100:00100000:2.0:1784093773.058328:0:68542:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784093773.058329:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024230912 00000100:00100000:3.0:1784093773.058392:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1784093773.058408:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:68542:x1870757024230912:12345-0@lo:104: 00010000:00010000:3.0:1784093773.058452:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058516:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093773.058524:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:68542:x1870757024230912:12345-0@lo:104: Request processed in 119us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093773.058532:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784093773.058536:0:68542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68542:1870757024230912:0@lo:104: 00010000:00010000:2.0:1784093773.058559:0:68542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.058605:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093773.058612:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.058621:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093773.058625:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.058634:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093773.058642:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093773.058648:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093773.058684:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.058691:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093773.058716:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.058724:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13a00/0x9ce98053214c9f70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9f77 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093773.058737:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024231040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093773.058741:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093773.058745:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093773.058765:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093773.058794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093773.058829:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231040 00000100:00100000:3.0:1784093773.058834:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231040 00010000:00010000:3.0:1784093773.058852:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 19 pid: 5770 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093773.058878:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784093773.058886:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024231040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093773.058896:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093773.058902:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 19 pid: 5770 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058913:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 19 pid: 5770 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058925:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77200/0x9ce98053214c9f77 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9f70 expref: 19 pid: 5770 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058937:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058945:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058957:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058964:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058971:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.058997:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.059003:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093773.059007:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.059014:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.059030:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093773.059039:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093773.059050:0:68542:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093773.059060:0:68542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093773.059067:0:68542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41a00/0x9ce98053214c9f7e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093773.059072:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024231040:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093773.059084:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1784093773.059097:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723749ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024231040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093773.289815:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093773.382251:0:68590:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4e859f90 20000000:00000080:1.0:1784093773.382269:0:68590:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b7d400 uarg=0000000000000000 00010000:00010000:1.0:1784093773.382547:0:68590:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093773.382630:0:68590:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093773.382647:0:68590:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093773.382666:0:68590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382681:0:68590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382692:0:68590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382699:0:68590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382706:0:68590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382714:0:68590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382721:0:68590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093773.382725:0:68590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382734:0:68590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382755:0:68590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382771:0:68590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093773.382777:0:68590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214c9f85 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093773.801592:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024231168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093773.801652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093773.801709:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231168 00000100:00100000:1.0:1784093773.801717:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231168 00000100:00080000:3.0:1784093773.801762:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093773.801796:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784093773.801809:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024231168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093773.801848:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093773.801906:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024231168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093773.801913:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1784093773.802187:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024231168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093774.313671:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093774.632862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093774.632934:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013684992 00000100:00100000:0.0:1784093774.632944:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013684992 00000100:00100000:0.0:1784093774.633066:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 518 00000100:00100000:0.0:1784093774.633078:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:40813:x1870757013684992:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093774.633098:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093774.633121:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf569d expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.633184:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9f93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.633198:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.633213:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093774.633398:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784093774.633403:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093774.633545:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9f93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.633570:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214c9f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf569d expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.633587:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9f93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf569d expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.633606:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784093774.633610:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093774.633613:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784093774.633669:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:40813:x1870757013684992:12345-192.168.204.57@tcp:101:rm.0 Request processed in 593us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093774.633677:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 518 00000100:00080000:3.0:1784093774.633766:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093774.635947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093774.635999:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013685120 00000100:00100000:3.0:1784093774.636007:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013685120 00000100:00100000:3.0:1784093774.636053:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 519 00000100:00100000:3.0:1784093774.636063:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:40813:x1870757013685120:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093774.636079:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093774.636094:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9f9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56a4 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636147:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636156:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636164:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636175:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636182:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636189:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636407:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636415:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636458:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636467:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093774.636473:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636498:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636514:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:3.0:1784093774.636518:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093774.636523:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636534:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214c9fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636547:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636554:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636560:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636565:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093774.636567:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636571:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636576:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907204fcec00) 00010000:00010000:3.0:1784093774.636577:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093774.636579:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636590:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636612:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9f9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56a4 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636619:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:3.0:1784093774.636621:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093774.636623:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56a4 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.636629:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784093774.636672:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:40813:x1870757013685120:12345-192.168.204.57@tcp:101:rm.0 Request processed in 612us (734us total) trans 0 rc 301/301 00000100:00100000:3.0:1784093774.636677:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 519 00000100:00100000:1.0:1784093774.659017:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093774.659140:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093774.659296:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013685248 00000100:00100000:3.0:1784093774.659307:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013685248 00000100:00100000:2.0:1784093774.659361:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013685504 00000100:00100000:2.0:1784093774.659374:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013685504 00000100:00100000:3.0:1784093774.659382:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 520 00000100:00100000:3.0:1784093774.659395:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013685248:12345-192.168.204.57@tcp:41:mkdir.0 00000100:00100000:1.0:1784093774.659492:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:1.0:1784093774.659511:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:40817:x1870757013685504:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:1.0:1784093774.659548:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093774.659574:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214c9f93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf569d expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.659597:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:1.0:1784093774.659612:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093774.659907:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.659932:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.659942:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.659954:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.659961:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.659967:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000024:3.0:1784093774.660389:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784093774.660480:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723749ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013685248:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 1088us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093774.660489:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 520 00000004:00200000:1.0:1784093774.660958:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00010000:00010000:1.0:1784093774.660968:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.660975:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.660982:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.660988:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093774.660992:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.660999:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.661018:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093774.661021:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093774.661025:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.661031:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9faf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093774.661046:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000047f6e3f9 reply state 00000000562d780b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093774.661055:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093774.661112:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:40817:x1870757013685504:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1609us (1970us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1784093774.661119:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 521 00010000:00010000:3.0:1784093774.662123:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.662140:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.662163:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.662170:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093774.662174:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.662182:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.662208:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907219c12000) 00010000:00010000:3.0:1784093774.662212:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093774.662217:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.662223:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214c9fb6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093774.691189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093774.691358:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013685632 00000100:00100000:3.0:1784093774.691373:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013685632 00000100:00100000:3.0:1784093774.691480:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 522 00000100:00100000:3.0:1784093774.691492:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226373850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:40821:x1870757013685632:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784093774.691518:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093774.691553:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56ab expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.691617:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.691654:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.691672:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093774.691748:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093774.691754:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093774.691780:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.691803:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214c9fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ab expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.691822:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ab expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.691831:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093774.691834:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093774.691838:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784093774.691894:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226373850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:40821:x1870757013685632:12345-192.168.204.57@tcp:101:chown.0 Request processed in 405us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093774.691902:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 522 00000100:00100000:1.0:1784093774.695063:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093774.695180:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013685760 00000100:00100000:2.0:1784093774.695187:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013685760 00000100:00100000:2.0:1784093774.695272:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 523 00000100:00100000:2.0:1784093774.695282:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:40821:x1870757013685760:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093774.695312:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093774.695330:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c9fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56b2 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695399:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695414:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695457:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695474:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695481:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695488:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695582:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695590:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695597:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093774.695632:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:2.0:1784093774.695642:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093774.695670:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695681:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695685:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695690:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695694:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093774.695697:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695701:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695709:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:2.0:1784093774.695711:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093774.695714:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695717:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214c9fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695741:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695750:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695767:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695773:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093774.695776:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695783:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695791:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781000) 00010000:00010000:2.0:1784093774.695792:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093774.695794:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695798:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214c9fd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695822:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214c9fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56b2 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695834:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56b2 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093774.695840:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093774.695843:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093774.695845:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784093774.695900:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:40821:x1870757013685760:12345-192.168.204.57@tcp:101:chown.0 Request processed in 620us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093774.695911:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 523 00000100:00100000:0.0:1784093774.697975:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093774.698040:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686016 00000100:00100000:1.0:1784093774.698049:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686016 00000100:00100000:1.0:1784093774.698110:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 524 00000100:00100000:1.0:1784093774.698118:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:40821:x1870757013686016:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:1.0:1784093774.698157:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093774.698175:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214c9fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56b2 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.698187:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781300) 00010000:00010000:1.0:1784093774.698194:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093774.698210:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.698237:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.698246:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093774.698496:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c26a0716 reply state 00000000a60e22d2 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093774.698506:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093774.698519:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000100:00100000:1.0:1784093774.698587:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:40821:x1870757013686016:12345-192.168.204.57@tcp:36:chown.0 Request processed in 470us (618us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1784093774.698592:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 524 00010000:00010000:3.0:1784093774.701496:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.701521:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.701616:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.701623:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093774.701629:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.701638:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.701658:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784093774.701662:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093774.701667:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093774.701675:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214c9fe7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093774.761537:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784093774.761544:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784093774.761548:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093774.761602:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.761612:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093774.761620:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093774.761643:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024231296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784093774.761711:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093774.761761:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe2240 going to sleep for 11 seconds 00000100:00100000:0.0:1784093774.762796:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231296 00000100:00100000:0.0:1784093774.762804:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231296 00000100:00100000:0.0:1784093774.762845:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1784093774.762854:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024231296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093774.762867:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093774.762881:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214c9fee expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.762904:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214c9fee expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.762915:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9fee expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.762923:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784093774.762972:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024231296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093774.762980:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1784093774.763034:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024231296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093774.763051:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.763059:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093774.763075:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093774.763081:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093774.763089:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093775.031949:0:68785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd13c66c70 20000000:00000080:0.0:1784093775.031965:0:68785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237edf800 uarg=0000000000000000 00010000:00010000:0.0:1784093775.032171:0:68785:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093775.032203:0:68785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:0.0:1784093775.032207:0:68785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093775.032218:0:68785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214c9fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ab expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.032239:0:68785:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093775.032252:0:68785:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093775.032266:0:68785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.032278:0:68785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c9fee expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.032295:0:68785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.032331:0:68785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c9fee expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.032346:0:68785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c9fee expref: 18 pid: 5772 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093775.032362:0:68785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68785:1870757024231424:0@lo:104: 00000100:00100000:0.0:1784093775.032465:0:68785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093775.032520:0:68785:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209100000 going to sleep for 11 seconds 00000100:00100000:2.0:1784093775.032522:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784093775.032540:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231424 00000100:00100000:2.0:1784093775.032547:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231424 00000100:00100000:2.0:1784093775.032637:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784093775.032647:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e3a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:68785:x1870757024231424:12345-0@lo:104: 00010000:00010000:2.0:1784093775.032660:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093775.032733:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093775.032740:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e3a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:68785:x1870757024231424:12345-0@lo:104: Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093775.032750:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784093775.032762:0:68785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68785:1870757024231424:0@lo:104: 00010000:00010000:3.0:1784093775.032784:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093775.032798:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.032800:0:68785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.032827:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093775.032834:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.032846:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093775.032855:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093775.032878:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093775.032948:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.032958:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093775.033003:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033011:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214c9fee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c9ff5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033038:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093775.033042:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093775.033045:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093775.033059:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024231552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093775.033093:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093775.033155:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231552 00000100:00100000:3.0:1784093775.033161:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231552 00010000:00010000:3.0:1784093775.033183:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9fee expref: 19 pid: 5772 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093775.033213:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1784093775.033219:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024231552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093775.033231:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093775.033237:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c9fee expref: 19 pid: 5772 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033250:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c9fee expref: 19 pid: 5772 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033263:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77200/0x9ce98053214c9ff5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c9fee expref: 19 pid: 5772 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033284:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033292:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033304:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033311:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033333:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033341:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033348:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093775.033352:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033362:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033381:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.033390:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093775.033461:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024231552:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093775.033476:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1784093775.033486:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024231552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093775.033490:0:68785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.033498:0:68785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093775.033506:0:68785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214c9ffc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093775.337865:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093775.372358:0:68833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe10a774b0 20000000:00000080:3.0:1784093775.372377:0:68833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb15c00 uarg=0000000000000000 00010000:00010000:3.0:1784093775.372612:0:68833:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093775.372623:0:68833:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093775.372633:0:68833:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093775.372649:0:68833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372661:0:68833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372672:0:68833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372678:0:68833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372686:0:68833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372694:0:68833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372700:0:68833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093775.372704:0:68833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372723:0:68833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372746:0:68833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372754:0:68833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093775.372759:0:68833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca003 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093775.867880:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000100:00100000:3.0:1784093776.249575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093776.250363:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686144 00000100:00100000:0.0:1784093776.250377:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686144 00000100:00100000:3.0:1784093776.250399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093776.250446:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686272 00000100:00100000:3.0:1784093776.250450:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686272 00000100:00100000:0.0:1784093776.250597:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 655 00000100:00100000:0.0:1784093776.250609:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013686144:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093776.250684:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013686144:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 77us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093776.250701:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 655 00000100:00100000:3.0:1784093776.250715:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 611 00000100:00100000:3.0:1784093776.250722:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013686272:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784093776.250758:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093776.250759:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013686272:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093776.250765:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 611 00000100:00100000:2.0:1784093776.255661:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093776.255773:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686400 00000100:00100000:3.0:1784093776.255783:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686400 00000100:00100000:3.0:1784093776.255887:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 252 00000100:00100000:3.0:1784093776.255900:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013686400:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:3.0:1784093776.255929:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214c8c84 00000100:00080000:3.0:1784093776.255940:0:6574:0:(import.c:65:import_set_state_nolock()) ffff907203aca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784093776.255982:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967328 00000100:00100000:3.0:1784093776.256357:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013686400:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 459us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093776.256377:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 252 00010000:00010000:3.0:1784093776.256409:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784093776.256510:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093776.257857:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093776.257995:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686528 00000100:00100000:3.0:1784093776.258006:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686528 00000100:00100000:3.0:1784093776.258062:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 253 00000100:00100000:3.0:1784093776.258072:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013686528:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:3.0:1784093776.258096:0:6572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214c8d8e 00000100:00080000:3.0:1784093776.258105:0:6572:0:(import.c:65:import_set_state_nolock()) ffff907210e61000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784093776.258144:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784093776.258195:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1784093776.258201:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967328 00000100:00100000:2.0:1784093776.258584:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013686528:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 512us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093776.258593:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 253 00010000:00010000:2.0:1784093776.361558:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093776.630114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093776.630198:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686656 00000100:00100000:2.0:1784093776.630220:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686656 00000100:00100000:2.0:1784093776.630302:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 9 00000100:00100000:2.0:1784093776.630312:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013686656:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093776.630329:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093776.630332:0:7457:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214c9fc4) 00010000:00010000:2.0:1784093776.630335:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093776.630397:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013686656:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 85us (292us total) trans 0 rc 116/116 00000100:00100000:2.0:1784093776.630405:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 9 00000100:00100000:2.0:1784093776.873618:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024231680:0@lo:400:kworker.0 00000100:00100000:2.0:1784093776.873706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093776.873732:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024232064:0@lo:400:kworker.0 00000100:00100000:2.0:1784093776.873787:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024232192:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.873793:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093776.873836:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024231808:0@lo:400:kworker.0 00000100:00100000:2.0:1784093776.873843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093776.873882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093776.873885:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232192 00000100:00100000:2.0:1784093776.873894:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232192 00000100:00100000:0.0:1784093776.873908:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024232320:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.873939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093776.873960:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231808 00000100:00100000:2.0:1784093776.873965:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231808 00000100:00100000:0.0:1784093776.873967:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093776.873976:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024231936:0@lo:400:kworker.0 00000100:00100000:2.0:1784093776.873990:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1784093776.873999:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024232192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093776.874053:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231680 00000100:00100000:0.0:1784093776.874057:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231680 00000100:00100000:2.0:1784093776.874059:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024232192:12345-0@lo:400:kworker.0 Request processed in 61us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093776.874069:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1784093776.874088:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024231936 00000100:00100000:2.0:1784093776.874091:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024231936 00000100:00100000:0.0:1784093776.874096:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1784093776.874108:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024231680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093776.874113:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1784093776.874122:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024231808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874155:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024231680:12345-0@lo:400:kworker.0 Request processed in 48us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093776.874162:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024231808:12345-0@lo:400:kworker.0 Request processed in 42us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093776.874164:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1784093776.874175:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1784093776.874200:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232064 00000100:00100000:2.0:1784093776.874204:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1784093776.874206:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232064 00000100:00100000:2.0:1784093776.874216:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024231936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874240:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232320 00000100:00100000:0.0:1784093776.874245:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232320 00000100:00100000:2.0:1784093776.874255:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024231936:12345-0@lo:400:kworker.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093776.874262:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1784093776.874280:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00080000:2.0:1784093776.874285:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093776.874291:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093776.874295:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093776.874300:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024232064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093776.874340:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024232192:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874348:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024232064:12345-0@lo:400:kworker.0 Request processed in 50us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093776.874354:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024231680:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874360:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1784093776.874382:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1784093776.874391:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024232320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874451:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024232320:12345-0@lo:400:kworker.0 Request processed in 62us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093776.874458:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1784093776.874514:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024232064:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874540:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024231936:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874552:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024231808:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874564:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024232320:0@lo:400:kworker.0 00000100:00100000:0.0:1784093776.874820:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024232448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093776.874850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093776.875546:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232448 00000100:00100000:3.0:1784093776.875551:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232448 00000100:00100000:3.0:1784093776.875609:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784093776.875615:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024232448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093776.875641:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093776.875695:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024232448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093776.875706:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1784093776.875729:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024232448:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1784093777.002073:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093777.002082:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093777.002087:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093777.002135:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.002147:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.002159:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093777.002257:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024232576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093777.002332:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093777.002399:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220c64300 going to sleep for 11 seconds 00000100:00100000:0.0:1784093777.002846:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232576 00000100:00100000:0.0:1784093777.002854:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232576 00000100:00100000:0.0:1784093777.002969:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1784093777.002978:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024232576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093777.002991:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093777.003004:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca00a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.003022:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca00a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.003035:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca00a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.003043:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784093777.003087:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024232576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093777.003095:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1784093777.003134:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024232576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093777.003153:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.003165:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093777.003188:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093777.003193:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.003211:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093777.351801:0:69077:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde1565480 20000000:00000080:3.0:1784093777.351815:0:69077:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb16000 uarg=0000000000000000 00010000:00010000:3.0:1784093777.352194:0:69077:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093777.352208:0:69077:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093777.352218:0:69077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093777.352232:0:69077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.352246:0:69077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca00a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.352259:0:69077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.352288:0:69077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca00a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.352299:0:69077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca00a expref: 18 pid: 5771 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093777.352310:0:69077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69077:1870757024232704:0@lo:104: 00000100:00100000:3.0:1784093777.352362:0:69077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093777.352444:0:69077:0:(client.c:2702:ptlrpc_set_wait()) set ffff907202ae6900 going to sleep for 11 seconds 00000100:00100000:1.0:1784093777.352517:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232704 00000100:00100000:1.0:1784093777.352524:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232704 00000100:00100000:1.0:1784093777.352562:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784093777.352569:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:69077:x1870757024232704:12345-0@lo:104: 00010000:00010000:1.0:1784093777.352578:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093777.352664:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093777.352680:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:69077:x1870757024232704:12345-0@lo:104: Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093777.352688:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00010000:2.0:1784093777.352702:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093777.352712:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093777.352722:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093777.352726:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093777.352735:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093777.352743:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093777.352758:0:69077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69077:1870757024232704:0@lo:104: 10000000:01000000:2.0:1784093777.352764:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093777.352780:0:69077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093777.352811:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093777.352819:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093777.352850:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093777.352858:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214ca00a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca011 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093777.352859:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024232832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093777.352882:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093777.352885:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093777.352890:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093777.352891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093777.352933:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232832 00000100:00100000:0.0:1784093777.352939:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232832 00010000:00010000:0.0:1784093777.352964:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca00a expref: 19 pid: 5771 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093777.352993:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1784093777.353000:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024232832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093777.353011:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093777.353015:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca00a expref: 19 pid: 5771 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353025:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca00a expref: 19 pid: 5771 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353038:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214ca011 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca00a expref: 19 pid: 5771 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353050:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353059:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353078:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353085:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353091:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353097:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353102:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093777.353106:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353112:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353132:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093777.353141:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784093777.353186:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024232832:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093777.353193:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784093777.353439:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024232832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093777.353517:0:69077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.353524:0:69077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.353528:0:69077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69000/0x9ce98053214ca018 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093777.385542:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093778.410181:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093778.535222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093778.535268:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686784 00000100:00100000:2.0:1784093778.535277:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686784 00000100:00080000:3.0:1784093778.535329:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093778.535447:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 525 00000100:00100000:2.0:1784093778.535511:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:40998:x1870757013686784:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093778.535533:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093778.535554:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca01f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56b9 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.535601:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca026 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.535612:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.535621:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093778.535844:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093778.535849:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093778.535942:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca026 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.535967:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca01f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56b9 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.535985:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca026 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56b9 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.535993:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093778.535997:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093778.536000:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093778.536060:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:40998:x1870757013686784:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 603us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093778.536068:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 525 00000100:00100000:1.0:1784093778.537612:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093778.537673:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013686912 00000100:00100000:2.0:1784093778.537681:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013686912 00000100:00100000:2.0:1784093778.537730:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 526 00000100:00100000:2.0:1784093778.537742:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:40998:x1870757013686912:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093778.537759:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093778.537776:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca02d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56c0 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.537825:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.537849:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.537861:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.537878:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.537886:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.537893:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538219:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538228:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538235:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093778.538313:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1784093778.538317:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093778.538407:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538442:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538459:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538466:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538472:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093778.538477:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538484:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538496:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093778.538500:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093778.538504:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538510:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538524:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538530:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538536:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538542:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093778.538551:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538557:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538564:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781400) 00010000:00010000:2.0:1784093778.538567:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093778.538569:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538584:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca03b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538613:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca02d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56c0 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538627:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56c0 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.538634:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784093778.538637:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093778.538639:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093778.538701:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:40998:x1870757013686912:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 962us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093778.538709:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 526 00000100:00100000:3.0:1784093778.540484:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093778.540555:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013687168 00000100:00100000:0.0:1784093778.540575:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013687168 00000100:00100000:0.0:1784093778.540675:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 527 00000100:00100000:0.0:1784093778.540691:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:40998:x1870757013687168:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093778.540798:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093778.540834:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56c0 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093778.540857:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781700) 00010000:00010000:0.0:1784093778.540872:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093778.540907:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093778.540922:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093778.540934:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093778.556728:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00010000:3.0:1784093778.556738:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000583a8d48 reply state 000000003fe4c699 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093778.556751:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093778.556895:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00080000:3.0:1784093778.556988:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093778.557006:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:40998:x1870757013687168:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 16318us (16526us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1784093778.557015:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 527 00010000:00010000:2.0:1784093778.557033:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.557054:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.557062:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.557069:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093778.557073:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.557081:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.557098:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b100) 00010000:00010000:2.0:1784093778.557101:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093778.557106:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093778.557112:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca049 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093778.876066:0:69273:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff761075c0 20000000:00000080:1.0:1784093778.876082:0:69273:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b37000 uarg=0000000000000000 00010000:00010000:1.0:1784093778.876576:0:69273:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093778.876604:0:69273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781f00) 00010000:00010000:1.0:1784093778.876608:0:69273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093778.876618:0:69273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca026 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56b9 expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876652:0:69273:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093778.876672:0:69273:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093778.876688:0:69273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876707:0:69273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876718:0:69273:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876722:0:69273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876726:0:69273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876731:0:69273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876736:0:69273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093778.876740:0:69273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876747:0:69273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876756:0:69273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876763:0:69273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093778.876770:0:69273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13800/0x9ce98053214ca050 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093778.921549:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024232960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093778.921613:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093778.921663:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024232960 00000100:00100000:1.0:1784093778.921672:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024232960 00000100:00080000:3.0:1784093778.921698:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093778.921730:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784093778.921742:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024232960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093778.921779:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093778.921837:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024232960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093778.921844:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784093778.921884:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024232960:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1784093779.305568:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093779.305577:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093779.305583:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093779.305643:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093779.305653:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093779.305665:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093779.305694:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024233088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093779.305765:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093779.305831:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907225f8f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784093779.305942:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233088 00000100:00100000:2.0:1784093779.305950:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233088 00000100:00100000:0.0:1784093779.306027:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1784093779.306038:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024233088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093779.306057:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093779.306071:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca057 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093779.306095:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca057 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093779.306106:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca057 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093779.306115:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093779.306155:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024233088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093779.306162:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1784093779.306200:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024233088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093779.306219:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093779.306229:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093779.306247:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093779.306252:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093779.306259:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093779.433620:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784093779.962526:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784093779.962536:0:7469:0:(genops.c:906:class_export_put()) final put ffff907210e64000/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:1.0:1784093779.962581:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff907210e64000/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0001 00000020:00000080:1.0:1784093779.962670:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907210e61000 for lustre-OST0001 00000001:00100000:2.0:1784093779.963698:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784093779.963703:0:6598:0:(genops.c:906:class_export_put()) final put ffff907203acd800/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:0.0:1784093779.963728:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff907203acd800/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0000 00000020:00000080:0.0:1784093779.963777:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907203aca800 for lustre-OST0000 00000100:00100000:3.0:1784093780.027855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093780.027906:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013687296 00000100:00100000:2.0:1784093780.027927:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013687296 00000100:00100000:2.0:1784093780.028015:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 528 00000100:00100000:2.0:1784093780.028027:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41074:x1870757013687296:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093780.028052:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093780.028079:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56c7 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028149:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028163:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028177:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028192:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028200:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028206:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028729:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca07a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028739:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028747:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093780.028842:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1784093780.028846:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093780.028924:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca07a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028937:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028943:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028950:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028956:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093780.028960:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028968:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028981:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781c00) 00010000:00010000:2.0:1784093780.028985:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093780.028989:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.028996:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca06c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029009:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029026:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029032:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029038:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093780.029042:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029048:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029057:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781d00) 00010000:00010000:2.0:1784093780.029060:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093780.029063:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029069:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca073 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029101:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56c7 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029119:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca07a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56c7 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.029126:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093780.029129:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093780.029137:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784093780.029200:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41074:x1870757013687296:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1175us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093780.029207:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 528 00000100:00080000:3.0:1784093780.029318:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093780.033576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093780.033750:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013687552 00000100:00100000:2.0:1784093780.033760:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013687552 00000100:00100000:2.0:1784093780.033820:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 529 00000100:00100000:2.0:1784093780.033833:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:41074:x1870757013687552:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093780.033853:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093780.033873:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca081 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56ce expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.034251:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.034271:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.034284:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.034303:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.034311:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.034320:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093780.035522:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:2.0:1784093780.035883:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035896:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035906:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035947:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035955:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035963:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035970:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093780.035974:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035982:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.035996:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093780.035999:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093780.036005:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.036013:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093780.036035:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ffaa4d19 reply state 00000000a70472a3 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093780.036045:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093780.036074:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca081 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ce expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.036090:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ce expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.036097:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093780.036100:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093780.036103:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784093780.036178:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:41074:x1870757013687552:12345-192.168.204.57@tcp:101:touch.0 Request processed in 2347us (2607us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1784093780.036187:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 529 00010000:00010000:0.0:1784093780.038025:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.038041:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.038051:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.038058:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093780.038065:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.038078:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.038091:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781c00) 00010000:00010000:0.0:1784093780.038094:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093780.038098:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.038104:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca08f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093780.038855:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093780.038904:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013687808 00000100:00100000:0.0:1784093780.038914:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013687808 00000100:00100000:0.0:1784093780.038968:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 530 00000100:00100000:0.0:1784093780.038980:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:41074:x1870757013687808:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:0.0:1784093780.039030:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093780.039049:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ce expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.039070:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff90721a781d00) 00010000:00010000:0.0:1784093780.039081:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093780.039121:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.039132:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.039141:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093780.039279:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000070aee088 reply state 00000000594a9acb transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093780.039288:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093780.039365:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:41074:x1870757013687808:12345-192.168.204.57@tcp:36:touch.0 Request processed in 387us (570us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1784093780.039372:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 530 00010000:00010000:1.0:1784093780.040605:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.040632:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.040639:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.040647:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093780.040650:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.040657:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.040671:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff907202e6b200) 00010000:00010000:1.0:1784093780.040673:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093780.040683:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.040689:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093780.040802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093780.040882:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013687936 00000100:00100000:1.0:1784093780.040890:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013687936 00000100:00100000:1.0:1784093780.040930:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 531 00000100:00100000:1.0:1784093780.040939:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:41074:x1870757013687936:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093780.040956:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093780.040971:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca0ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56d5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.041014:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca0ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56d5 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.041028:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca0ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56d5 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.041047:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff907219c12700) 00010000:00010000:1.0:1784093780.041050:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093780.041053:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093780.041101:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:41074:x1870757013687936:12345-192.168.204.57@tcp:101:touch.0 Request processed in 162us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093780.041108:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 531 00000100:00100000:2.0:1784093780.043753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093780.043863:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013688064 00000100:00100000:0.0:1784093780.043875:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013688064 00000100:00100000:0.0:1784093780.043925:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 254 00000100:00100000:0.0:1784093780.043932:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870757013688064:12345-192.168.204.57@tcp:8:touch.0 00010000:00080000:0.0:1784093780.043960:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 941 last 0 00000020:00000080:0.0:1784093780.043987:0:6572:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214ca0b2 00002000:00100000:0.0:1784093780.043997:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff907101d60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784093780.044015:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784093780.044228:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784093780.044264:0:6572:0:(import.c:65:import_set_state_nolock()) ffff907101d62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784093780.044335:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013688064:12345-192.168.204.57@tcp:8:touch.0 Request processed in 402us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093780.044345:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 254 00000100:00100000:0.0:1784093780.046722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093780.046786:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013688192 00000100:00100000:3.0:1784093780.046797:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013688192 00000100:00080000:0.0:1784093780.046874:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093780.046886:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 255 00000100:00100000:3.0:1784093780.046899:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:0:x1870757013688192:12345-192.168.204.57@tcp:2:touch.0 00000001:00100000:2.0:1784093780.061039:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000001:00080000:2.0:1784093780.061058:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:1.0:1784093780.061152:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:0:x1870757013688192:12345-192.168.204.57@tcp:2:touch.0 Request processed in 14250us (14433us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1784093780.061165:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 255 00000100:00100000:0.0:1784093780.063663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093780.063695:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013688448 00000100:00100000:2.0:1784093780.063705:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013688448 00000100:00100000:2.0:1784093780.063755:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 58 00000100:00100000:2.0:1784093780.063766:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:41074:x1870757013688448:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:2.0:1784093780.064066:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:41074:x1870757013688448:12345-192.168.204.57@tcp:35:touch.0 Request processed in 301us (409us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1784093780.064084:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 58 00000100:00100000:2.0:1784093780.085882:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093780.086002:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013688576 00000100:00100000:0.0:1784093780.086012:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013688576 00000100:00100000:0.0:1784093780.086068:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 532 00000100:00100000:0.0:1784093780.086093:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:41078:x1870757013688576:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093780.086117:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093780.086140:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca0b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56dc expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086201:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086215:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086227:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086240:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086248:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086255:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086351:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086360:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086368:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093780.086412:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00000004:00200000:0.0:1784093780.086417:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093780.086476:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086489:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086499:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086506:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086514:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086520:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093780.086525:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086533:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086545:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781900) 00010000:00010000:0.0:1784093780.086549:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093780.086553:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086559:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca0c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086583:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086590:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086596:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086602:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093780.086605:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086612:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086635:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff907202e6b400) 00010000:00010000:0.0:1784093780.086637:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093780.086641:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086647:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca0c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086677:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca0b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56dc expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086690:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56dc expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.086710:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff907219c12700) 00010000:00010000:0.0:1784093780.086712:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093780.086715:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784093780.086778:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:41078:x1870757013688576:12345-192.168.204.57@tcp:101:rm.0 Request processed in 688us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093780.086786:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 532 00000100:00100000:0.0:1784093780.088735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093780.089449:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013688704 00000100:00100000:2.0:1784093780.089459:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013688704 00000100:00100000:2.0:1784093780.089506:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 256 00000100:00100000:2.0:1784093780.089517:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013688704:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093780.089534:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093780.089552:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56e3 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093780.089578:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x6a571c54, atime: 0x6a571c54, ctime: 0x6a571c54, blocks: 0x1 00010000:00010000:2.0:1784093780.089595:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=941s v=(0 0) 00010000:00010000:2.0:1784093780.089599:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093780.089605:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.089725:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.089740:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784093780.089870:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013688704:12345-192.168.204.57@tcp:101:rm.0 Request processed in 355us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093780.089878:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 256 00000100:00100000:2.0:1784093780.092286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093780.092386:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013688960 00000100:00100000:0.0:1784093780.092395:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013688960 00000100:00100000:0.0:1784093780.092508:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 533 00000100:00100000:0.0:1784093780.092516:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:41078:x1870757013688960:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093780.092565:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093780.092594:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca0ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56dc expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092615:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca0ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56d5 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092635:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff907219c12700) 00010000:00010000:0.0:1784093780.092648:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093780.092666:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092678:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092686:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092712:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092718:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092724:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092829:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092837:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.092843:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093780.093381:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9280 00000004:00080000:0.0:1784093780.093391:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 941170968377ns, next at 942170966134ns, rc = 0 00010000:00010000:0.0:1784093780.093518:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093528:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093535:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093543:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093561:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093568:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093630:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093780.093654:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093661:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093667:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093674:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093780.093679:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093687:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093696:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784093780.093699:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093780.093702:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093709:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca0ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093722:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093733:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093738:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093744:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093780.093746:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093752:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093758:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781900) 00010000:00010000:0.0:1784093780.093761:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093780.093764:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.093769:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca0dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093780.093778:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000000f88ba33 reply state 00000000b9709bc7 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093780.093786:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093780.093858:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:41078:x1870757013688960:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1341us (1577us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784093780.093866:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 533 00010000:00010000:2.0:1784093780.093908:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093780.093920:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.093926:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093780.093930:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.093937:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.093946:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff907202e6b800) 00010000:00010000:2.0:1784093780.093948:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093780.093951:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.093957:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca0f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.093970:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093780.093971:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093780.093973:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093780.095236:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.095253:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.095258:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.095262:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093780.095265:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.095277:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.095286:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff907202e6bb00) 00010000:00010000:2.0:1784093780.095288:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093780.095290:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.095294:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca0e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.457563:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093780.806268:0:69518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd953bf2c0 20000000:00000080:0.0:1784093780.806290:0:69518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237edcc00 uarg=0000000000000000 00010000:00010000:0.0:1784093780.806616:0:69518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093780.806653:0:69518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781900) 00010000:00010000:0.0:1784093780.806657:0:69518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093780.806668:0:69518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca07a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56c7 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.806691:0:69518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093780.806707:0:69518:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093780.806721:0:69518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.806735:0:69518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca057 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.806744:0:69518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.806785:0:69518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca057 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.806799:0:69518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca057 expref: 18 pid: 5771 timeout: 1091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093780.806816:0:69518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69518:1870757024233216:0@lo:104: 00000100:00100000:0.0:1784093780.806882:0:69518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093780.806940:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233216 00000100:00100000:2.0:1784093780.806947:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233216 00000100:00100000:0.0:1784093780.806951:0:69518:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722d980240 going to sleep for 11 seconds 00000100:00100000:2.0:1784093780.806998:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784093780.807009:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:69518:x1870757024233216:12345-0@lo:104: 00010000:00010000:2.0:1784093780.807038:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093780.807108:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093780.807115:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:69518:x1870757024233216:12345-0@lo:104: Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093780.807124:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784093780.807137:0:69518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69518:1870757024233216:0@lo:104: 00010000:00010000:0.0:1784093780.807160:0:69518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.807175:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093780.807183:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.807192:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784093780.807197:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.807205:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784093780.807212:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784093780.807218:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093780.807255:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.807261:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784093780.807312:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024233344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093780.807335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093780.807370:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233344 00010000:00010000:1.0:1784093780.807372:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093780.807376:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233344 00010000:00010000:1.0:1784093780.807379:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca057 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca05e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093780.807391:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093780.807393:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093780.807395:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093780.807402:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca057 expref: 19 pid: 5771 timeout: 1091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093780.807459:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784093780.807468:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024233344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093780.807478:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093780.807484:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca057 expref: 19 pid: 5771 timeout: 1091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807494:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca057 expref: 19 pid: 5771 timeout: 1091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807504:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca05e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca057 expref: 19 pid: 5771 timeout: 1091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807516:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807523:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807544:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807551:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807557:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807564:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807569:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093780.807572:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807579:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807597:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093780.807617:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093780.807627:0:69518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.807635:0:69518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093780.807640:0:69518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76600/0x9ce98053214ca0f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093780.807662:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024233344:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093780.807670:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1784093780.808138:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024233344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093781.368765:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093781.368804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093781.368830:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689088 00000100:00100000:1.0:1784093781.368842:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689088 00000100:00100000:2.0:1784093781.368856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093781.368869:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689216 00000100:00100000:0.0:1784093781.368876:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689216 00000100:00100000:1.0:1784093781.368902:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 659 00000100:00100000:0.0:1784093781.368921:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 615 00000100:00100000:1.0:1784093781.368923:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013689088:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093781.368935:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:2354:x1870757013689216:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093781.369015:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013689088:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093781.369016:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:2354:x1870757013689216:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093781.369032:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 659 00000100:00100000:0.0:1784093781.369033:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 615 00000100:00100000:0.0:1784093781.369074:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689344 00000100:00100000:0.0:1784093781.369078:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689344 00000100:00100000:0.0:1784093781.369109:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 420 00000100:00100000:0.0:1784093781.369116:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013689344:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093781.369143:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013689344:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093781.369150:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 420 00010000:00010000:2.0:1784093781.484005:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093781.993766:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024233472:0@lo:400:kworker.0 00000100:00100000:2.0:1784093781.993820:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024233856:0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.993849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093781.993865:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093781.993904:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024233728:0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.993922:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024233984:0@lo:400:kworker.0 00000100:00100000:2.0:1784093781.993937:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233856 00000100:00100000:2.0:1784093781.993946:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233856 00000100:00100000:0.0:1784093781.993948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093781.993974:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233472 00000100:00100000:3.0:1784093781.993980:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233472 00000100:00100000:2.0:1784093781.994016:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1784093781.994021:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1784093781.994029:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024233856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093781.994089:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024233856:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093781.994097:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00080000:2.0:1784093781.994118:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093781.994155:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024233856:0@lo:400:kworker.0 00000100:00100000:2.0:1784093781.994189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093781.994227:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233728 00000100:00100000:2.0:1784093781.994232:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233728 00000100:00100000:3.0:1784093781.994237:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024233472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093781.994243:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784093781.994262:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024233600:0@lo:400:kworker.0 00000100:00100000:2.0:1784093781.994280:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233984 00000100:00100000:2.0:1784093781.994285:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233984 00000100:00100000:3.0:1784093781.994296:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024233472:12345-0@lo:400:kworker.0 Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093781.994306:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1784093781.994327:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1784093781.994338:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024233728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.994386:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1784093781.994397:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024233984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093781.994491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093781.994515:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024233728:12345-0@lo:400:kworker.0 Request processed in 176us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093781.994525:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1784093781.994541:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024233600 00000100:00100000:2.0:1784093781.994546:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024233600 00000100:00100000:2.0:1784093781.994565:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1784093781.994580:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024233600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093781.994650:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024234112:0@lo:400:kworker.0 00000100:00100000:0.0:1784093781.994685:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093781.994722:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024233728:0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.994741:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024233984:12345-0@lo:400:kworker.0 Request processed in 340us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093781.994756:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1784093781.994769:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024233600:12345-0@lo:400:kworker.0 Request processed in 196us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093781.994773:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024233600:0@lo:400:kworker.0 00000100:00100000:2.0:1784093781.994788:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00080000:3.0:1784093781.994792:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093781.994828:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024234112 00000100:00100000:2.0:1784093781.994833:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024234112 00000100:00100000:2.0:1784093781.994875:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1784093781.994877:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093781.994886:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024234112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.994892:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024234240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093781.994934:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093781.994939:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024234112:12345-0@lo:400:kworker.0 Request processed in 55us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093781.994947:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1784093781.994952:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024234112:0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.994983:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024234240 00000100:00100000:3.0:1784093781.994988:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024234240 00000100:00080000:2.0:1784093781.994998:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093781.995043:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1784093781.995046:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024233984:0@lo:400:kworker.0 00000100:00100000:3.0:1784093781.995057:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024234240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093781.995064:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024233472:0@lo:400:kworker.0 00002000:00000024:3.0:1784093781.995091:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093781.995147:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024234240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093781.995154:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1784093781.995180:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024234240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093782.068340:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093782.068389:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689472 00000100:00100000:1.0:1784093782.068399:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689472 00000100:00080000:2.0:1784093782.068451:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093782.068496:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 534 00000100:00100000:1.0:1784093782.068508:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:41165:x1870757013689472:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093782.068529:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093782.068552:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca0ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56ea expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.068629:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.068645:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.068659:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093782.068722:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:1.0:1784093782.068727:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093782.068755:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.068783:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca0ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ea expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.068824:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ea expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.068834:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093782.068838:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093782.068842:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784093782.068913:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:41165:x1870757013689472:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 408us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093782.068922:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 534 00000100:00100000:3.0:1784093782.076170:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093782.076228:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689728 00000100:00100000:0.0:1784093782.076239:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689728 00000100:00100000:0.0:1784093782.076320:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 535 00000100:00100000:0.0:1784093782.076331:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:41165:x1870757013689728:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093782.076384:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093782.076411:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ea expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.076814:0:5778:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca07a) 00010000:00010000:0.0:1784093782.076821:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12c00) 00010000:00010000:0.0:1784093782.076834:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093782.076864:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.076877:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.076894:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093782.095086:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00010000:3.0:1784093782.095088:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004fe4c7aa reply state 000000009d1f02f4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093782.095104:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00000100:00100000:3.0:1784093782.095112:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093782.095250:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000100:00100000:2.0:1784093782.095258:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024234368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784093782.095322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784093782.095332:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093782.095356:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41165:x1870757013689728:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 19023us (19189us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1784093782.095365:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024234368 00000100:00100000:3.0:1784093782.095366:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 535 00000100:00100000:0.0:1784093782.095374:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024234368 00000100:00100000:0.0:1784093782.095415:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784093782.095446:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024234368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784093782.095472:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:0.0:1784093782.095494:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.095509:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 5 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.095515:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784093782.095518:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093782.095522:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.095541:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 5 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.095551:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 5 pid: 6573 timeout: 1043 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093782.095559:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024234496:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093782.095602:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de666c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784093782.095734:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.095744:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.095751:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.095758:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093782.095762:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.095770:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.095783:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b300) 00010000:00010000:1.0:1784093782.095786:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093782.095790:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.095803:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca10d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093782.097197:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024234496:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093782.097201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:0.0:1784093782.097222:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093782.097259:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689856 00000100:00100000:2.0:1784093782.097266:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689856 00010000:00010000:2.0:1784093782.097307:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 6 pid: 6573 timeout: 1043 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093782.097338:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 248 00000100:00100000:2.0:1784093782.097347:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013689856:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093782.097365:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093782.097371:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 6 pid: 6573 timeout: 1043 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093782.097383:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 6 pid: 6573 timeout: 1043 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093782.097402:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214ca0d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56e3 expref: 6 pid: 6573 timeout: 1043 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093782.097414:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093782.097417:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093782.097439:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093782.097448:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093782.097474:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093782.097508:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013689856:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 163us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093782.097516:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 248 00010000:00010000:0.0:1784093782.097561:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.097573:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.097594:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.097603:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.097624:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1784093782.097640:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784093782.097659:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093782.097666:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.097675:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093782.097679:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.097688:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.097701:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.097708:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214ca114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093782.097728:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093782.097730:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093782.097733:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093782.098142:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024234368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2718us (2818us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1784093782.098150:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000004:00080000:2.0:1784093782.098222:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230ce4380/2, rc 0, transno 4294967330 00000100:00100000:2.0:1784093782.098227:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024234368:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1784093782.459167:0:69713:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffad89f450 20000000:00000080:0.0:1784093782.459183:0:69713:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3a6800 uarg=0000000000000000 00010000:00010000:0.0:1784093782.459740:0:69713:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093782.459755:0:69713:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093782.459768:0:69713:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093782.459789:0:69713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459815:0:69713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459825:0:69713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459832:0:69713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459840:0:69713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459847:0:69713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459854:0:69713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093782.459858:0:69713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459867:0:69713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459880:0:69713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459888:0:69713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.459895:0:69713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214ca11b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093782.505527:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093782.505536:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093782.505541:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093782.505596:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.505609:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.505621:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093782.505649:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024234624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093782.505714:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093782.505761:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024234624 00000100:00100000:3.0:1784093782.505770:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024234624 00000100:00100000:0.0:1784093782.506226:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720780 going to sleep for 11 seconds 00000100:00100000:3.0:1784093782.506253:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1784093782.506265:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024234624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093782.506280:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093782.506286:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093782.506296:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca122 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093782.506321:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca122 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093782.506333:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca122 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093782.506343:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784093782.506401:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024234624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093782.506409:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1784093782.506465:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024234624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093782.506483:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.506494:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093782.506516:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093782.506521:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093782.506529:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.529871:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093783.834349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093783.834507:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013689984 00000100:00100000:3.0:1784093783.834519:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013689984 00000100:00100000:3.0:1784093783.834596:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:3.0:1784093783.834609:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41242:x1870757013689984:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093783.834636:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093783.834659:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56f1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.834724:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.834737:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.834749:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.834762:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.834767:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.834773:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835181:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835190:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835196:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093783.835279:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:3.0:1784093783.835283:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093783.835353:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835368:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835374:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835381:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835387:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093783.835391:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835397:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835409:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093783.835412:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093783.835417:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835449:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835462:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835479:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835485:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835490:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093783.835493:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835498:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835505:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907204fce100) 00010000:00010000:3.0:1784093783.835508:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093783.835510:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835515:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca13e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835542:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56f1 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835568:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56f1 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093783.835576:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784093783.835578:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093783.835587:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784093783.835658:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013689984:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1051us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093783.835666:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:0.0:1784093783.839526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093783.839613:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013690240 00000100:00100000:1.0:1784093783.839623:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013690240 00000100:00100000:1.0:1784093783.839676:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 537 00000100:00100000:1.0:1784093783.839693:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013690240:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093783.839714:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093783.839731:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca14c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56f8 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.839954:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.839968:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.839978:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.839991:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.839997:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840003:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093783.840121:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:1.0:1784093783.840143:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840151:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840157:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840173:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093783.840177:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840184:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840195:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:1.0:1784093783.840198:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093783.840202:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840207:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca153 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840217:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840223:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840228:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840233:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093783.840235:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840240:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840257:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff907219c12a00) 00010000:00010000:1.0:1784093783.840260:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093783.840263:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840268:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca15a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840303:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca14c lrc: 1/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56f8 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840313:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:1.0:1784093783.840316:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093783.840320:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca14c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56f8 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093783.840329:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093783.840396:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013690240:12345-192.168.204.57@tcp:101:touch.0 Request processed in 703us (875us total) trans 0 rc 301/301 00000100:00100000:1.0:1784093783.840403:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 537 00000100:00100000:0.0:1784093783.844138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093783.844337:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013690368 00000100:00100000:1.0:1784093783.844346:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013690368 00000100:00100000:0.0:1784093783.844602:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 538 00000100:00100000:0.0:1784093783.844623:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013690368:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784093783.844643:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093783.844667:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf56ff expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844727:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844740:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844751:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844764:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844770:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844777:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844963:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844980:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844986:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.844992:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093783.844997:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845004:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845016:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:0.0:1784093783.845019:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093783.845024:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845030:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845041:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845047:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845052:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845057:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093783.845066:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845072:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845080:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff907202e6b600) 00010000:00010000:0.0:1784093783.845082:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093783.845085:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845090:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845118:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca161 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ff expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845127:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:0.0:1784093783.845130:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093783.845134:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56ff expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093783.845142:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784093783.845195:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013690368:12345-192.168.204.57@tcp:101:touch.0 Request processed in 574us (1065us total) trans 0 rc 301/301 00000100:00100000:0.0:1784093783.845351:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 538 00000100:00100000:2.0:1784093783.847180:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093783.847213:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013690496 00000100:00100000:2.0:1784093783.847226:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013690496 00000100:00100000:2.0:1784093783.847272:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 539 00000100:00100000:2.0:1784093783.847282:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013690496:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093783.847300:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093783.847334:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5706 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847392:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847406:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847418:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847455:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847464:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847472:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847642:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847651:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847658:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847670:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093783.847675:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847683:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847695:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784093783.847698:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093783.847703:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847710:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca17d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847723:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847730:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847737:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847742:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093783.847745:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847751:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847769:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781500) 00010000:00010000:2.0:1784093783.847772:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093783.847775:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847782:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847814:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca176 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5706 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847824:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784093783.847827:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093783.847831:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5706 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093783.847842:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093783.847896:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41242:x1870757013690496:12345-192.168.204.57@tcp:101:touch.0 Request processed in 615us (719us total) trans 0 rc 301/301 00000100:00100000:2.0:1784093783.847904:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 539 00000100:00100000:0.0:1784093784.042562:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093784.042586:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024234752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093784.042651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093784.042698:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024234752 00000100:00100000:1.0:1784093784.042707:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024234752 00000100:00100000:1.0:1784093784.042781:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1784093784.042793:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024234752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093784.042844:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093784.042903:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024234752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093784.042918:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784093784.042929:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024234752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784093784.042933:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784093784.555509:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093784.605829:0:69957:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3d7393f0 20000000:00000080:0.0:1784093784.605847:0:69957:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237edc000 uarg=0000000000000000 00010000:00010000:0.0:1784093784.606071:0:69957:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093784.606106:0:69957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce200) 00010000:00010000:0.0:1784093784.606110:0:69957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093784.606122:0:69957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf56f1 expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.606143:0:69957:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093784.606160:0:69957:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093784.606175:0:69957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.606188:0:69957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca122 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.606197:0:69957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.606235:0:69957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca122 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.606249:0:69957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca122 expref: 18 pid: 5770 timeout: 1095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093784.606263:0:69957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69957:1870757024234880:0@lo:104: 00000100:00100000:0.0:1784093784.606324:0:69957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093784.606375:0:69957:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784093784.606385:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024234880 00000100:00100000:1.0:1784093784.606393:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024234880 00000100:00100000:1.0:1784093784.606463:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784093784.606473:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:69957:x1870757024234880:12345-0@lo:104: 00010000:00010000:1.0:1784093784.606486:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093784.606560:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093784.606567:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:69957:x1870757024234880:12345-0@lo:104: Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093784.606575:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784093784.606579:0:69957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69957:1870757024234880:0@lo:104: 00010000:00010000:0.0:1784093784.606609:0:69957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.606642:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093784.606651:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.606660:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093784.606664:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.606673:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093784.606680:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093784.606686:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093784.606719:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607040:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093784.607072:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607090:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca122 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca129 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607104:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093784.607106:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093784.607114:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093784.607166:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024235008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093784.607297:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093784.607499:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235008 00000100:00100000:3.0:1784093784.607504:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235008 00010000:00010000:3.0:1784093784.607526:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca122 expref: 19 pid: 5770 timeout: 1095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093784.607565:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1784093784.607574:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024235008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093784.607583:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093784.607588:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca122 expref: 19 pid: 5770 timeout: 1095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607598:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca122 expref: 19 pid: 5770 timeout: 1095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607610:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214ca129 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca122 expref: 19 pid: 5770 timeout: 1095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607622:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607629:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607642:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607649:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607657:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607671:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607677:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093784.607681:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607688:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607708:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093784.607717:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093784.607805:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024235008:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093784.607813:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00010000:0.0:1784093784.607883:0:69957:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.607892:0:69957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093784.607902:0:69957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76e00/0x9ce98053214ca18b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093784.607908:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024235008:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1784093785.097610:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00010000:00010000:0.0:1784093785.577650:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093785.924020:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093785.924057:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013690624 00000100:00100000:1.0:1784093785.924066:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013690624 00000100:00100000:1.0:1784093785.924126:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00100000:1.0:1784093785.924137:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:41328:x1870757013690624:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093785.924156:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093785.924177:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf570d expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.924256:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.924271:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.924283:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093785.924497:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:1.0:1784093785.924502:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093785.924629:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.924653:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf570d expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.924675:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf570d expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.924684:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093785.924687:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093785.924690:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784093785.924744:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:41328:x1870757013690624:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 609us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093785.924753:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00080000:1.0:1784093785.924877:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093785.931246:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093785.931293:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013690880 00000100:00100000:1.0:1784093785.931305:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013690880 00000100:00100000:1.0:1784093785.931365:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 541 00000100:00100000:1.0:1784093785.931376:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41328:x1870757013690880:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093785.931462:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093785.931603:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf570d expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.931619:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca145) 00010000:00010000:1.0:1784093785.931630:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093785.931642:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093785.931669:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.931682:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093785.931692:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093785.932088:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000001479cff8 reply state 000000000e373711 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093785.932098:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093785.932173:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000100:00100000:1.0:1784093785.932261:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:41328:x1870757013690880:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 886us (1023us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1784093785.932270:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 541 00010000:00010000:3.0:1784093785.934584:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093785.934595:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093785.934603:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093785.934610:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093785.934614:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093785.934633:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093785.934647:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12100) 00010000:00010000:3.0:1784093785.934650:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093785.934655:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093785.934660:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca1a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093786.281473:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093786.281480:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093786.281485:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093786.281539:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093786.281549:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093786.281557:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093786.281580:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024235136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093786.281645:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093786.281706:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839240 going to sleep for 11 seconds 00000100:00100000:3.0:1784093786.281744:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235136 00000100:00100000:3.0:1784093786.281753:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235136 00000100:00100000:3.0:1784093786.281810:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1784093786.281821:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024235136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093786.281834:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093786.281849:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca1a7 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093786.281874:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093786.281885:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093786.281894:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093786.281938:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024235136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093786.281945:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1784093786.283587:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024235136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093786.283608:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093786.283619:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093786.283639:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093786.283644:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093786.283651:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093786.283755:0:70155:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf38dc1d0 20000000:00000080:1.0:1784093786.283765:0:70155:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b34800 uarg=0000000000000000 00010000:00010000:1.0:1784093786.283957:0:70155:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093786.283970:0:70155:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093786.283983:0:70155:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093786.283995:0:70155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284005:0:70155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284012:0:70155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284046:0:70155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284059:0:70155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 18 pid: 5772 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093786.284071:0:70155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70155:1870757024235264:0@lo:104: 00000100:00100000:1.0:1784093786.284116:0:70155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093786.284193:0:70155:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220dfa240 going to sleep for 11 seconds 00000100:00100000:2.0:1784093786.284233:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235264 00000100:00100000:2.0:1784093786.284239:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235264 00000100:00100000:2.0:1784093786.284306:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784093786.284314:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:70155:x1870757024235264:12345-0@lo:104: 00010000:00010000:2.0:1784093786.284325:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093786.284386:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093786.284392:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:70155:x1870757024235264:12345-0@lo:104: Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093786.284399:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784093786.284408:0:70155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70155:1870757024235264:0@lo:104: 00010000:00010000:3.0:1784093786.284443:0:70155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093786.284469:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093786.284476:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093786.284513:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093786.284517:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093786.284526:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093786.284534:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093786.284540:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784093786.284628:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284635:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784093786.284666:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284672:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca1a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca1ae expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.284686:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093786.284688:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093786.284690:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093786.284771:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024235392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784093786.284805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093786.284909:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235392 00000100:00100000:1.0:1784093786.284914:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235392 00010000:00010000:1.0:1784093786.284933:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 19 pid: 5772 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093786.285046:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784093786.285055:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024235392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093786.285076:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093786.285082:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 19 pid: 5772 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285092:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 19 pid: 5772 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285106:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68800/0x9ce98053214ca1ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca1a7 expref: 19 pid: 5772 timeout: 1097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285117:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285125:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285137:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285143:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285150:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285156:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285162:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093786.285165:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285183:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285217:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093786.285227:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093786.285260:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024235392:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093786.285267:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1784093786.285302:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024235392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093786.285321:0:70155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093786.285331:0:70155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093786.285339:0:70155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12000/0x9ce98053214ca1b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093786.489405:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093786.489549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093786.489589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093786.489592:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691008 00000100:00100000:3.0:1784093786.489604:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691008 00000100:00100000:2.0:1784093786.489623:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691264 00000100:00100000:2.0:1784093786.489629:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691264 00000100:00100000:3.0:1784093786.489661:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 663 00000100:00100000:3.0:1784093786.489675:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013691008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093786.489686:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691136 00000100:00100000:1.0:1784093786.489693:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691136 00000100:00100000:2.0:1784093786.489699:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 423 00000100:00100000:2.0:1784093786.489712:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013691264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093786.489745:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013691008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093786.489754:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 663 00000100:00100000:2.0:1784093786.489772:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013691264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093786.489781:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 423 00000100:00100000:1.0:1784093786.489884:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 619 00000100:00100000:1.0:1784093786.489896:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013691136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093786.489904:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093786.489999:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013691136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093786.490008:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 619 00010000:00010000:2.0:1784093786.601851:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093787.114118:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024235520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093787.114200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093787.114268:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024235776:0@lo:400:kworker.0 00000100:00100000:3.0:1784093787.114269:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024236032:0@lo:400:kworker.0 00000100:00100000:3.0:1784093787.114319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093787.114338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093787.114348:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784093787.114357:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024235648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.114367:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093787.114377:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024235904:0@lo:400:kworker.0 00000100:00100000:3.0:1784093787.114396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093787.114413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093787.114482:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024236160:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.114511:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235776 00000100:00100000:1.0:1784093787.114519:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235776 00000100:00100000:3.0:1784093787.114522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093787.114549:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235520 00000100:00100000:3.0:1784093787.114553:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235520 00000100:00100000:1.0:1784093787.114567:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235904 00000100:00100000:1.0:1784093787.114571:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235904 00000100:00100000:3.0:1784093787.114593:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1784093787.114599:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236160 00000100:00100000:3.0:1784093787.114601:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024235520:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093787.114610:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236160 00002000:00000024:3.0:1784093787.114633:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093787.114638:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1784093787.114648:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024235776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093787.114680:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024235520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093787.114689:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1784093787.114715:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024235648 00000100:00100000:3.0:1784093787.114719:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024235648 00000100:00100000:1.0:1784093787.114724:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024235776:12345-0@lo:400:kworker.0 Request processed in 75us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093787.114733:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1784093787.114754:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1784093787.114762:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024235904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.114792:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024235904:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093787.114799:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1784093787.114807:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1784093787.114814:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1784093787.114823:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024235648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.114825:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024236160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093787.114878:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024235648:12345-0@lo:400:kworker.0 Request processed in 61us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093787.114882:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024236160:12345-0@lo:400:kworker.0 Request processed in 58us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093787.114891:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1784093787.114894:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:3.0:1784093787.114956:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093787.114962:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093787.114977:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024235904:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.114991:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024235776:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.115059:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236032 00000100:00100000:1.0:1784093787.115063:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236032 00000100:00100000:1.0:1784093787.115099:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1784093787.115107:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024236032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.115148:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024236032:12345-0@lo:400:kworker.0 Request processed in 43us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093787.115155:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1784093787.115202:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024235648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.115215:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024236160:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.115225:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:1.0:1784093787.115230:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230ce4380, transno 4294967330 00000100:00100000:1.0:1784093787.115241:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024236032:0@lo:400:kworker.0 00000100:00100000:1.0:1784093787.115261:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024235520:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784093787.115307:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784093787.135720:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000100:00100000:2.0:1784093787.503803:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093787.504004:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691392 00000100:00100000:1.0:1784093787.504015:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691392 00000100:00080000:3.0:1784093787.504126:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093787.504175:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 542 00000100:00100000:1.0:1784093787.504187:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013691392:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093787.504283:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013691392:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 99us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093787.504291:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 542 00000100:00100000:2.0:1784093787.505576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093787.505612:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691520 00000100:00100000:0.0:1784093787.505618:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691520 00000100:00100000:0.0:1784093787.505646:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 258 00000100:00100000:0.0:1784093787.505652:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013691520:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093787.505981:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013691520:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 328us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093787.505988:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 258 00000100:00100000:3.0:1784093787.506909:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.506961:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691648 00000100:00100000:2.0:1784093787.506969:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691648 00000100:00100000:2.0:1784093787.507000:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 259 00000100:00100000:2.0:1784093787.507006:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1870757013691648:12345-192.168.204.57@tcp:8:lfs.0 00010000:00080000:2.0:1784093787.507031:0:6573:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 948 last 0 00000020:00000080:2.0:1784093787.507060:0:6573:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214ca1bc 00002000:00100000:2.0:1784093787.507072:0:6573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff907103950000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 17039360 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784093787.507082:0:6573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784093787.507297:0:6573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784093787.507327:0:6573:0:(import.c:65:import_set_state_nolock()) ffff907103951800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784093787.507378:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013691648:12345-192.168.204.57@tcp:8:lfs.0 Request processed in 371us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093787.507386:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 259 00000100:00100000:2.0:1784093787.509097:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093787.510030:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691776 00000100:00100000:3.0:1784093787.510040:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691776 00000100:00100000:3.0:1784093787.510161:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 260 00000100:00100000:3.0:1784093787.510171:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:41412:x1870757013691776:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093787.510529:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:41412:x1870757013691776:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 359us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093787.510542:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 260 00000100:00080000:0.0:1784093787.510607:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093787.512204:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.512248:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013691904 00000100:00100000:2.0:1784093787.512254:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013691904 00000100:00100000:2.0:1784093787.512287:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 543 00000100:00100000:2.0:1784093787.512293:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013691904:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093787.512730:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013691904:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 435us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093787.512738:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 543 00000100:00100000:1.0:1784093787.515220:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.515636:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692032 00000100:00100000:2.0:1784093787.515649:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692032 00000100:00100000:2.0:1784093787.515707:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:2.0:1784093787.515720:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013692032:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093787.515806:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013692032:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 90us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093787.515826:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:3.0:1784093787.516940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093787.516997:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692160 00000100:00100000:0.0:1784093787.517004:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692160 00000100:00100000:0.0:1784093787.517044:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 261 00000100:00100000:0.0:1784093787.517053:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013692160:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093787.517489:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013692160:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 424us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093787.517497:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 261 00000100:00100000:1.0:1784093787.519756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.519878:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692288 00000100:00100000:2.0:1784093787.519890:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692288 00000100:00100000:2.0:1784093787.519945:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 262 00000100:00100000:2.0:1784093787.519955:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41412:x1870757013692288:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093787.520369:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41412:x1870757013692288:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 415us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093787.520379:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 262 00000100:00100000:1.0:1784093787.522363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.522468:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692416 00000100:00100000:2.0:1784093787.522490:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692416 00000100:00100000:2.0:1784093787.522539:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00100000:2.0:1784093787.522547:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013692416:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093787.522832:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:41412:x1870757013692416:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 285us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093787.522842:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00100000:3.0:1784093787.550214:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.550458:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692544 00000100:00100000:2.0:1784093787.550468:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692544 00000100:00100000:2.0:1784093787.550537:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 546 00000100:00100000:2.0:1784093787.550547:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41416:x1870757013692544:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784093787.550568:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093787.550591:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5714 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.550657:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.550673:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.550686:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.550699:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.550707:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.550714:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551113:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca1d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551132:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551141:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093787.551219:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1784093787.551224:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093787.551542:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551556:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551563:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551570:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551577:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093787.551582:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551590:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551602:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093787.551606:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093787.551611:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551627:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551641:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551647:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551653:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551659:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093787.551662:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551669:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551677:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781c00) 00010000:00010000:2.0:1784093787.551679:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093787.551682:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551688:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca1d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551718:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5714 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551735:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5714 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.551749:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093787.551752:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093787.551755:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784093787.551818:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41416:x1870757013692544:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1271us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093787.551826:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 546 00000100:00100000:1.0:1784093787.554353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.555767:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692800 00000100:00100000:2.0:1784093787.555788:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692800 00000100:00100000:2.0:1784093787.555932:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 547 00000100:00100000:2.0:1784093787.555946:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41416:x1870757013692800:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784093787.555974:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093787.556003:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca1df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf571b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.556460:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.556489:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.556506:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.556525:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.556534:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.556624:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093787.557627:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:2.0:1784093787.557945:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.557956:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.557962:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558005:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558013:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558019:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558025:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093787.558030:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558038:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558053:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093787.558056:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093787.558069:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558077:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca1e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093787.558092:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b83e2c8e reply state 0000000003ec2453 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093787.558104:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093787.558145:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca1df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf571b expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558161:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf571b expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093787.558176:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093787.558178:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093787.558181:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093787.558272:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:41416:x1870757013692800:12345-192.168.204.57@tcp:101:dd.0 Request processed in 2329us (3927us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1784093787.558281:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 547 00010000:00010000:0.0:1784093787.560009:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093787.560024:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093787.560029:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093787.560033:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093787.560036:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093787.560041:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093787.560056:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781700) 00010000:00010000:0.0:1784093787.560058:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093787.560062:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093787.560065:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca1ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093787.561801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093787.561988:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013692928 00000100:00100000:3.0:1784093787.561997:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013692928 00000100:00100000:3.0:1784093787.562070:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 263 00000100:00100000:3.0:1784093787.562077:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:41416:x1870757013692928:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784093787.562092:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093787.562107:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5722 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784093787.562127:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784093787.562142:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=948s v=(0 0) 00010000:00010000:3.0:1784093787.562146:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093787.562153:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 7 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093787.562165:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 7 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093787.562173:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093787.562223:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:41416:x1870757013692928:12345-192.168.204.57@tcp:101:dd.0 Request processed in 147us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093787.562227:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 263 00000100:00100000:1.0:1784093787.572936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.573058:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693056 00000100:00100000:2.0:1784093787.573071:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693056 00002000:00100000:2.0:1784093787.573134:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff907101285180 x1870757013693056/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:108/0 lens 488/0 e 0 to 0 dl 1784093798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784093787.573144:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907101285180 with x1870757013693056 ext(0->1048575) 00002000:00010000:2.0:1784093787.573149:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907101285180 00000100:00100000:2.0:1784093787.573221:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 12 00000100:00100000:2.0:1784093787.573248:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013693056:12345-192.168.204.57@tcp:4:dd.0 00000001:00100000:0.0:1784093787.596943:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000100:00100000:3.0:1784093787.600184:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013693056:12345-192.168.204.57@tcp:4:dd.0 Request processed in 26925us (27249us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1784093787.600213:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 12 00002000:00100000:3.0:1784093787.600228:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff907101285180 x1870757013693056/t4294967329(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:108/0 lens 488/448 e 0 to 0 dl 1784093798 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784093787.600240:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907101285180 with x1870757013693056 ext(0->1048575) 00002000:00010000:3.0:1784093787.600246:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907101285180 00000100:00100000:2.0:1784093787.602299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093787.602398:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693184 00000100:00100000:1.0:1784093787.602409:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693184 00000100:00100000:1.0:1784093787.602590:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:1.0:1784093787.602601:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:41416:x1870757013693184:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:0.0:1784093787.615250:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000100:00100000:1.0:1784093787.615303:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:41416:x1870757013693184:12345-192.168.204.57@tcp:44:dd.0 Request processed in 12698us (13005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093787.615324:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:1.0:1784093787.616884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093787.616976:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693312 00000100:00100000:0.0:1784093787.616989:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693312 00000100:00100000:0.0:1784093787.617027:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 264 00000100:00100000:0.0:1784093787.617036:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013693312:12345-192.168.204.57@tcp:16:dd.0 00010000:00010000:3.0:1784093787.625667:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093787.633349:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000100:00100000:3.0:1784093787.633524:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013693312:12345-192.168.204.57@tcp:16:dd.0 Request processed in 16478us (16632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093787.633538:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 264 00000100:00100000:3.0:1784093787.635389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093787.635522:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693568 00000100:00100000:2.0:1784093787.635532:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693568 00000100:00100000:2.0:1784093787.635646:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 59 00000100:00100000:2.0:1784093787.635658:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:41416:x1870757013693568:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:2.0:1784093787.636075:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:41416:x1870757013693568:12345-192.168.204.57@tcp:35:dd.0 Request processed in 418us (691us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1784093787.636084:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 59 10000000:01000000:2.0:1784093788.010506:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093788.010514:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093788.010520:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093788.010563:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093788.010575:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093788.010586:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093788.010612:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024236288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093788.010667:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093788.010707:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093788.010752:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236288 00000100:00100000:0.0:1784093788.010758:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236288 00000100:00100000:0.0:1784093788.010802:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1784093788.010809:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024236288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093788.010820:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093788.010830:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca209 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093788.010847:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca209 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093788.010855:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca209 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093788.010860:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784093788.010899:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024236288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093788.010904:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1784093788.010971:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024236288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093788.010981:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093788.010996:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093788.011011:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093788.011014:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093788.011019:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784093788.133716:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000004:00080000:3.0:1784093788.617235:0:70403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 949694810817ns, next at 942170966134ns, rc = 0 00000004:00080000:3.0:1784093788.617327:0:70403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 949694904817ns, next at 901165985361ns, rc = 0 00000004:00080000:0.0:1784093788.618273:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000004:00080000:0.0:1784093788.618936:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00010000:00010000:3.0:1784093788.651449:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093789.157115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093789.157161:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693696 00000100:00100000:3.0:1784093789.157172:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693696 00000100:00080000:0.0:1784093789.157222:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093789.157247:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 549 00000100:00100000:3.0:1784093789.157264:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013693696:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093789.157369:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013693696:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 113us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093789.157383:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 549 00000100:00100000:3.0:1784093789.158195:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093789.158245:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693824 00000100:00100000:2.0:1784093789.158252:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693824 00000100:00080000:0.0:1784093789.158298:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093789.158316:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 265 00000100:00100000:2.0:1784093789.158326:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:41608:x1870757013693824:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093789.158686:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:41608:x1870757013693824:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 360us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093789.158693:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 265 00000100:00100000:2.0:1784093789.159385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093789.159616:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013693952 00000100:00100000:3.0:1784093789.159621:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013693952 00000100:00100000:3.0:1784093789.159666:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 266 00000100:00100000:3.0:1784093789.159683:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:41608:x1870757013693952:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784093789.159722:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093789.159981:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:41608:x1870757013693952:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 299us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093789.159995:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 266 00000100:00100000:3.0:1784093789.160989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093789.161025:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694080 00000100:00100000:2.0:1784093789.161031:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694080 00000100:00100000:2.0:1784093789.161069:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 550 00000100:00100000:2.0:1784093789.161080:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013694080:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093789.161494:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013694080:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 415us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093789.161504:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 550 00000100:00100000:2.0:1784093789.162568:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024236416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093789.162623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093789.162671:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236416 00000100:00100000:3.0:1784093789.162677:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236416 00000100:00080000:0.0:1784093789.162721:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093789.162723:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784093789.162733:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024236416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093789.162766:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093789.162814:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024236416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093789.162821:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1784093789.162851:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024236416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093789.163273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093789.163313:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694208 00000100:00100000:2.0:1784093789.163318:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694208 00000100:00100000:2.0:1784093789.163360:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 551 00000100:00100000:2.0:1784093789.163368:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013694208:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093789.163445:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013694208:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093789.163466:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 551 00000100:00100000:2.0:1784093789.164472:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093789.164615:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694336 00000100:00100000:3.0:1784093789.164623:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694336 00000100:00100000:3.0:1784093789.164682:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 267 00000100:00100000:3.0:1784093789.164693:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41608:x1870757013694336:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093789.165065:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41608:x1870757013694336:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 370us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093789.165075:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 267 00000100:00100000:0.0:1784093789.167203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093789.167261:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694464 00000100:00100000:2.0:1784093789.167268:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694464 00000100:00100000:2.0:1784093789.167325:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 268 00000100:00100000:2.0:1784093789.167337:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41608:x1870757013694464:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093789.167741:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41608:x1870757013694464:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 404us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093789.167749:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 268 00000100:00100000:0.0:1784093789.169360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093789.169440:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694592 00000100:00100000:2.0:1784093789.169457:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694592 00000100:00100000:2.0:1784093789.169500:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00100000:2.0:1784093789.169509:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013694592:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093789.169850:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:41608:x1870757013694592:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 342us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093789.169856:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00100000:3.0:1784093789.199405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093789.199522:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694848 00000100:00100000:2.0:1784093789.199532:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694848 00000100:00100000:2.0:1784093789.199584:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 553 00000100:00100000:2.0:1784093789.199594:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:41612:x1870757013694848:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784093789.199646:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093789.199674:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca1f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf571b expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.199690:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093789.199700:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093789.199720:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.199732:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.199742:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.199755:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.199761:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.199768:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.200114:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.200132:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.200139:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784093789.201145:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9280 00000004:00080000:2.0:1784093789.201156:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 950278733117ns, next at 951278731056ns, rc = 0 00010000:00010000:2.0:1784093789.201243:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201254:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201263:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201271:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201278:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201285:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201304:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093789.201329:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201337:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201339:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093789.201349:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201352:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201362:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093789.201366:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201377:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093789.201381:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201384:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201397:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784093789.201401:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093789.201539:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201539:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201559:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca225 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201565:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff90721a781700) 00010000:00010000:1.0:1784093789.201569:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093789.201573:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201581:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca22c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201582:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201597:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201604:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201609:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093789.201611:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093789.201613:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093789.201617:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093789.201618:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093789.201637:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201648:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093789.201651:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093789.201654:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093789.201660:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca217 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093789.201670:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000077e7fc15 reply state 00000000c3b4cdb3 transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093789.201680:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093789.201801:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:41612:x1870757013694848:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2206us (2403us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1784093789.201811:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 553 00010000:00010000:3.0:1784093789.203345:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.203358:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.203377:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.203383:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093789.203387:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.203394:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.203406:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781000) 00010000:00010000:3.0:1784093789.203409:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093789.203412:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.203418:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca21e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093789.674193:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784093790.020939:0:70547:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 951098512586ns, next at 942170966134ns, rc = 0 00000004:00080000:3.0:1784093790.021061:0:70547:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 951098638551ns, next at 951278731056ns, rc = 0 00000001:00080000:0.0:1784093790.033766:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000004:00080000:0.0:1784093790.033778:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00000004:00080000:0.0:1784093790.033795:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000004:00080000:0.0:1784093790.033804:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000100:00100000:1.0:1784093790.033996:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024236544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784093790.034068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093790.034107:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236544 00000100:00100000:3.0:1784093790.034119:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236544 00000100:00080000:0.0:1784093790.034176:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093790.034210:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784093790.034224:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024236544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784093790.034261:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:17 count 1 00010000:00010000:3.0:1784093790.034292:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.034336:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 5 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.034346:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1784093790.034351:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093790.034357:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.034391:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 5 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.034409:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 5 pid: 6574 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093790.034675:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024236672:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093790.034777:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff907225f8f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784093790.036571:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024236672:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784093790.036639:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093790.036669:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093790.037358:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013694976 00000100:00100000:2.0:1784093790.037371:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013694976 00010000:00010000:2.0:1784093790.037413:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 6 pid: 6574 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093790.037515:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 251 00000100:00100000:2.0:1784093790.037527:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013694976:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093790.037545:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093790.037552:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 6 pid: 6574 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093790.037583:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 6 pid: 6574 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093790.037609:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ca202 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5722 expref: 6 pid: 6574 timeout: 1051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093790.037626:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093790.037631:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093790.037637:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093790.037646:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093790.037679:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093790.037701:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.037710:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.037732:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093790.037739:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093790.037746:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013694976:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 218us (1076us total) trans 0 rc 0/0 00010000:00010000:3.0:1784093790.037755:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784093790.037770:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 251 00010000:00010000:1.0:1784093790.037884:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093790.037892:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093790.037914:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093790.037918:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093790.037928:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093790.037942:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093790.037949:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214ca233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093790.037967:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093790.037969:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093790.037971:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093790.038410:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024236544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4189us (4342us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1784093790.038416:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000004:00080000:1.0:1784093790.038489:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237375f80/2, rc 0, transno 4294967330 00000100:00100000:1.0:1784093790.038508:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024236544:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784093790.697587:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093791.608682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093791.608717:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093791.608734:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695104 00000100:00100000:3.0:1784093791.608745:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695104 00000100:00100000:0.0:1784093791.608757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093791.608797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093791.608817:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 666 00000100:00100000:3.0:1784093791.608831:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013695104:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093791.608838:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695360 00000100:00100000:1.0:1784093791.608844:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695360 00000100:00100000:0.0:1784093791.608845:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695488 00000100:00100000:0.0:1784093791.608850:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695488 00000100:00100000:0.0:1784093791.608892:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 425 00000100:00100000:0.0:1784093791.608901:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013695488:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093791.608913:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 426 00000100:00100000:3.0:1784093791.608921:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013695104:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093791.608927:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013695360:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093791.608934:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 666 00000100:00100000:0.0:1784093791.608938:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013695488:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093791.608947:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 425 00000100:00080000:0.0:1784093791.608969:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093791.608974:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093791.608976:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013695360:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093791.609000:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 426 00000100:00100000:2.0:1784093791.609056:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695232 00000100:00100000:2.0:1784093791.609060:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695232 00000100:00100000:2.0:1784093791.609115:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 623 00000100:00100000:2.0:1784093791.609124:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013695232:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093791.609170:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013695232:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093791.609176:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 623 00000100:00080000:0.0:1784093791.609281:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784093791.721558:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093792.233576:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024236800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093792.233645:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093792.233676:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024236928:0@lo:400:kworker.0 00000100:00100000:3.0:1784093792.233695:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236800 00000100:00100000:3.0:1784093792.233703:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236800 00000100:00100000:1.0:1784093792.233721:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024237312:0@lo:400:kworker.0 00000100:00100000:2.0:1784093792.233726:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024237056:0@lo:400:kworker.0 00000100:00100000:0.0:1784093792.233738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093792.233766:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1784093792.233770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093792.233774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093792.233778:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024236800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093792.233785:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024237440:0@lo:400:kworker.0 00000100:00100000:2.0:1784093792.233806:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00000024:3.0:1784093792.233813:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1784093792.233815:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024237184:0@lo:400:kworker.0 00000100:00100000:0.0:1784093792.233821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093792.233822:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024236928 00000100:00100000:1.0:1784093792.233828:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024236928 00000100:00100000:2.0:1784093792.233847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093792.233869:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024236800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093792.233881:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237056 00000100:00100000:0.0:1784093792.233886:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237056 00000100:00100000:1.0:1784093792.233888:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1784093792.233894:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237440 00000100:00100000:3.0:1784093792.233897:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784093792.233899:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237440 00000100:00100000:1.0:1784093792.233903:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024236928:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093792.233917:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093792.233923:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093792.233932:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237184 00000100:00100000:3.0:1784093792.233933:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237312 00000100:00100000:2.0:1784093792.233934:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237184 00000100:00100000:3.0:1784093792.233936:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237312 00000100:00100000:0.0:1784093792.233951:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1784093792.233954:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024236928:12345-0@lo:400:kworker.0 Request processed in 54us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093792.233965:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1784093792.233966:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024237440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093792.233971:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1784093792.233971:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1784093792.233983:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024237312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093792.233983:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093792.234024:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024237440:12345-0@lo:400:kworker.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093792.234034:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024237440:0@lo:400:kworker.0 00000100:00100000:0.0:1784093792.234035:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1784093792.234036:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024237312:12345-0@lo:400:kworker.0 Request processed in 52us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093792.234036:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024237056:12345-0@lo:400:kworker.0 Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093792.234050:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1784093792.234050:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1784093792.234056:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024236928:0@lo:400:kworker.0 00000100:00100000:0.0:1784093792.234062:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00080000:3.0:1784093792.234074:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093792.234079:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024237184:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093792.234080:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093792.234110:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024237312:0@lo:400:kworker.0 00000100:00100000:0.0:1784093792.234122:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024237184:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093792.234123:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024237056:0@lo:400:kworker.0 00000100:00100000:1.0:1784093792.234132:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024236800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093792.234137:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1784093792.234158:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024237184:0@lo:400:kworker.0 00010000:00010000:0.0:1784093792.745739:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093793.769670:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093794.281747:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024237568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093794.281870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093794.281916:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237568 00000100:00100000:0.0:1784093794.281926:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237568 00000100:00100000:0.0:1784093794.281996:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1784093794.282008:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024237568:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784093794.282076:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784093794.282087:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093794.282153:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024237568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093794.282163:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784093794.282188:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024237568:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784093794.290790:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00010000:00010000:3.0:1784093794.793574:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093795.817538:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093796.728363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093796.728402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093796.728416:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695616 00000100:00100000:3.0:1784093796.728452:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695616 00000100:00100000:2.0:1784093796.728469:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695744 00000100:00100000:2.0:1784093796.728475:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695744 00000100:00100000:0.0:1784093796.728484:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093796.728513:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 668 00000100:00100000:0.0:1784093796.728520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093796.728528:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013695616:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093796.728534:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 627 00000100:00100000:1.0:1784093796.728542:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013695872 00000100:00100000:2.0:1784093796.728546:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013695744:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093796.728559:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013695872 00000100:00100000:1.0:1784093796.728601:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696000 00000100:00100000:3.0:1784093796.728602:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013695616:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093796.728605:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013695744:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093796.728606:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696000 00000100:00100000:3.0:1784093796.728613:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 668 00000100:00100000:0.0:1784093796.728619:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 428 00000100:00100000:2.0:1784093796.728620:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 627 00000100:00100000:0.0:1784093796.728636:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013695872:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093796.728650:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 429 00000100:00100000:1.0:1784093796.728662:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013696000:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093796.728680:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093796.728686:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093796.728686:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013695872:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093796.728690:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093796.728694:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 428 00000100:00100000:1.0:1784093796.728732:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013696000:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093796.728768:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 429 00010000:00010000:0.0:1784093796.841508:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093797.353608:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024237696:0@lo:400:kworker.0 00000100:00100000:2.0:1784093797.353612:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024238080:0@lo:400:kworker.0 00000100:00100000:1.0:1784093797.353671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093797.353679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093797.353708:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237696 00000100:00100000:0.0:1784093797.353715:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237696 00000100:00100000:1.0:1784093797.353725:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024238208:0@lo:400:kworker.0 00000100:00100000:3.0:1784093797.353729:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238080 00000100:00100000:3.0:1784093797.353736:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238080 00000100:00100000:2.0:1784093797.353740:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024237824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093797.353759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093797.353763:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1784093797.353774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093797.353779:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024237696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093797.353799:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024238336:0@lo:400:kworker.0 00000100:00100000:3.0:1784093797.353801:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1784093797.353809:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024237952:0@lo:400:kworker.0 00000100:00100000:3.0:1784093797.353815:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024238080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093797.353844:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024237696:12345-0@lo:400:kworker.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093797.353853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093797.353856:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1784093797.353873:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238208 00000100:00100000:1.0:1784093797.353878:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238208 00000100:00100000:3.0:1784093797.353889:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024238080:12345-0@lo:400:kworker.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093797.353897:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1784093797.353907:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238336 00000100:00100000:2.0:1784093797.353913:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238336 00000100:00100000:0.0:1784093797.353921:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024237696:0@lo:400:kworker.0 00000100:00080000:3.0:1784093797.353926:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093797.353927:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00080000:3.0:1784093797.353933:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093797.353942:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024238208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093797.353952:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237824 00000100:00100000:2.0:1784093797.353955:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1784093797.353958:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237824 00000100:00100000:2.0:1784093797.353965:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024238336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093797.353969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093797.354004:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024238464:0@lo:400:kworker.0 00000100:00100000:3.0:1784093797.354005:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1784093797.354005:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024238208:12345-0@lo:400:kworker.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093797.354015:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024238336:12345-0@lo:400:kworker.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093797.354021:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024237824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093797.354023:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1784093797.354029:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1784093797.354035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093797.354045:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024237952 00000100:00100000:2.0:1784093797.354048:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024237952 00000100:00100000:1.0:1784093797.354054:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238464 00002000:00000024:3.0:1784093797.354057:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093797.354060:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238464 00000100:00100000:2.0:1784093797.354075:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1784093797.354082:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024237952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093797.354100:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1784093797.354104:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024237824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093797.354114:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024238464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093797.354116:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1784093797.354122:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024237952:12345-0@lo:400:kworker.0 Request processed in 39us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093797.354129:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00080000:3.0:1784093797.354149:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093797.354153:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024238208:0@lo:400:kworker.0 00000100:00100000:0.0:1784093797.354158:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024238464:12345-0@lo:400:kworker.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093797.354167:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1784093797.354184:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000100:00100000:3.0:1784093797.354186:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024238080:0@lo:400:kworker.0 00000004:00080000:2.0:1784093797.354188:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237375f80, transno 4294967330 00000100:00100000:1.0:1784093797.354208:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024237952:0@lo:400:kworker.0 00000100:00100000:2.0:1784093797.354216:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024237824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093797.354226:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024238464:0@lo:400:kworker.0 00000100:00100000:2.0:1784093797.354236:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024238336:0@lo:400:kworker.0 00010000:00010000:1.0:1784093797.865620:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093798.889600:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093799.401627:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024238592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093799.401688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093799.401781:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238592 00000100:00100000:0.0:1784093799.401789:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238592 00000100:00080000:3.0:1784093799.401841:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093799.401877:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784093799.401888:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024238592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093799.401922:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093799.401982:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024238592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093799.402002:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1784093799.402045:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024238592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093799.913654:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093800.937554:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093801.848342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093801.848388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093801.848406:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696256 00000100:00100000:3.0:1784093801.848417:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696256 00000100:00100000:2.0:1784093801.848455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093801.848463:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696128 00000100:00100000:0.0:1784093801.848470:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696128 00000100:00100000:1.0:1784093801.848486:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696384 00000100:00100000:1.0:1784093801.848491:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696384 00000100:00100000:2.0:1784093801.848495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093801.848527:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 670 00000100:00100000:3.0:1784093801.848528:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 631 00000100:00100000:1.0:1784093801.848529:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696512 00000100:00100000:1.0:1784093801.848533:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696512 00000100:00100000:0.0:1784093801.848554:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013696128:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093801.848556:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013696256:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093801.848558:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 432 00000100:00080000:2.0:1784093801.848567:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093801.848570:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013696384:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784093801.848593:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093801.848597:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093801.848623:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 433 00000100:00100000:1.0:1784093801.848624:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013696384:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093801.848626:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013696256:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093801.848632:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013696128:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093801.848641:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013696512:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093801.848641:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 432 00000100:00100000:3.0:1784093801.848649:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 631 00000100:00100000:0.0:1784093801.848652:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 670 00000100:00100000:2.0:1784093801.848686:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013696512:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093801.848695:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 433 00010000:00010000:1.0:1784093801.961593:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093802.473618:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024238720:0@lo:400:kworker.0 00000100:00100000:1.0:1784093802.473618:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024238848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093802.473627:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024238976:0@lo:400:kworker.0 00000100:00100000:2.0:1784093802.473650:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024239104:0@lo:400:kworker.0 00000100:00100000:0.0:1784093802.473698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093802.473703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093802.473708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093802.473733:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238976 00000100:00100000:2.0:1784093802.473741:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238976 00000100:00100000:1.0:1784093802.473766:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024239232:0@lo:400:kworker.0 00000100:00100000:0.0:1784093802.473774:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024239488:0@lo:400:kworker.0 00000100:00100000:3.0:1784093802.473775:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024239360:0@lo:400:kworker.0 00000100:00100000:2.0:1784093802.473803:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1784093802.473806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093802.473816:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024238976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093802.473834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093802.473836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093802.473856:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238848 00000100:00100000:1.0:1784093802.473862:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238848 00000100:00100000:2.0:1784093802.473879:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024238976:12345-0@lo:400:kworker.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093802.473880:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239360 00000100:00100000:3.0:1784093802.473887:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239360 00000100:00100000:2.0:1784093802.473890:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1784093802.473895:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024238976:0@lo:400:kworker.0 00000100:00100000:1.0:1784093802.473909:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1784093802.473921:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1784093802.473921:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024238848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093802.473936:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024239360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093802.473936:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024238720 00000100:00100000:0.0:1784093802.473943:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024238720 00002000:00000024:1.0:1784093802.473951:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784093802.473974:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093802.473980:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093802.473984:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1784093802.473992:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024239360:12345-0@lo:400:kworker.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093802.473998:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024238720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093802.473999:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239232 00000100:00100000:3.0:1784093802.474005:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239232 00000100:00100000:2.0:1784093802.474006:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1784093802.474023:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024238848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093802.474032:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784093802.474049:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239488 00000100:00100000:2.0:1784093802.474052:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024239360:0@lo:400:kworker.0 00000100:00100000:0.0:1784093802.474054:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024238720:12345-0@lo:400:kworker.0 Request processed in 60us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093802.474055:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239488 00000100:00100000:2.0:1784093802.474063:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024238720:0@lo:400:kworker.0 00000100:00100000:0.0:1784093802.474067:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1784093802.474071:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1784093802.474084:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024239232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093802.474094:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00080000:2.0:1784093802.474094:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093802.474106:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024239488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093802.474118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093802.474122:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024239232:12345-0@lo:400:kworker.0 Request processed in 42us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093802.474137:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239104 00000100:00100000:1.0:1784093802.474140:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1784093802.474143:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239104 00000100:00100000:3.0:1784093802.474164:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024239488:12345-0@lo:400:kworker.0 Request processed in 58us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093802.474174:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1784093802.474189:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024239488:0@lo:400:kworker.0 00000100:00100000:1.0:1784093802.474206:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024238848:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784093802.474219:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093802.474221:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1784093802.474229:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024239232:0@lo:400:kworker.0 00000100:00100000:2.0:1784093802.474235:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024239104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093802.474289:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024239104:12345-0@lo:400:kworker.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093802.474297:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1784093802.474322:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024239104:0@lo:400:kworker.0 00010000:00010000:3.0:1784093802.985588:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093804.009585:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093804.521626:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093804.521651:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024239616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093804.521725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093804.521771:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239616 00000100:00100000:2.0:1784093804.521780:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239616 00000100:00080000:1.0:1784093804.521867:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093804.521930:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784093804.521947:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024239616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093804.521979:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093804.522034:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024239616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093804.522042:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1784093804.522091:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024239616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093805.033511:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093806.057607:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093806.968386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093806.968419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093806.968467:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093806.968508:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696768 00000100:00100000:0.0:1784093806.968508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093806.968519:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696768 00000100:00100000:0.0:1784093806.968553:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697024 00000100:00100000:1.0:1784093806.968561:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696896 00000100:00100000:0.0:1784093806.968561:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697024 00000100:00100000:1.0:1784093806.968573:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696896 00000100:00100000:2.0:1784093806.968589:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 635 00000100:00100000:2.0:1784093806.968603:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013696768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093806.968614:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 436 00000100:00100000:0.0:1784093806.968626:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013697024:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093806.968657:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 437 00000100:00100000:1.0:1784093806.968674:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013696896:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093806.968676:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013696640 00000100:00100000:3.0:1784093806.968683:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013696640 00000100:00100000:2.0:1784093806.968689:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013696768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093806.968697:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013697024:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093806.968703:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 635 00000100:00100000:0.0:1784093806.968717:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 436 00000100:00100000:3.0:1784093806.968733:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 672 00000100:00100000:3.0:1784093806.968749:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013696640:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093806.968758:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013696896:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093806.968772:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 437 00000100:00080000:0.0:1784093806.968782:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093806.968791:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013696640:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 47us (411us total) trans 0 rc 0/0 00000100:00080000:0.0:1784093806.968791:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093806.968801:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093806.968806:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 672 00010000:00010000:3.0:1784093807.081675:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093807.593643:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024239744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093807.593643:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024240000:0@lo:400:kworker.0 00000100:00100000:1.0:1784093807.593660:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024239872:0@lo:400:kworker.0 00000100:00100000:2.0:1784093807.593681:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024240128:0@lo:400:kworker.0 00000100:00100000:0.0:1784093807.593764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093807.593766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093807.593770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093807.593803:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240000 00000100:00100000:2.0:1784093807.593811:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240000 00000100:00100000:1.0:1784093807.593835:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024240256:0@lo:400:kworker.0 00000100:00100000:0.0:1784093807.593847:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024240512:0@lo:400:kworker.0 00000100:00100000:3.0:1784093807.593848:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024240384:0@lo:400:kworker.0 00000100:00100000:1.0:1784093807.593871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093807.593878:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1784093807.593890:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024240000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093807.593897:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093807.593907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093807.593924:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239744 00000100:00100000:1.0:1784093807.593929:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239744 00000100:00100000:0.0:1784093807.593949:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240384 00000100:00100000:0.0:1784093807.593955:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240384 00000100:00100000:2.0:1784093807.593963:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024240000:12345-0@lo:400:kworker.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093807.593971:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1784093807.593974:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024239872 00000100:00100000:3.0:1784093807.593980:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024239872 00000100:00100000:1.0:1784093807.593990:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784093807.593995:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1784093807.594003:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024239744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093807.594007:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024240384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093807.594016:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240256 00000100:00100000:0.0:1784093807.594022:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240256 00000100:00100000:3.0:1784093807.594026:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1784093807.594038:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024239872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093807.594052:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024240384:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00002000:00000024:1.0:1784093807.594057:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093807.594070:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1784093807.594070:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240512 00000100:00100000:0.0:1784093807.594076:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240512 00000100:00100000:3.0:1784093807.594093:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024239872:12345-0@lo:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093807.594113:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1784093807.594128:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1784093807.594135:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024239744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093807.594141:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024240256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093807.594144:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024240384:0@lo:400:kworker.0 00000100:00100000:1.0:1784093807.594149:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784093807.594170:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024239744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093807.594191:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1784093807.594197:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024240256:12345-0@lo:400:kworker.0 Request processed in 60us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093807.594203:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093807.594210:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00080000:2.0:1784093807.594220:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093807.594227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784093807.594229:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093807.594234:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093807.594253:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240128 00000100:00100000:0.0:1784093807.594253:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024240000:0@lo:400:kworker.0 00000100:00100000:2.0:1784093807.594260:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240128 00000100:00100000:1.0:1784093807.594262:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024240512:12345-0@lo:400:kworker.0 Request processed in 61us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093807.594272:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1784093807.594284:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024240512:0@lo:400:kworker.0 00000100:00080000:3.0:1784093807.594302:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093807.594303:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1784093807.594314:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024239872:0@lo:400:kworker.0 00000100:00100000:2.0:1784093807.594315:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024240128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093807.594330:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024240256:0@lo:400:kworker.0 00000100:00100000:2.0:1784093807.594359:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024240128:12345-0@lo:400:kworker.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093807.594364:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1784093807.594399:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024240128:0@lo:400:kworker.0 00010000:00010000:2.0:1784093808.105591:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093808.645799:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093808.645855:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697152 00000100:00100000:2.0:1784093808.645865:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697152 00000100:00080000:3.0:1784093808.645920:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093808.645937:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 554 00000100:00100000:2.0:1784093808.645950:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013697152:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093808.646046:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013697152:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093808.646055:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 554 00000100:00100000:2.0:1784093808.646868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093808.646913:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697280 00000100:00100000:1.0:1784093808.646918:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697280 00000100:00080000:3.0:1784093808.646959:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093808.646959:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 270 00000100:00100000:1.0:1784093808.646969:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697280:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093808.647244:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697280:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 276us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093808.647252:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 270 00000100:00100000:0.0:1784093808.648658:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093808.648709:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697408 00000100:00100000:2.0:1784093808.648715:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697408 00000100:00100000:2.0:1784093808.648762:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 271 00000100:00080000:3.0:1784093808.648764:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093808.648774:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697408:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093808.649009:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697408:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 237us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093808.649014:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 271 00000100:00100000:3.0:1784093808.649706:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093808.649755:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697536 00000100:00100000:0.0:1784093808.649760:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697536 00000100:00100000:0.0:1784093808.649794:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 555 00000100:00100000:0.0:1784093808.649801:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013697536:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093808.650073:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013697536:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 273us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093808.650088:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 555 00000100:00100000:0.0:1784093808.651735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093808.651794:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697664 00000100:00100000:2.0:1784093808.651804:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697664 00000100:00100000:2.0:1784093808.651846:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 556 00000100:00100000:2.0:1784093808.651855:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013697664:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093808.651967:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013697664:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 111us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093808.651975:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 556 00000100:00100000:3.0:1784093808.652799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093808.652856:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697792 00000100:00100000:1.0:1784093808.652861:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697792 00000100:00100000:1.0:1784093808.652896:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 272 00000100:00100000:1.0:1784093808.652903:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697792:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093808.653226:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697792:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 322us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093808.653239:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 272 00000100:00100000:3.0:1784093808.653859:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093808.653909:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013697920 00000100:00100000:1.0:1784093808.653914:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013697920 00000100:00100000:1.0:1784093808.653944:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 273 00000100:00100000:1.0:1784093808.653949:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697920:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093808.654168:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:41991:x1870757013697920:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 217us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093808.654176:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 273 00000100:00100000:0.0:1784093808.654843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093808.654886:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013698048 00000100:00100000:2.0:1784093808.654898:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013698048 00000100:00100000:2.0:1784093808.654935:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 557 00000100:00100000:2.0:1784093808.654945:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013698048:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093808.655231:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:41991:x1870757013698048:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 286us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093808.655238:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 557 00010000:00010000:0.0:1784093809.129583:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093809.488771:0:71006:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6658de20 20000000:00000080:2.0:1784093809.488788:0:71006:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90710388ac00 uarg=0000000000000000 00010000:00010000:2.0:1784093809.489195:0:71006:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784093809.489226:0:71006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093809.489229:0:71006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093809.489237:0:71006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca1d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5714 expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.489258:0:71006:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784093809.489279:0:71006:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093809.489292:0:71006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.489303:0:71006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca209 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.489312:0:71006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.489347:0:71006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca209 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.489360:0:71006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca209 expref: 18 pid: 5772 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093809.489371:0:71006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71006:1870757024240640:0@lo:104: 00000100:00100000:2.0:1784093809.489418:0:71006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093809.489476:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240640 00000100:00100000:2.0:1784093809.489482:0:71006:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219ec8540 going to sleep for 11 seconds 00000100:00100000:1.0:1784093809.489485:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240640 00000100:00100000:1.0:1784093809.489533:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784093809.489543:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:71006:x1870757024240640:12345-0@lo:104: 00010000:00010000:1.0:1784093809.489556:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093809.489617:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093809.489623:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:71006:x1870757024240640:12345-0@lo:104: Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093809.489632:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784093809.489637:0:71006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71006:1870757024240640:0@lo:104: 00010000:00010000:3.0:1784093809.489639:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093809.489647:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093809.489655:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093809.489658:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.489662:0:71006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093809.489665:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093809.489678:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093809.489682:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093809.489707:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093809.489714:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093809.489738:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093809.489744:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024240768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093809.489759:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214ca209 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca210 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093809.489774:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093809.489778:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093809.489779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784093809.489781:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093809.489828:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240768 00000100:00100000:0.0:1784093809.489833:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240768 00010000:00010000:0.0:1784093809.489864:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca209 expref: 19 pid: 5772 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093809.489891:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1784093809.489898:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024240768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093809.489909:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093809.489915:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca209 expref: 19 pid: 5772 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489925:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca209 expref: 19 pid: 5772 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489936:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214ca210 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca209 expref: 19 pid: 5772 timeout: 1120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489959:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489967:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489979:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489985:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489992:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.489998:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.490004:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093809.490007:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.490015:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.490031:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093809.490040:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093809.490059:0:71006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.490078:0:71006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093809.490091:0:71006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214ca23a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093809.490099:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024240768:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093809.490120:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784093809.490123:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024240768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093809.641578:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024240896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093809.641653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093809.641740:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024240896 00000100:00100000:2.0:1784093809.641748:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024240896 00000100:00100000:2.0:1784093809.641808:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784093809.641818:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024240896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093809.641854:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093809.641900:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024240896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093809.641908:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:2.0:1784093809.641932:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093809.641988:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024240896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093810.153544:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093810.479967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093810.480019:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013698176 00000100:00100000:0.0:1784093810.480030:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013698176 00000100:00080000:3.0:1784093810.480085:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093810.480118:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 558 00000100:00100000:0.0:1784093810.480131:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:42078:x1870757013698176:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093810.480150:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093810.480172:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5729 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.480237:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.480251:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.480265:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093810.480491:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:0.0:1784093810.480496:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093810.480605:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.480634:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5729 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.480650:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5729 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.480670:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784093810.480674:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093810.480677:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784093810.480729:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:42078:x1870757013698176:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 601us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093810.480737:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 558 00000100:00100000:3.0:1784093810.482150:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093810.482196:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013698432 00000100:00100000:0.0:1784093810.482203:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013698432 00000100:00100000:0.0:1784093810.482242:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 559 00000100:00100000:0.0:1784093810.482250:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:42078:x1870757013698432:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093810.482291:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093810.482309:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5729 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.482323:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca1d8) 00010000:00010000:0.0:1784093810.482326:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784093810.482333:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093810.482349:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.482359:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093810.482368:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093810.495027:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000004:00010000:1.0:1784093810.495032:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000032dc85c3 reply state 000000008e62e000 transno 4294967512 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093810.495061:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093810.495178:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00080000:1.0:1784093810.495276:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784093810.495296:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:42078:x1870757013698432:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 13042us (13143us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1784093810.495314:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 559 00010000:00010000:1.0:1784093810.495460:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093810.495469:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093810.495477:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093810.495484:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093810.495488:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093810.495496:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093810.495525:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b000) 00010000:00010000:1.0:1784093810.495528:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093810.495533:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093810.495539:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca24f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093810.785863:0:71202:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffc3f87d0 20000000:00000080:2.0:1784093810.785879:0:71202:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103889000 uarg=0000000000000000 00010000:00010000:2.0:1784093810.786350:0:71202:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093810.786364:0:71202:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093810.786377:0:71202:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093810.786394:0:71202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786407:0:71202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786450:0:71202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786458:0:71202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786465:0:71202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786472:0:71202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786479:0:71202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093810.786483:0:71202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786491:0:71202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786503:0:71202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786511:0:71202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093810.786517:0:71202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214ca256 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093811.114476:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093811.114483:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093811.114489:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093811.114544:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.114557:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.114566:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093811.114594:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024241024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093811.114669:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093811.114724:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241024 00000100:00100000:2.0:1784093811.114731:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26c300 going to sleep for 11 seconds 00000100:00100000:0.0:1784093811.114738:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241024 00000100:00100000:0.0:1784093811.114808:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1784093811.114819:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024241024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093811.114832:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093811.114846:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca25d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.114870:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca25d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.114882:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca25d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.114892:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784093811.114938:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024241024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093811.114947:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1784093811.114973:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024241024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093811.114991:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.115001:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093811.115019:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093811.115025:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.115045:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.177551:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093811.800344:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093811.800398:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013698560 00000100:00100000:2.0:1784093811.800407:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013698560 00000100:00100000:2.0:1784093811.800506:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:2.0:1784093811.800521:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42154:x1870757013698560:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093811.800547:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093811.800570:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5730 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.800647:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.800661:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.800676:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.800691:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.800698:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.800705:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801307:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801318:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801325:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093811.801464:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1784093811.801469:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093811.801566:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801579:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801586:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801593:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801599:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.801604:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801612:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801627:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093811.801631:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093811.801636:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801642:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801658:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801675:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801682:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801688:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.801694:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801702:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801712:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781d00) 00010000:00010000:2.0:1784093811.801715:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093811.801717:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801724:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801763:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5730 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801785:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5730 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.801794:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093811.801797:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093811.801807:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093811.801866:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:42154:x1870757013698560:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1346us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093811.801876:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:1.0:1784093811.803608:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093811.803658:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013698816 00000100:00100000:2.0:1784093811.803667:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013698816 00000100:00100000:2.0:1784093811.803713:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 561 00000100:00100000:2.0:1784093811.803724:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:42154:x1870757013698816:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093811.803738:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093811.803752:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca287 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5737 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.804092:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.804111:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.804121:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.804137:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.804144:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.804152:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093811.804996:0:7044:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7044:1870757024241152:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784093811.805057:0:7044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093811.805097:0:7044:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784093811.805114:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241152 00000100:00100000:3.0:1784093811.805119:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241152 00000100:00100000:3.0:1784093811.805168:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784093811.805177:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:7044:x1870757024241152:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784093811.805218:0:53396:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:2.0:1784093811.805328:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:2.0:1784093811.805772:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805783:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805793:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805831:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805840:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805847:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805854:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.805859:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805867:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805880:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093811.805884:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093811.805888:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805895:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca28e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093811.805918:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005571d96d reply state 00000000372faa81 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093811.805926:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093811.805953:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca287 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5737 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805970:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca29c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5737 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.805977:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784093811.805980:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093811.805983:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784093811.806051:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:42154:x1870757013698816:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 2328us (2446us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1784093811.806060:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 561 00000100:00080000:2.0:1784093811.806104:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784093811.807669:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.807681:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.807699:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.807706:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093811.807711:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.807718:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.807732:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781500) 00010000:00010000:1.0:1784093811.807735:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093811.807740:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.807747:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca295 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093811.807854:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093811.807915:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013699072 00000100:00100000:1.0:1784093811.807924:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013699072 00000100:00100000:1.0:1784093811.807973:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 562 00000100:00100000:1.0:1784093811.807985:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:42154:x1870757013699072:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:1.0:1784093811.808046:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093811.808062:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca29c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5737 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808074:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff90721a781800) 00010000:00010000:1.0:1784093811.808082:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093811.808121:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808132:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808142:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093811.808254:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000456a85d4 reply state 000000006434ab5c transno 4294967514 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093811.808263:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093811.808337:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:42154:x1870757013699072:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 355us (484us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1784093811.808345:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 562 00010000:00010000:1.0:1784093811.808918:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808927:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808934:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808940:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093811.808944:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808951:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808961:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784093811.808969:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093811.808972:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.808976:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca2aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093811.809265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093811.809304:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013699200 00000100:00100000:1.0:1784093811.809310:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013699200 00000100:00100000:1.0:1784093811.809344:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:1.0:1784093811.809353:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:42154:x1870757013699200:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784093811.809367:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093811.809381:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca2b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf573e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.809414:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf573e expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.809443:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf573e expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.809463:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093811.809466:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093811.809469:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784093811.809504:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:42154:x1870757013699200:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 152us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093811.809513:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:2.0:1784093811.810459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093811.810480:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013699328 00000100:00100000:1.0:1784093811.810486:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013699328 00000100:00080000:2.0:1784093811.810518:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093811.810538:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 275 00000100:00100000:1.0:1784093811.810544:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013699328:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:1.0:1784093811.810849:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013699328:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 302us (389us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784093811.810858:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 275 00000100:00100000:2.0:1784093811.811783:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093811.811829:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013699584 00000100:00100000:1.0:1784093811.811835:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013699584 00000100:00100000:1.0:1784093811.811873:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 60 00000100:00100000:1.0:1784093811.811882:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:42154:x1870757013699584:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:1.0:1784093811.812125:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:42154:x1870757013699584:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 243us (341us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1784093811.812132:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 60 00000100:00100000:3.0:1784093811.819046:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:7044:x1870757024241152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13865us (13983us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1784093811.819060:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784093811.819083:0:7044:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7044:1870757024241152:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784093811.819100:0:7044:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1784093811.830624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093811.830678:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013699712 00000100:00100000:2.0:1784093811.830688:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013699712 00000100:00100000:2.0:1784093811.830748:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 564 00000100:00100000:2.0:1784093811.830757:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:42158:x1870757013699712:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784093811.830779:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093811.830797:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca2b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5745 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830851:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830862:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830870:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830879:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830884:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830888:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.830996:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831003:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831010:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093811.831064:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00000004:00200000:2.0:1784093811.831069:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093811.831087:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831097:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831103:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831108:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831112:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831116:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.831119:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831123:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831132:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093811.831134:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093811.831136:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831140:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca2bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831156:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831160:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831163:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831166:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.831167:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831171:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831174:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781900) 00010000:00010000:2.0:1784093811.831176:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093811.831177:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831180:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca2c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831203:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca2b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5745 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831212:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5745 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.831226:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff907219c12000) 00010000:00010000:2.0:1784093811.831228:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093811.831231:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784093811.831296:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:42158:x1870757013699712:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 540us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093811.831304:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 564 00000100:00100000:2.0:1784093811.832938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093811.832978:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013699840 00000100:00100000:1.0:1784093811.832986:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013699840 00000100:00100000:1.0:1784093811.833040:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 276 00000100:00100000:1.0:1784093811.833050:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013699840:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784093811.833062:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093811.833075:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf574c expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093811.833095:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x6a571c74, atime: 0x6a571c74, ctime: 0x6a571c74, blocks: 0x1 00010000:00010000:1.0:1784093811.833107:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=972s v=(0 0) 00010000:00010000:1.0:1784093811.833111:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093811.833117:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.833140:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.833148:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784093811.833179:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013699840:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093811.833184:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 276 00000100:00100000:1.0:1784093811.835090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093811.835137:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700096 00000100:00100000:2.0:1784093811.835145:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700096 00000100:00100000:2.0:1784093811.835188:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 565 00000100:00100000:2.0:1784093811.835197:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:42158:x1870757013700096:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784093811.835247:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093811.835269:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca2cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5745 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835286:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca2b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf573e expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835295:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff907219c12000) 00010000:00010000:2.0:1784093811.835303:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093811.835319:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835329:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835337:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835359:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835368:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835376:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835507:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835516:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.835523:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784093811.835968:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9344 00000004:00080000:2.0:1784093811.835975:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 972913552393ns, next at 973913550877ns, rc = 0 00010000:00010000:2.0:1784093811.836016:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836041:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836049:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836056:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836072:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836079:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836097:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093811.836115:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093811.836117:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.836124:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836126:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836143:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.836144:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093811.836152:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836153:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.836160:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.836165:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836169:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.836184:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784093811.836188:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093811.836198:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836200:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784093811.836207:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093811.836209:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca2f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836211:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836226:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca2e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.836233:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093811.836238:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093811.836245:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093811.836247:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093811.836255:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836260:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836262:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093811.836264:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836269:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836274:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093811.836275:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093811.836277:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093811.836281:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca2db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093811.836291:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000009f6875d9 reply state 0000000093921e7d transno 4294967516 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093811.836299:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093811.836360:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:42158:x1870757013700096:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1165us (1272us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1784093811.836368:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 565 00010000:00010000:1.0:1784093811.837124:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.837133:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.837139:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.837145:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093811.837149:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.837155:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.837164:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff90721a781d00) 00010000:00010000:1.0:1784093811.837167:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093811.837170:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093811.837182:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca2e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093812.088322:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093812.088406:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093812.088489:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700224 00000100:00100000:3.0:1784093812.088512:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700224 00000100:00100000:2.0:1784093812.088560:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700352 00000100:00100000:2.0:1784093812.088571:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700352 00000100:00100000:3.0:1784093812.088591:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 675 00000100:00100000:3.0:1784093812.088632:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013700224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784093812.088655:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093812.088669:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:2.0:1784093812.088685:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013700352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093812.088753:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013700224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093812.088764:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013700352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093812.088775:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 675 00000100:00100000:2.0:1784093812.088782:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 440 00010000:00010000:2.0:1784093812.201599:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093812.441713:0:71445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd572dc00 20000000:00000080:0.0:1784093812.441726:0:71445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907230a4a000 uarg=0000000000000000 00010000:00010000:0.0:1784093812.441918:0:71445:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093812.441949:0:71445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781b00) 00010000:00010000:0.0:1784093812.441952:0:71445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093812.441962:0:71445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5730 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.441984:0:71445:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093812.441998:0:71445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093812.442022:0:71445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442034:0:71445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca25d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442042:0:71445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442075:0:71445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca25d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442096:0:71445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca25d expref: 18 pid: 5771 timeout: 1123 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093812.442109:0:71445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71445:1870757024241280:0@lo:104: 00000100:00100000:0.0:1784093812.442163:0:71445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093812.442220:0:71445:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209100c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093812.442227:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241280 00000100:00100000:2.0:1784093812.442235:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241280 00000100:00100000:2.0:1784093812.442278:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784093812.442288:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:71445:x1870757024241280:12345-0@lo:104: 00010000:00010000:2.0:1784093812.442300:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093812.442349:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093812.442358:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:71445:x1870757024241280:12345-0@lo:104: Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093812.442363:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784093812.442370:0:71445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71445:1870757024241280:0@lo:104: 00010000:00010000:3.0:1784093812.442378:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093812.442384:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442387:0:71445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442396:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093812.442400:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442406:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093812.442411:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093812.442414:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093812.442453:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442457:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093812.442476:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442480:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40000/0x9ce98053214ca25d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca264 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093812.442494:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024241408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093812.442497:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093812.442504:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093812.442506:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093812.442526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093812.442556:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241408 00000100:00100000:3.0:1784093812.442560:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241408 00010000:00010000:3.0:1784093812.442577:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca25d expref: 19 pid: 5771 timeout: 1123 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093812.442596:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1784093812.442601:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024241408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093812.442608:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093812.442612:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca25d expref: 19 pid: 5771 timeout: 1123 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442622:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca25d expref: 19 pid: 5771 timeout: 1123 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442632:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214ca264 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca25d expref: 19 pid: 5771 timeout: 1123 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442643:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442651:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442663:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442670:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442677:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442690:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442695:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093812.442699:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442704:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442715:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093812.442722:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093812.442726:0:71445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442732:0:71445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093812.442737:0:71445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77200/0x9ce98053214ca2f7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093812.442752:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024241408:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093812.442758:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784093812.442787:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024241408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093812.713598:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024241536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093812.713665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093812.713743:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241536 00000100:00100000:2.0:1784093812.713751:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241536 00000100:00080000:0.0:1784093812.713786:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093812.713810:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1784093812.713820:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024241536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784093812.713860:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093812.713908:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024241536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093812.713917:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784093812.713946:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024241536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093812.714063:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024241792:0@lo:400:kworker.0 00000100:00100000:1.0:1784093812.714085:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024242048:0@lo:400:kworker.0 00000100:00100000:0.0:1784093812.714101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093812.714123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093812.714133:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093812.714141:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024241664:0@lo:400:kworker.0 00000100:00100000:1.0:1784093812.714151:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093812.714161:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024241920:0@lo:400:kworker.0 00000100:00100000:0.0:1784093812.714168:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093812.714195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093812.714222:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241792 00000100:00100000:1.0:1784093812.714232:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242048 00000100:00100000:1.0:1784093812.714236:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242048 00000100:00100000:0.0:1784093812.714241:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241792 00000100:00100000:1.0:1784093812.714284:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241664 00000100:00100000:1.0:1784093812.714289:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241664 00000100:00100000:0.0:1784093812.714293:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1784093812.714302:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024242048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093812.714319:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1784093812.714328:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024241792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093812.714345:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024242048:12345-0@lo:400:kworker.0 Request processed in 44us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093812.714350:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1784093812.714364:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1784093812.714369:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024241664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093812.714377:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024241792:12345-0@lo:400:kworker.0 Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093812.714385:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1784093812.714410:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024241664:12345-0@lo:400:kworker.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093812.714411:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024241920 00000100:00100000:1.0:1784093812.714416:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024241920 00000100:00100000:0.0:1784093812.714442:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1784093812.714465:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00080000:0.0:1784093812.714471:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093812.714473:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024241920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093812.714498:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024242048:0@lo:400:kworker.0 00000100:00100000:1.0:1784093812.714513:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024241920:12345-0@lo:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093812.714520:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024241920:0@lo:400:kworker.0 00000100:00100000:1.0:1784093812.714524:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1784093812.714546:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024241664:0@lo:400:kworker.0 00000100:00100000:0.0:1784093812.714559:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024241792:0@lo:400:kworker.0 00010000:00010000:2.0:1784093813.225604:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093813.427180:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093813.427236:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700480 00000100:00100000:0.0:1784093813.427247:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700480 00000100:00080000:2.0:1784093813.427295:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093813.427320:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 566 00000100:00100000:0.0:1784093813.427330:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:42249:x1870757013700480:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093813.427351:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093813.427372:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca2fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5753 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.427457:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.427477:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.427503:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093813.427563:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:0.0:1784093813.427566:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093813.427586:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.427607:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca2fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5753 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.427623:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5753 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.427630:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784093813.427633:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093813.427635:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093813.427688:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:42249:x1870757013700480:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 360us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093813.427696:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 566 00000100:00100000:0.0:1784093813.428780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093813.428826:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700736 00000100:00100000:2.0:1784093813.428831:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700736 00000100:00100000:2.0:1784093813.428859:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 567 00000100:00100000:2.0:1784093813.428867:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:42249:x1870757013700736:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093813.428894:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093813.428907:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5753 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093813.428916:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca280) 00010000:00010000:2.0:1784093813.428919:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:2.0:1784093813.428924:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093813.428936:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093813.428944:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093813.428953:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093813.440711:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000004:00010000:3.0:1784093813.440718:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000002a1a42b3 reply state 000000006881c50a transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093813.440727:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000100:00100000:3.0:1784093813.440736:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1784093813.440738:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000100:00100000:1.0:1784093813.440867:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024242176:0@lo:6:osp-syn-0-0.0 00000004:00200000:3.0:1784093813.440869:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000100:00100000:1.0:1784093813.440920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093813.440945:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242176 00010000:00080000:3.0:1784093813.440951:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093813.440952:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242176 00000100:00100000:3.0:1784093813.440966:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:42249:x1870757013700736:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 12099us (12187us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1784093813.440975:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 567 00000100:00080000:2.0:1784093813.440983:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093813.441017:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784093813.441026:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024242176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784093813.441054:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:18 count 1 00010000:00010000:0.0:1784093813.441072:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.441086:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.441092:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784093813.441096:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093813.441099:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.441109:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.441118:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.441119:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.441132:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.441133:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 6 pid: 6572 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.441146:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093813.441151:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093813.441152:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024242304:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093813.441202:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5d80 going to sleep for 11 seconds 00010000:00010000:3.0:1784093813.441213:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.441230:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781900) 00010000:00010000:3.0:1784093813.441234:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093813.441238:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.441245:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca30c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093813.442174:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024242304:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093813.442194:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093813.442468:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093813.442532:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700864 00000100:00100000:3.0:1784093813.442538:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700864 00010000:00010000:3.0:1784093813.442578:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 7 pid: 6572 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784093813.442591:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093813.442797:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 254 00000100:00100000:3.0:1784093813.442807:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013700864:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093813.442819:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093813.442825:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 7 pid: 6572 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.442957:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 7 pid: 6572 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.442975:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214ca2d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf574c expref: 7 pid: 6572 timeout: 1074 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.442985:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093813.443000:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093813.443005:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.443011:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093813.443031:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093813.443058:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093813.443068:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013700864:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 261us (602us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093813.443068:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093813.443076:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 254 00010000:00010000:0.0:1784093813.443078:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.443086:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.443105:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784093813.443357:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1870757024242176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2331us (2434us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784093813.443368:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:0.0:1784093813.443392:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093813.443398:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.443406:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093813.443411:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.443436:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093813.443439:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90710134e300/2, rc 0, transno 4294967333 00000100:00100000:3.0:1784093813.443446:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024242176:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784093813.443463:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.443471:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214ca313 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093813.443492:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093813.443494:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093813.443496:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093813.717188:0:71640:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc936f32b0 20000000:00000080:1.0:1784093813.717204:0:71640:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101bbd400 uarg=0000000000000000 00010000:00010000:1.0:1784093813.717675:0:71640:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093813.717690:0:71640:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093813.717702:0:71640:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093813.717719:0:71640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717733:0:71640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717744:0:71640:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717751:0:71640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717758:0:71640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717765:0:71640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717771:0:71640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093813.717775:0:71640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717790:0:71640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717803:0:71640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717811:0:71640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093813.717817:0:71640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12800/0x9ce98053214ca31a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093814.057678:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093814.057691:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093814.057695:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093814.057740:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093814.057753:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093814.057770:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093814.057797:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024242432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093814.057866:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093814.057920:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242432 00000100:00100000:2.0:1784093814.057921:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a9bea80 going to sleep for 11 seconds 00000100:00100000:0.0:1784093814.057929:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242432 00000100:00100000:0.0:1784093814.057990:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1784093814.058001:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024242432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093814.058023:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093814.058039:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca321 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093814.058064:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca321 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093814.058075:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca321 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093814.058085:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784093814.058151:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024242432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093814.058158:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1784093814.058499:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024242432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093814.058517:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093814.058527:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093814.058547:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093814.058553:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093814.058560:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093814.249609:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093814.761554:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093814.761576:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024242560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093814.761645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093814.761671:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242560 00000100:00100000:2.0:1784093814.761687:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242560 00000100:00100000:2.0:1784093814.761741:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784093814.761750:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1870757024242560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093814.761786:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093814.761840:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1870757024242560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093814.761846:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784093814.761923:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024242560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093814.768780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093814.768825:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013700992 00000100:00100000:3.0:1784093814.768834:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013700992 00000100:00100000:3.0:1784093814.768887:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 568 00000100:00100000:3.0:1784093814.768897:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:42325:x1870757013700992:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093814.768921:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093814.768945:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca32f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf575a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769025:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769039:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769052:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769069:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769076:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769083:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769593:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769603:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769619:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093814.769753:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:3.0:1784093814.769759:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093814.769864:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769877:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769884:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769890:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769897:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093814.769902:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769910:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769923:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784093814.769926:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093814.769930:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769937:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769958:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769975:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769982:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769989:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093814.769992:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.769999:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.770010:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907204fcee00) 00010000:00010000:3.0:1784093814.770012:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093814.770015:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.770021:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca33d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.770054:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca32f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf575a expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.770075:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf575a expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093814.770092:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784093814.770095:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093814.770098:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784093814.770155:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:42325:x1870757013700992:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1258us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093814.770163:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 568 00000001:00080000:3.0:1784093814.779066:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000001:00080000:3.0:1784093814.779083:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00010000:00010000:3.0:1784093815.274939:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093815.399294:0:71886:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff70a21500 20000000:00000080:0.0:1784093815.399308:0:71886:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237839c00 uarg=0000000000000000 00010000:00010000:0.0:1784093815.399530:0:71886:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093815.399558:0:71886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fceb00) 00010000:00010000:0.0:1784093815.399562:0:71886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093815.399571:0:71886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf575a expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.399591:0:71886:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093815.399603:0:71886:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093815.399615:0:71886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.399627:0:71886:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca321 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.399635:0:71886:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.399667:0:71886:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca321 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.399680:0:71886:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca321 expref: 18 pid: 5771 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093815.399694:0:71886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71886:1870757024242688:0@lo:104: 00000100:00100000:0.0:1784093815.399756:0:71886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093815.399799:0:71886:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093815.399810:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784093815.399823:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242688 00000100:00100000:1.0:1784093815.399830:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242688 00000100:00100000:1.0:1784093815.399881:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1784093815.399890:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103875450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:71886:x1870757024242688:12345-0@lo:104: 00010000:00010000:1.0:1784093815.399903:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093815.399976:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093815.399984:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103875450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:71886:x1870757024242688:12345-0@lo:104: Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093815.399991:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784093815.400007:0:71886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71886:1870757024242688:0@lo:104: 00010000:00010000:2.0:1784093815.400015:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093815.400024:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400033:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093815.400037:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.400045:0:71886:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400047:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093815.400057:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093815.400068:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093815.400096:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400103:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093815.400130:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093815.400136:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024242816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093815.400150:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214ca321 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca328 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400164:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093815.400166:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093815.400169:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093815.400189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093815.400226:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242816 00000100:00100000:2.0:1784093815.400231:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242816 00010000:00010000:2.0:1784093815.400250:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca321 expref: 19 pid: 5771 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093815.400276:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784093815.400282:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024242816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093815.400297:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093815.400303:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca321 expref: 19 pid: 5771 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400313:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca321 expref: 19 pid: 5771 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400323:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214ca328 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca321 expref: 19 pid: 5771 timeout: 1126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400334:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400342:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400364:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400371:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400378:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400384:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400390:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093815.400394:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400401:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400416:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093815.400456:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093815.400479:0:71886:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093815.400490:0:71886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093815.400497:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024242816:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (306us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093815.400501:0:71886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214ca34b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093815.400510:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784093815.400511:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024242816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093816.298572:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093816.463118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093816.463173:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013701120 00000100:00100000:0.0:1784093816.463184:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013701120 00000100:00080000:1.0:1784093816.463243:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093816.463254:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 569 00000100:00100000:0.0:1784093816.463264:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:42415:x1870757013701120:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093816.463283:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093816.463307:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca352 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5761 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.463375:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.463389:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.463403:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093816.463620:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:0.0:1784093816.463629:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093816.463743:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.463771:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca352 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5761 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.463796:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5761 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.463806:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784093816.463809:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093816.463814:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784093816.463882:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:42415:x1870757013701120:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 620us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093816.463890:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 569 00000100:00100000:3.0:1784093816.465369:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093816.465414:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013701376 00000100:00100000:0.0:1784093816.465433:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013701376 00000100:00100000:0.0:1784093816.465464:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 570 00000100:00100000:0.0:1784093816.465473:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:42415:x1870757013701376:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093816.465528:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093816.465548:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5761 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.465562:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca344) 00010000:00010000:0.0:1784093816.465566:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784093816.465574:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093816.465591:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.465605:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093816.465612:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093816.465948:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008b438d0a reply state 000000000e6865f6 transno 4294967518 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093816.465956:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093816.466014:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000100:00100000:0.0:1784093816.466084:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:42415:x1870757013701376:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 611us (715us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784093816.466091:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 570 00010000:00010000:1.0:1784093816.466735:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093816.466767:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093816.466773:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093816.466780:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093816.466784:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093816.466802:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093816.466813:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b100) 00010000:00010000:1.0:1784093816.466816:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093816.466830:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093816.466840:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ca360 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093816.766215:0:72081:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0dc17010 20000000:00000080:2.0:1784093816.766228:0:72081:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907231060c00 uarg=0000000000000000 00010000:00010000:2.0:1784093816.766415:0:72081:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093816.766455:0:72081:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093816.766467:0:72081:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093816.766483:0:72081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766495:0:72081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766504:0:72081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766508:0:72081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766513:0:72081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766517:0:72081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766524:0:72081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093816.766528:0:72081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766535:0:72081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766546:0:72081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766554:0:72081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093816.766576:0:72081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40e00/0x9ce98053214ca367 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093817.193588:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093817.193593:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093817.193597:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093817.193638:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093817.193650:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093817.193661:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093817.193689:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024242944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093817.193745:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093817.193871:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024242944 00000100:00100000:3.0:1784093817.193879:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024242944 00000100:00100000:2.0:1784093817.193908:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907225f8f480 going to sleep for 11 seconds 00000100:00100000:3.0:1784093817.193938:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1784093817.193949:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024242944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093817.193966:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093817.193979:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca36e expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093817.194002:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca36e expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093817.194014:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca36e expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093817.194023:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784093817.194069:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024242944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093817.194090:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1784093817.194095:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024242944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093817.194109:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093817.194127:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093817.194146:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093817.194150:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093817.194164:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093817.208694:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093817.208732:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093817.208773:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.208773:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013701504 00000100:00100000:0.0:1784093817.208783:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013701504 00000100:00100000:3.0:1784093817.208814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.208854:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 678 00000100:00100000:1.0:1784093817.208855:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013701760 00000100:00100000:0.0:1784093817.208868:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013701504:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093817.208869:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013701632 00000100:00100000:1.0:1784093817.208871:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013701760 00000100:00100000:2.0:1784093817.208878:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013701632 00000100:00100000:3.0:1784093817.208880:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013701888 00000100:00100000:3.0:1784093817.208886:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013701888 00000100:00100000:2.0:1784093817.208940:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:1.0:1784093817.208947:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 442 00000100:00100000:2.0:1784093817.208953:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013701632:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093817.208958:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 443 00000100:00100000:1.0:1784093817.208963:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013701760:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093817.208966:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013701504:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093817.208975:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013701888:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093817.208982:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 678 00000100:00100000:2.0:1784093817.209006:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013701632:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093817.209015:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013701760:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 57us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093817.209019:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013701888:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093817.209020:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:3.0:1784093817.209032:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 443 00000100:00100000:1.0:1784093817.209043:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 442 00000100:00080000:2.0:1784093817.209080:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093817.209086:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784093817.321717:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093817.833641:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024243200:0@lo:400:kworker.0 00000100:00100000:0.0:1784093817.833663:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024243072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093817.833720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093817.833722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093817.833781:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024243584:0@lo:400:kworker.0 00000100:00100000:1.0:1784093817.833783:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024243712:0@lo:400:kworker.0 00000100:00100000:0.0:1784093817.833822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093817.833827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093817.833855:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093817.833867:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093817.833870:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243200 00000100:00100000:0.0:1784093817.833874:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024243456:0@lo:400:kworker.0 00000100:00100000:1.0:1784093817.833877:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024243328:0@lo:400:kworker.0 00000100:00100000:3.0:1784093817.833880:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243200 00000100:00100000:1.0:1784093817.833924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093817.833937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093817.833940:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243584 00000100:00100000:3.0:1784093817.833945:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243584 00000100:00100000:1.0:1784093817.833975:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243328 00000100:00100000:1.0:1784093817.833981:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243328 00000100:00100000:0.0:1784093817.833984:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1784093817.833993:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1784093817.833998:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024243200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093817.834003:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024243584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093817.834016:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1784093817.834026:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024243328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093817.834058:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024243200:12345-0@lo:400:kworker.0 Request processed in 63us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.834066:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1784093817.834073:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024243328:12345-0@lo:400:kworker.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093817.834081:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1784093817.834096:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243712 00000100:00100000:0.0:1784093817.834102:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243712 00000100:00100000:1.0:1784093817.834130:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243456 00000100:00100000:3.0:1784093817.834131:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024243584:12345-0@lo:400:kworker.0 Request processed in 130us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093817.834136:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243456 00000100:00100000:3.0:1784093817.834142:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1784093817.834148:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1784093817.834160:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024243712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093817.834173:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243072 00000100:00100000:1.0:1784093817.834174:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1784093817.834179:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243072 00000100:00100000:1.0:1784093817.834186:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024243456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093817.834202:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024243712:12345-0@lo:400:kworker.0 Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.834211:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1784093817.834215:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784093817.834225:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024243072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093817.834232:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024243456:12345-0@lo:400:kworker.0 Request processed in 48us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093817.834241:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00002000:00000024:3.0:1784093817.834256:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093817.834266:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024243328:0@lo:400:kworker.0 00000100:00100000:0.0:1784093817.834283:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024243200:0@lo:400:kworker.0 00000100:00080000:1.0:1784093817.834286:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093817.834292:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093817.834296:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093817.834298:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024243712:0@lo:400:kworker.0 00000100:00100000:3.0:1784093817.834312:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024243072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093817.834321:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1784093817.834343:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:1.0:1784093817.834355:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90710134e300, transno 4294967333 00000100:00100000:1.0:1784093817.834371:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024243456:0@lo:400:kworker.0 00000100:00100000:1.0:1784093817.834387:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024243072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093817.834408:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024243584:0@lo:400:kworker.0 00000100:00100000:3.0:1784093817.886481:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.887602:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702016 00000100:00100000:0.0:1784093817.887612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702016 00000100:00100000:0.0:1784093817.887659:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 571 00000100:00100000:0.0:1784093817.887666:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:42500:x1870757013702016:12345-192.168.204.57@tcp:48:lfs.60003 00000001:00080000:1.0:1784093817.897002:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000100:00100000:2.0:1784093817.905123:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702016:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 17446us (18643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093817.905138:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 571 00000100:00100000:0.0:1784093817.906183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093817.906228:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702144 00000100:00100000:2.0:1784093817.906237:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702144 00000100:00100000:2.0:1784093817.906283:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 278 00000100:00100000:2.0:1784093817.906293:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702144:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093817.906587:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702144:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 294us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093817.906594:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 278 00000100:00100000:3.0:1784093817.907182:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.907215:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702272 00000100:00100000:0.0:1784093817.907220:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702272 00000100:00100000:0.0:1784093817.907244:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 279 00000100:00100000:0.0:1784093817.907249:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702272:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093817.907513:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702272:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 261us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.907521:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 279 00000100:00100000:3.0:1784093817.908089:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.908125:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702400 00000100:00100000:0.0:1784093817.908129:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702400 00000100:00100000:0.0:1784093817.908154:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:0.0:1784093817.908159:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702400:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093817.908335:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702400:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 175us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.908340:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:3.0:1784093817.909619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093817.909662:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702528 00000100:00100000:1.0:1784093817.909667:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702528 00000100:00100000:1.0:1784093817.909705:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 573 00000100:00100000:1.0:1784093817.909715:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702528:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093817.926224:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702528:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 16502us (16595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.926239:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 573 00000100:00100000:3.0:1784093817.927246:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093817.927286:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702656 00000100:00100000:1.0:1784093817.927293:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702656 00000100:00100000:1.0:1784093817.927329:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 280 00000100:00100000:1.0:1784093817.927336:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702656:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093817.927575:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702656:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 239us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093817.927581:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 280 00000100:00100000:3.0:1784093817.928354:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093817.928395:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702784 00000100:00100000:2.0:1784093817.928399:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702784 00000100:00100000:2.0:1784093817.928451:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:2.0:1784093817.928458:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702784:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093817.928632:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702784:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 175us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093817.928637:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:3.0:1784093817.929188:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093817.929224:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013702912 00000100:00100000:2.0:1784093817.929228:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013702912 00000100:00100000:2.0:1784093817.929255:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 574 00000100:00100000:2.0:1784093817.929260:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702912:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093817.929552:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42500:x1870757013702912:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 290us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093817.929560:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 574 00000100:00100000:3.0:1784093817.948119:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.948172:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013703040 00000100:00100000:0.0:1784093817.948189:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013703040 00000100:00100000:0.0:1784093817.948250:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 575 00000100:00100000:0.0:1784093817.948258:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:42504:x1870757013703040:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784093817.948275:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093817.948294:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca37c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5768 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948344:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948358:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948391:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948404:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948412:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948418:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948830:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948841:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948846:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093817.948899:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:0.0:1784093817.948902:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093817.948970:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948979:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948984:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948994:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.948998:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093817.949001:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949005:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949013:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093817.949015:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093817.949018:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949022:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949029:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949032:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949035:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949038:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093817.949040:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949049:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949054:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907202e6bb00) 00010000:00010000:0.0:1784093817.949055:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093817.949057:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949060:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca38a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949080:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca37c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5768 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949097:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5768 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.949101:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093817.949103:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093817.949104:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784093817.949167:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:42504:x1870757013703040:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 910us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.949173:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 575 00000100:00100000:3.0:1784093817.950290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093817.950330:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013703296 00000100:00100000:0.0:1784093817.950335:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013703296 00000100:00100000:0.0:1784093817.950363:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 576 00000100:00100000:0.0:1784093817.950369:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:42504:x1870757013703296:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784093817.950387:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093817.950395:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca398 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf576f expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.950575:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.950584:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.950590:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.950597:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.950602:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.950606:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093817.950990:0:7758:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7758:1870757024243840:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784093817.951026:0:7758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093817.951084:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243840 00000100:00100000:3.0:1784093817.951085:0:7758:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e32b780 going to sleep for 11 seconds 00000100:00100000:1.0:1784093817.951091:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243840 00000100:00100000:1.0:1784093817.951134:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784093817.951144:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:7758:x1870757024243840:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784093817.951181:0:53396:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1784093817.951269:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00010000:00010000:0.0:1784093817.951643:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca3ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951653:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951662:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca3ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951711:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951719:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951725:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951731:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093817.951735:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951742:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951753:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093817.951757:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093817.951761:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951767:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ca39f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093817.951780:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f7639677 reply state 0000000032e83f5f transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093817.951790:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093817.951818:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca398 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf576f expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951847:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca3ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf576f expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.951855:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784093817.951858:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093817.951860:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784093817.951924:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:42504:x1870757013703296:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1554us (1633us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1784093817.951933:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 576 00010000:00010000:0.0:1784093817.952729:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.952739:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.952746:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.952753:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093817.952756:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.952763:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.952774:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff907202e6b600) 00010000:00010000:0.0:1784093817.952777:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093817.952781:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093817.952794:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ca3a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093817.954935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093817.955180:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013703424 00000100:00100000:2.0:1784093817.955189:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013703424 00000100:00100000:2.0:1784093817.955247:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 283 00000100:00100000:2.0:1784093817.955257:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:42504:x1870757013703424:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784093817.955273:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093817.955293:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5776 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093817.955318:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784093817.955337:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=979s v=(0 0) 00010000:00010000:2.0:1784093817.955342:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093817.955353:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093817.955394:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093817.955408:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784093817.955480:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:42504:x1870757013703424:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 224us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093817.955490:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 283 00000100:00100000:1.0:1784093817.961235:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:7758:x1870757024243840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10089us (10202us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1784093817.961247:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784093817.961290:0:7758:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7758:1870757024243840:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784093817.961305:0:7758:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1784093817.963945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093817.964007:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013703552 00000100:00100000:1.0:1784093817.964016:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013703552 00002000:00100000:1.0:1784093817.964061:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff907210e79880 x1870757013703552/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:138/0 lens 488/0 e 0 to 0 dl 1784093828 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093817.964088:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907210e79880 with x1870757013703552 ext(0->1048575) 00002000:00010000:1.0:1784093817.964094:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907210e79880 00000100:00100000:1.0:1784093817.964121:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 13 00000100:00100000:1.0:1784093817.964132:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013703552:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:1.0:1784093817.973798:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013703552:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 9658us (9845us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1784093817.973813:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 13 00002000:00100000:1.0:1784093817.973827:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff907210e79880 x1870757013703552/t4294967332(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:138/0 lens 488/448 e 0 to 0 dl 1784093828 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093817.973839:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907210e79880 with x1870757013703552 ext(0->1048575) 00002000:00010000:1.0:1784093817.973847:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907210e79880 00000100:00100000:0.0:1784093817.975250:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093817.975316:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013703680 00000100:00100000:2.0:1784093817.975325:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013703680 00000100:00100000:2.0:1784093817.975377:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 577 00000100:00100000:2.0:1784093817.975388:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:42504:x1870757013703680:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:3.0:1784093817.985201:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:0.0:1784093817.985304:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:42504:x1870757013703680:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 9913us (10052us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093817.985315:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 577 00000100:00100000:3.0:1784093817.986412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093817.986464:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013703808 00000100:00100000:2.0:1784093817.986473:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013703808 00000100:00100000:2.0:1784093817.986525:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 284 00000100:00100000:2.0:1784093817.986537:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013703808:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:1.0:1784093818.001579:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000001:00080000:1.0:1784093818.001597:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00000100:00100000:2.0:1784093818.001649:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013703808:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 15108us (15231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093818.001660:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 284 00000100:00100000:3.0:1784093818.003523:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093818.003575:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704064 00000100:00100000:1.0:1784093818.003584:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704064 00000100:00080000:2.0:1784093818.003634:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093818.003637:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 61 00000100:00100000:1.0:1784093818.003648:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:42504:x1870757013704064:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093818.004010:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:42504:x1870757013704064:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 364us (491us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784093818.004015:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 61 00010000:00010000:3.0:1784093818.345562:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093818.447004:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:0.0:1784093818.896042:0:72328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 979973617705ns, next at 973913550877ns, rc = 0 00000004:00080000:0.0:1784093818.896140:0:72328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 979973717086ns, next at 951278731056ns, rc = 0 00000004:00080000:2.0:1784093818.897220:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 47 committed 00000004:00080000:2.0:1784093818.897738:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 45 committed 00000100:00100000:0.0:1784093819.343538:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093819.343579:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704192 00000100:00100000:3.0:1784093819.343589:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704192 00000100:00100000:3.0:1784093819.343643:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 578 00000100:00100000:3.0:1784093819.343654:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013704192:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093819.343758:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013704192:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 106us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093819.343769:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 578 00000100:00100000:1.0:1784093819.344543:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093819.344565:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704320 00000100:00100000:0.0:1784093819.344571:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704320 00000100:00080000:2.0:1784093819.344619:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093819.344626:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 285 00000100:00100000:0.0:1784093819.344634:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:42696:x1870757013704320:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093819.344965:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:42696:x1870757013704320:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 330us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093819.344973:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 285 00000100:00100000:0.0:1784093819.345513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093819.345567:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704448 00000100:00100000:1.0:1784093819.345573:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704448 00000100:00080000:2.0:1784093819.345608:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093819.345722:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 286 00000100:00100000:1.0:1784093819.345741:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:42696:x1870757013704448:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093819.346025:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:42696:x1870757013704448:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 286us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093819.346033:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 286 00000100:00100000:1.0:1784093819.346558:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093819.346595:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704576 00000100:00100000:0.0:1784093819.346601:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704576 00000100:00100000:0.0:1784093819.346631:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:0.0:1784093819.346637:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013704576:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093819.346959:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013704576:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 321us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093819.346966:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:2.0:1784093819.348086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093819.348122:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704704 00000100:00100000:0.0:1784093819.348127:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704704 00000100:00100000:0.0:1784093819.348159:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 580 00000100:00100000:0.0:1784093819.348167:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013704704:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093819.348228:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013704704:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093819.348235:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 580 00000100:00100000:1.0:1784093819.348826:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093819.348857:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704832 00000100:00100000:2.0:1784093819.348868:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704832 00000100:00100000:2.0:1784093819.348911:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 287 00000100:00100000:2.0:1784093819.348923:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:42696:x1870757013704832:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093819.349165:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:42696:x1870757013704832:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 245us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093819.349174:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 287 00000100:00100000:1.0:1784093819.349715:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093819.349745:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013704960 00000100:00100000:0.0:1784093819.349751:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013704960 00000100:00100000:0.0:1784093819.349788:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 288 00000100:00100000:0.0:1784093819.349796:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:42696:x1870757013704960:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093819.350046:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:42696:x1870757013704960:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 251us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093819.350052:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 288 00000100:00100000:1.0:1784093819.350590:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093819.350623:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705088 00000100:00100000:0.0:1784093819.350627:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705088 00000100:00100000:0.0:1784093819.350653:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 581 00000100:00100000:0.0:1784093819.350659:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013705088:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093819.350959:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:42696:x1870757013705088:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 296us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093819.350967:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 581 00010000:00010000:1.0:1784093819.369534:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093819.371323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093819.371360:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705344 00000100:00100000:0.0:1784093819.371368:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705344 00000100:00100000:0.0:1784093819.371408:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 582 00000100:00100000:0.0:1784093819.371415:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:42700:x1870757013705344:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784093819.371494:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093819.371524:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca3ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf576f expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371536:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784093819.371545:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093819.371561:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371570:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371577:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371585:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371590:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371594:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371875:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371895:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.371899:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093819.372702:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9344 00000004:00080000:0.0:1784093819.372714:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 980450291933ns, next at 981450290374ns, rc = 0 00010000:00010000:0.0:1784093819.372799:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372809:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372817:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372825:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372831:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372838:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372851:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093819.372867:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093819.372870:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.372875:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372886:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372899:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.372900:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093819.372906:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372907:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093819.372912:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.372917:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.372936:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784093819.372937:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.372947:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093819.372952:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372955:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784093819.372961:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093819.372962:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca3d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372964:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.372982:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214ca3d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.372986:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093819.372990:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093819.372994:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093819.373002:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.373011:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.373017:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.373022:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093819.373025:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.373029:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.373034:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784093819.373035:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093819.373037:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093819.373047:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214ca3c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093819.373053:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ee81c875 reply state 000000002ba51d42 transno 4294967521 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093819.373059:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093819.373112:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:42700:x1870757013705344:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1698us (1794us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1784093819.373118:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 582 00010000:00010000:2.0:1784093819.373673:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.373698:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.373704:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.373709:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093819.373712:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.373719:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.373728:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff907202e6bb00) 00010000:00010000:2.0:1784093819.373730:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093819.373733:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093819.373739:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214ca3c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093819.881627:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024243968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093819.881684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093819.881755:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024243968 00000100:00100000:2.0:1784093819.881764:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024243968 00000100:00080000:1.0:1784093819.881820:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093819.881837:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1784093819.881847:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024243968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093819.881895:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093819.881946:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024243968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093819.881952:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1784093819.881983:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024243968:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784093820.045018:0:72473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 981122593634ns, next at 973913550877ns, rc = 0 00000004:00080000:1.0:1784093820.045123:0:72473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 981122700356ns, next at 981450290374ns, rc = 0 00000001:00080000:0.0:1784093820.053182:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:0.0:1784093820.053197:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 46 committed 00000004:00080000:0.0:1784093820.053214:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 48 committed 00000100:00100000:2.0:1784093820.053346:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024244096:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784093820.053416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093820.053452:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244096 00000100:00100000:0.0:1784093820.053460:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244096 00000100:00080000:3.0:1784093820.053507:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093820.053544:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784093820.053557:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024244096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784093820.053585:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:2.0:1784093820.053608:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093820.053628:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093820.053636:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093820.053640:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093820.053643:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093820.053665:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093820.053675:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 5 pid: 8031 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093820.053683:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024244224:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093820.053728:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c780 going to sleep for 11 seconds 00000004:00080000:3.0:1784093820.054093:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 47 committed 00000100:00100000:1.0:1784093820.055523:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093820.055538:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024244224:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093820.055562:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705472 00010000:00010000:2.0:1784093820.055563:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093820.055570:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705472 00010000:00010000:3.0:1784093820.055604:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 6 pid: 8031 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093820.055637:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 256 00000100:00100000:3.0:1784093820.055648:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013705472:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093820.055662:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093820.055668:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 6 pid: 8031 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093820.055682:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 6 pid: 8031 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093820.055705:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214ca3bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5776 expref: 6 pid: 8031 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093820.055721:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093820.055724:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093820.055730:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093820.055751:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093820.055776:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093820.055795:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093820.055806:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093820.055815:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093820.055822:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013705472:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 174us (302us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093820.055826:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093820.055834:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 256 00010000:00010000:2.0:1784093820.055855:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093820.055889:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093820.055898:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093820.055909:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093820.055915:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093820.055925:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093820.055938:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093820.055956:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082bb4744/0x9ce98053214ca3de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093820.055976:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093820.055978:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093820.055980:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093820.056322:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024244096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2769us (2906us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1784093820.056331:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784093820.056364:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:1.0:1784093820.056380:0:3303:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff907237374700 x1870757024244096/t4294967333(4294967333) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784093836 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1784093820.056391:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237374700/2, rc 0, transno 4294967333 00000100:00100000:1.0:1784093820.056405:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024244096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784093820.394585:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093821.417832:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093822.328344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093822.328381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093822.328401:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705728 00000100:00100000:0.0:1784093822.328410:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705728 00000100:00100000:1.0:1784093822.328415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093822.328457:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705600 00000100:00100000:3.0:1784093822.328464:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705600 00000100:00100000:2.0:1784093822.328467:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705984 00000100:00100000:2.0:1784093822.328472:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705984 00000100:00100000:1.0:1784093822.328477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784093822.328520:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093822.328524:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013705856 00000100:00100000:3.0:1784093822.328526:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 679 00000100:00080000:1.0:1784093822.328528:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093822.328529:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013705856 00000100:00100000:0.0:1784093822.328534:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 646 00000100:00100000:3.0:1784093822.328540:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013705600:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093822.328549:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013705728:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093822.328563:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 446 00000100:00100000:2.0:1784093822.328576:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 447 00000100:00100000:1.0:1784093822.328576:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013705984:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093822.328592:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013705856:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093822.328621:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013705600:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093822.328629:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013705984:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093822.328630:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013705856:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093822.328632:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013705728:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093822.328641:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 679 00000100:00100000:1.0:1784093822.328647:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 446 00000100:00100000:0.0:1784093822.328654:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 646 00000100:00100000:2.0:1784093822.328660:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 447 00000100:00080000:1.0:1784093822.328673:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784093822.441612:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093822.953624:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093822.953650:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024244480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093822.953650:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024244352:0@lo:400:kworker.0 00000100:00100000:0.0:1784093822.953661:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024244608:0@lo:400:kworker.0 00000100:00100000:1.0:1784093822.953735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093822.953736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093822.953737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093822.953801:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024244736:0@lo:400:kworker.0 00000100:00100000:0.0:1784093822.953803:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024245120:0@lo:400:kworker.0 00000100:00100000:2.0:1784093822.953845:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244608 00000100:00100000:3.0:1784093822.953847:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024244992:0@lo:400:kworker.0 00000100:00100000:1.0:1784093822.953853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093822.953856:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244608 00000100:00100000:0.0:1784093822.953862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093822.953878:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784093822.953886:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024244864:0@lo:400:kworker.0 00000100:00100000:3.0:1784093822.953895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093822.953912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093822.953915:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244736 00000100:00100000:2.0:1784093822.953920:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244736 00000100:00100000:0.0:1784093822.953926:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244352 00000100:00100000:0.0:1784093822.953932:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244352 00000100:00100000:3.0:1784093822.953947:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244480 00000100:00100000:3.0:1784093822.953953:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244480 00000100:00100000:1.0:1784093822.953954:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244992 00000100:00100000:1.0:1784093822.953959:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244992 00000100:00100000:2.0:1784093822.953968:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1784093822.953978:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1784093822.953984:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024244608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093822.953993:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024244352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093822.953997:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1784093822.954001:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1784093822.954012:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024244736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093822.954014:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024244480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093822.954048:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784093822.954061:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024244352:12345-0@lo:400:kworker.0 Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093822.954063:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024244736:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093822.954082:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1784093822.954082:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1784093822.954102:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1784093822.954109:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024244608:12345-0@lo:400:kworker.0 Request processed in 132us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093822.954111:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024244992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093822.954115:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024244480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093822.954121:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1784093822.954130:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:0.0:1784093822.954137:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093822.954143:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093822.954158:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024244992:12345-0@lo:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093822.954160:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245120 00000100:00100000:2.0:1784093822.954161:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024244864 00000100:00100000:0.0:1784093822.954167:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245120 00000100:00100000:2.0:1784093822.954168:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024244864 00000100:00100000:1.0:1784093822.954168:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1784093822.954188:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024244992:0@lo:400:kworker.0 00000100:00100000:1.0:1784093822.954207:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024244736:0@lo:400:kworker.0 00000100:00100000:3.0:1784093822.954219:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024244480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093822.954222:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1784093822.954224:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024244352:0@lo:400:kworker.0 00000100:00100000:0.0:1784093822.954233:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1784093822.954236:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024244864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093822.954247:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024245120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093822.954290:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024244608:0@lo:400:kworker.0 00000100:00100000:2.0:1784093822.954294:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024244864:12345-0@lo:400:kworker.0 Request processed in 59us (379us total) trans 0 rc 0/0 00000100:00080000:1.0:1784093822.954295:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093822.954300:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024245120:12345-0@lo:400:kworker.0 Request processed in 55us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093822.954310:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1784093822.954312:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024245120:0@lo:400:kworker.0 00000100:00100000:0.0:1784093822.954319:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1784093822.954324:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024244864:0@lo:400:kworker.0 00010000:00010000:0.0:1784093823.465592:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093824.489609:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093824.499901:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000100:00100000:1.0:1784093825.001569:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024245248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093825.001624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093825.001689:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245248 00000100:00100000:2.0:1784093825.001698:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245248 00000100:00080000:1.0:1784093825.001743:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093825.001788:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784093825.001801:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024245248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093825.001837:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093825.001888:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024245248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093825.001896:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1784093825.001935:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024245248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093825.513627:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093826.537670:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093827.448550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093827.448587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093827.448608:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093827.448610:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706240 00000100:00100000:2.0:1784093827.448618:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706240 00000100:00100000:3.0:1784093827.448639:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706112 00000100:00100000:3.0:1784093827.448647:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706112 00000100:00100000:1.0:1784093827.448647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093827.448675:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706368 00000100:00100000:0.0:1784093827.448680:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706368 00000100:00100000:2.0:1784093827.448687:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:1.0:1784093827.448690:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706496 00000100:00100000:3.0:1784093827.448695:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 681 00000100:00100000:1.0:1784093827.448697:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706496 00000100:00100000:2.0:1784093827.448704:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013706240:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093827.448706:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013706112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093827.448742:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 450 00000100:00100000:0.0:1784093827.448758:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013706368:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093827.448759:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 451 00000100:00100000:1.0:1784093827.448773:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013706496:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093827.448792:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013706112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093827.448795:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013706240:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093827.448803:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013706368:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093827.448812:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 681 00000100:00100000:2.0:1784093827.448814:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:1.0:1784093827.448815:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013706496:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093827.448822:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 450 00000100:00100000:1.0:1784093827.448831:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 451 00000100:00080000:2.0:1784093827.448842:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093827.448847:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093827.448850:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784093827.561577:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093828.073617:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784093828.073641:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024245632:0@lo:400:kworker.0 00000100:00100000:1.0:1784093828.073650:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024246016:0@lo:400:kworker.0 00000100:00100000:0.0:1784093828.073657:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024245376:0@lo:400:kworker.0 00000100:00100000:3.0:1784093828.073670:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024245760:0@lo:400:kworker.0 00000100:00100000:2.0:1784093828.073738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093828.073744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093828.073785:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245632 00000100:00100000:3.0:1784093828.073786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093828.073805:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245632 00000100:00100000:2.0:1784093828.073810:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024245504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093828.073814:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024245888:0@lo:400:kworker.0 00000100:00100000:3.0:1784093828.073835:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245760 00000100:00100000:3.0:1784093828.073841:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245760 00000100:00100000:2.0:1784093828.073854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093828.073860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093828.073865:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1784093828.073878:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024245632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093828.073894:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024246144:0@lo:400:kworker.0 00000100:00100000:3.0:1784093828.073896:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1784093828.073910:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245376 00000100:00100000:3.0:1784093828.073912:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024245760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093828.073917:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245376 00000100:00100000:2.0:1784093828.073928:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093828.073957:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1784093828.073970:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024245376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093828.073971:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024245632:12345-0@lo:400:kworker.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093828.073972:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024245632:0@lo:400:kworker.0 00000100:00100000:3.0:1784093828.073981:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024245760:12345-0@lo:400:kworker.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093828.073990:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1784093828.073999:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1784093828.074010:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093828.074035:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246016 00000100:00100000:1.0:1784093828.074039:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245888 00000100:00100000:0.0:1784093828.074043:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024245376:12345-0@lo:400:kworker.0 Request processed in 77us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093828.074045:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245888 00000100:00100000:3.0:1784093828.074049:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246016 00000100:00100000:0.0:1784093828.074057:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1784093828.074068:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024245504 00000100:00100000:2.0:1784093828.074073:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024245504 00000100:00100000:1.0:1784093828.074090:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246144 00000100:00100000:1.0:1784093828.074096:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246144 00000100:00100000:3.0:1784093828.074104:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1784093828.074113:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024245376:0@lo:400:kworker.0 00000100:00100000:3.0:1784093828.074119:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024246016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093828.074121:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1784093828.074132:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1784093828.074136:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024245504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093828.074147:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024245888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093828.074151:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1784093828.074164:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024246144:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784093828.074170:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093828.074177:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024246016:12345-0@lo:400:kworker.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093828.074186:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1784093828.074208:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024245888:12345-0@lo:400:kworker.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093828.074217:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1784093828.074230:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024245760:0@lo:400:kworker.0 00000100:00100000:0.0:1784093828.074232:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024246144:12345-0@lo:400:kworker.0 Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093828.074234:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024245504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093828.074247:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1784093828.074254:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1784093828.074268:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024246016:0@lo:400:kworker.0 00000100:00080000:2.0:1784093828.074289:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093828.074293:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024245888:0@lo:400:kworker.0 00000100:00100000:0.0:1784093828.074293:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000100:00080000:2.0:1784093828.074295:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784093828.074301:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237374700, transno 4294967333 00000100:00080000:2.0:1784093828.074309:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093828.074333:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024246144:0@lo:400:kworker.0 00000100:00100000:0.0:1784093828.074351:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024245504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784093828.585661:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093829.609596:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093830.121783:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024246272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093830.121875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093830.121940:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246272 00000100:00100000:2.0:1784093830.121950:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246272 00000100:00080000:3.0:1784093830.122005:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093830.122034:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1784093830.122046:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024246272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093830.122087:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093830.122146:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024246272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093830.122155:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1784093830.122206:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024246272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093830.633767:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093831.657669:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093832.568517:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093832.568562:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093832.568570:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706752 00000100:00100000:3.0:1784093832.568580:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706752 00000100:00100000:2.0:1784093832.568599:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093832.568656:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706624 00000100:00100000:2.0:1784093832.568658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784093832.568667:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093832.568668:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706624 00000100:00100000:3.0:1784093832.568677:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:3.0:1784093832.568690:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013706752:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093832.568700:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707008 00000100:00100000:2.0:1784093832.568707:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707008 00000100:00100000:1.0:1784093832.568714:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013706880 00000100:00100000:1.0:1784093832.568720:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013706880 00000100:00100000:0.0:1784093832.568756:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 683 00000100:00100000:2.0:1784093832.568767:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 454 00000100:00100000:0.0:1784093832.568778:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013706624:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093832.568779:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013706752:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093832.568782:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 455 00000100:00100000:2.0:1784093832.568787:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013707008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093832.568812:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:1.0:1784093832.568812:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013706880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093832.568855:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013706624:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093832.568863:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013707008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093832.568870:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013706880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093832.568887:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 454 00000100:00100000:0.0:1784093832.568894:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 683 00000100:00100000:1.0:1784093832.568901:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 455 00000100:00080000:2.0:1784093832.568927:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093832.568934:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784093832.681624:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093833.193648:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024246400:0@lo:400:kworker.0 00000100:00100000:3.0:1784093833.193689:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024246656:0@lo:400:kworker.0 00000100:00100000:1.0:1784093833.193808:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024246784:0@lo:400:kworker.0 00000100:00100000:0.0:1784093833.194485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093833.194496:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024246528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093833.195665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093833.195692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093833.195700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093833.195701:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024246912:0@lo:400:kworker.0 00000100:00100000:3.0:1784093833.195704:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024247168:0@lo:400:kworker.0 00000100:00100000:2.0:1784093833.195717:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024247040:0@lo:400:kworker.0 00000100:00100000:1.0:1784093833.195756:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246400 00000100:00100000:0.0:1784093833.195761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093833.195765:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246400 00000100:00100000:3.0:1784093833.195767:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246656 00000100:00100000:2.0:1784093833.195769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093833.195771:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246656 00000100:00100000:3.0:1784093833.195812:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246784 00000100:00100000:3.0:1784093833.195815:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246784 00000100:00100000:1.0:1784093833.195816:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1784093833.195820:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246912 00000100:00100000:0.0:1784093833.195825:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246912 00000100:00100000:1.0:1784093833.195827:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024246400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093833.195828:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024246528 00000100:00100000:2.0:1784093833.195834:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024246528 00000100:00100000:3.0:1784093833.195848:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247040 00000100:00100000:3.0:1784093833.195853:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247040 00000100:00100000:0.0:1784093833.195875:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1784093833.195883:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1784093833.195884:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1784093833.195885:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024246400:12345-0@lo:400:kworker.0 Request processed in 61us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093833.195890:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024246912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093833.195895:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024246528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093833.195901:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1784093833.195904:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024246656:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784093833.195927:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093833.195946:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024246912:12345-0@lo:400:kworker.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093833.195954:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024246656:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093833.195955:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1784093833.195967:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1784093833.195978:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024246528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093833.195987:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784093833.195987:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024246912:0@lo:400:kworker.0 00000100:00100000:3.0:1784093833.195988:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1784093833.196001:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024246784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093833.196005:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024246400:0@lo:400:kworker.0 00000100:00100000:0.0:1784093833.196010:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1784093833.196022:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024247040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093833.196040:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024246528:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784093833.196044:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093833.196049:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024246784:12345-0@lo:400:kworker.0 Request processed in 52us (354us total) trans 0 rc 0/0 00000100:00080000:1.0:1784093833.196049:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093833.196054:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093833.196064:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1784093833.196070:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024247040:0@lo:400:kworker.0 00000100:00100000:0.0:1784093833.196071:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024247040:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093833.196085:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1784093833.196091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093833.196099:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024246784:0@lo:400:kworker.0 00000100:00100000:3.0:1784093833.196124:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024246656:0@lo:400:kworker.0 00000100:00100000:1.0:1784093833.196129:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247168 00000100:00100000:1.0:1784093833.196132:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247168 00000100:00100000:1.0:1784093833.196158:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1784093833.196165:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024247168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093833.196199:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024247168:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093833.196205:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1784093833.196229:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024247168:0@lo:400:kworker.0 00010000:00010000:0.0:1784093833.705571:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093834.729644:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093835.241735:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093835.241770:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024247296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093835.241868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093835.241944:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247296 00000100:00100000:2.0:1784093835.241959:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247296 00000100:00080000:1.0:1784093835.242014:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093835.242043:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784093835.242058:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024247296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093835.242095:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093835.242172:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024247296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093835.242180:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1784093835.242240:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024247296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093835.753696:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093836.777614:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093837.688597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093837.688640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093837.688688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093837.688720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093837.688752:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707520 00000100:00100000:3.0:1784093837.688763:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707520 00000100:00100000:3.0:1784093837.688810:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707392 00000100:00100000:3.0:1784093837.688812:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707392 00000100:00100000:3.0:1784093837.688833:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 458 00000100:00100000:3.0:1784093837.688845:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013707520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093837.688878:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707136 00000100:00100000:0.0:1784093837.688885:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707136 00000100:00100000:3.0:1784093837.688915:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013707520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093837.688924:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 458 00000100:00100000:3.0:1784093837.688949:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:3.0:1784093837.688954:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013707392:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093837.688976:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 685 00000100:00100000:3.0:1784093837.688981:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013707392:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093837.688988:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:0.0:1784093837.688994:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013707136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093837.689004:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093837.689008:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093837.689033:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013707136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093837.689040:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 685 00000100:00100000:1.0:1784093837.689106:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707264 00000100:00100000:1.0:1784093837.689111:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707264 00000100:00100000:1.0:1784093837.689170:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 658 00000100:00100000:1.0:1784093837.689178:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013707264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093837.689216:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013707264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093837.689223:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 658 00000100:00080000:3.0:1784093837.689319:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784093837.801680:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093838.313626:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024247552:0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.313640:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024247424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093838.313706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093838.313706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093838.313714:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024247808:0@lo:400:kworker.0 00000100:00100000:1.0:1784093838.313774:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247552 00000100:00100000:1.0:1784093838.313781:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247552 00000100:00100000:1.0:1784093838.313828:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1784093838.313828:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247424 00000100:00100000:0.0:1784093838.313832:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247424 00000100:00100000:1.0:1784093838.313845:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024247552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.313868:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1784093838.313874:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024247424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093838.313892:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024247552:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093838.313898:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00002000:00000024:0.0:1784093838.313902:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093838.313950:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024247424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093838.313956:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1784093838.313989:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024247552:0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.314003:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024247424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093838.314009:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024247936:0@lo:400:kworker.0 00000100:00100000:2.0:1784093838.314023:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024248064:0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.314031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093838.314057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093838.314077:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784093838.314083:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024247680:0@lo:400:kworker.0 00000100:00100000:2.0:1784093838.314104:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093838.314133:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024248192:0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.314133:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247936 00000100:00100000:0.0:1784093838.314136:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247936 00000100:00100000:2.0:1784093838.314158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093838.314164:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248192 00000100:00100000:0.0:1784093838.314167:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248192 00000100:00100000:0.0:1784093838.314200:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1784093838.314204:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248064 00000100:00100000:0.0:1784093838.314206:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024247936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093838.314207:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248064 00000100:00100000:3.0:1784093838.314254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093838.314262:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024247936:12345-0@lo:400:kworker.0 Request processed in 56us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093838.314264:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1784093838.314272:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024248192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.314275:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1784093838.314296:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247680 00000100:00100000:0.0:1784093838.314299:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247680 00000100:00100000:3.0:1784093838.314303:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024247808 00000100:00100000:3.0:1784093838.314310:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024247808 00000100:00100000:0.0:1784093838.314325:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1784093838.314327:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024248192:12345-0@lo:400:kworker.0 Request processed in 42us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093838.314333:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024248064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093838.314334:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1784093838.314345:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1784093838.314358:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024247680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.314381:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024248064:12345-0@lo:400:kworker.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093838.314387:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1784093838.314403:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024247680:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093838.314411:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1784093838.314446:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1784093838.314446:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024247808:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093838.314490:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093838.314491:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024247808:12345-0@lo:400:kworker.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093838.314496:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093838.314501:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093838.314501:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1784093838.314542:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024247808:0@lo:400:kworker.0 00000100:00100000:0.0:1784093838.314553:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024247936:0@lo:400:kworker.0 00000100:00100000:1.0:1784093838.314823:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024247680:0@lo:400:kworker.0 00000100:00100000:1.0:1784093838.314829:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024248192:0@lo:400:kworker.0 00000100:00100000:1.0:1784093838.314834:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024248064:0@lo:400:kworker.0 00000100:00100000:2.0:1784093838.653467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093838.653721:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707648 00000100:00100000:3.0:1784093838.653731:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707648 00000100:00100000:1.0:1784093838.653871:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:1.0:1784093838.653886:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013707648:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093838.653994:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013707648:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 112us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093838.654018:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:1.0:1784093838.656113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093838.656339:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707776 00000100:00100000:2.0:1784093838.656351:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707776 00000100:00100000:2.0:1784093838.656418:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 290 00000100:00100000:2.0:1784093838.656459:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013707776:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093838.657776:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013707776:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 1309us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093838.657788:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 290 00000100:00100000:3.0:1784093838.660720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093838.660830:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013707904 00000100:00100000:1.0:1784093838.660842:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013707904 00000100:00100000:1.0:1784093838.660893:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 291 00000100:00100000:1.0:1784093838.660904:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013707904:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093838.661267:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013707904:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 364us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093838.661275:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 291 00000100:00100000:0.0:1784093838.664313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093838.664444:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708032 00000100:00100000:2.0:1784093838.664453:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708032 00000100:00100000:2.0:1784093838.664545:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 584 00000100:00100000:2.0:1784093838.664555:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013708032:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093838.664959:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013708032:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 405us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093838.664967:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 584 00000100:00100000:3.0:1784093838.669951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093838.670059:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708160 00000100:00100000:2.0:1784093838.670083:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708160 00000100:00100000:2.0:1784093838.670178:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 585 00000100:00100000:2.0:1784093838.670189:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013708160:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093838.670280:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013708160:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 93us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093838.670286:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 585 00000100:00100000:3.0:1784093838.671205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093838.671293:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708288 00000100:00100000:0.0:1784093838.671300:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708288 00000100:00100000:0.0:1784093838.671338:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 292 00000100:00100000:0.0:1784093838.671347:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013708288:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093838.671730:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013708288:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 384us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093838.671738:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 292 00000100:00100000:0.0:1784093838.672670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093838.672816:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708416 00000100:00100000:2.0:1784093838.672823:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708416 00000100:00100000:2.0:1784093838.672907:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 293 00000100:00100000:2.0:1784093838.672916:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013708416:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093838.673360:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43078:x1870757013708416:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 443us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093838.673368:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 293 00000100:00100000:3.0:1784093838.675200:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093838.675550:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708544 00000100:00100000:1.0:1784093838.675559:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708544 00000100:00100000:1.0:1784093838.675654:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 586 00000100:00100000:1.0:1784093838.675664:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013708544:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093838.676048:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:43078:x1870757013708544:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 385us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093838.676056:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 586 00000100:00100000:3.0:1784093838.688640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093838.689083:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708672 00000100:00100000:2.0:1784093838.689103:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708672 00000100:00100000:2.0:1784093838.689202:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:2.0:1784093838.689217:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43079:x1870757013708672:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093838.689246:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093838.689278:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf577d expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093838.689390:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca3ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093838.689410:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093838.689469:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093838.689774:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:2.0:1784093838.689780:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093838.689906:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093838.689943:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf577d expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093838.689971:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca3ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf577d expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093838.689982:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b300) 00010000:00010000:2.0:1784093838.689986:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093838.689990:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093838.690079:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43079:x1870757013708672:12345-192.168.204.57@tcp:101:rm.0 Request processed in 865us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093838.690088:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:2.0:1784093838.693097:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093838.693498:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013708928 00000100:00100000:3.0:1784093838.693509:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013708928 00000100:00100000:3.0:1784093838.693631:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 588 00000100:00100000:3.0:1784093838.693642:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:43079:x1870757013708928:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093838.693662:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093838.693683:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca3f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5784 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093838.694004:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:3.0:1784093838.694356:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca3f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5784 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093838.694371:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093838.694374:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784093838.694378:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5784 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093838.694394:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784093838.694565:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:43079:x1870757013708928:12345-192.168.204.57@tcp:101:rm.0 Request processed in 924us (1477us total) trans 4294967522 rc 301/301 00000100:00100000:3.0:1784093838.694573:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 588 00000100:00100000:3.0:1784093838.697725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093838.697878:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013709056 00000100:00100000:1.0:1784093838.697892:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013709056 00000100:00100000:1.0:1784093838.697996:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 62 00000100:00100000:1.0:1784093838.698009:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:43079:x1870757013709056:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784093838.701992:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:43079:x1870757013709056:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3976us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093838.702006:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 62 00000100:00100000:2.0:1784093838.704552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093838.704605:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013709312 00000100:00100000:3.0:1784093838.704622:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013709312 00000100:00100000:3.0:1784093838.704674:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 63 00000100:00100000:3.0:1784093838.704684:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:43079:x1870757013709312:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:3.0:1784093838.705227:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:43079:x1870757013709312:12345-192.168.204.57@tcp:35:rm.0 Request processed in 543us (680us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1784093838.705236:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 63 00000100:00100000:3.0:1784093838.707687:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093838.707782:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013709568 00000100:00100000:1.0:1784093838.707791:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013709568 00000100:00100000:1.0:1784093838.707876:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 589 00000100:00100000:1.0:1784093838.707887:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:43079:x1870757013709568:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093838.707936:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784093838.707986:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca3ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf577d expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708009:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5768 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708020:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca026) 00010000:00010000:1.0:1784093838.708024:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907202e6b300) 00010000:00010000:1.0:1784093838.708035:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093838.708058:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708071:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708080:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708091:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708098:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708105:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708404:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708414:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708475:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708630:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708639:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708646:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708652:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093838.708656:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708664:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708673:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093838.708675:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093838.708679:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708684:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca40f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708701:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708707:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708719:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708724:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093838.708727:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708733:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708740:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093838.708743:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093838.708745:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708751:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca401 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708762:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708769:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708775:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708779:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093838.708783:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708798:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708807:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907219c12c00) 00010000:00010000:1.0:1784093838.708809:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093838.708812:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093838.708818:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca408 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093838.708888:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:43079:x1870757013709568:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1003us (1205us total) trans 0 rc -13/-13 00000100:00100000:1.0:1784093838.708896:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 589 00010000:00010000:2.0:1784093838.825559:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093839.850485:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093839.943404:0:72982:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0df78270 20000000:00000080:1.0:1784093839.943438:0:72982:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103e800 uarg=0000000000000000 00010000:00010000:1.0:1784093839.943912:0:72982:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093839.943927:0:72982:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093839.943942:0:72982:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093839.943959:0:72982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093839.943976:0:72982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca36e expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093839.943985:0:72982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093839.944020:0:72982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca36e expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093839.944041:0:72982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca36e expref: 18 pid: 5772 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093839.944057:0:72982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72982:1870757024248320:0@lo:104: 00000100:00100000:1.0:1784093839.944120:0:72982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093839.944168:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248320 00000100:00100000:1.0:1784093839.944191:0:72982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093839.944199:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248320 00000100:00100000:0.0:1784093839.944246:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784093839.944254:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:72982:x1870757024248320:12345-0@lo:104: 00010000:00010000:0.0:1784093839.944264:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944326:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784093839.944333:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:72982:x1870757024248320:12345-0@lo:104: Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093839.944338:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1784093839.944348:0:72982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72982:1870757024248320:0@lo:104: 00010000:00010000:1.0:1784093839.944369:0:72982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093839.944454:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093839.944461:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093839.944481:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093839.944485:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093839.944506:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093839.944513:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093839.944519:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093839.944558:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093839.944565:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093839.944593:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093839.944599:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41e00/0x9ce98053214ca36e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca375 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093839.944615:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093839.944617:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093839.944619:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093839.944680:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093839.944691:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024248448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093839.944719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093839.944796:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248448 00000100:00100000:0.0:1784093839.944800:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248448 00010000:00010000:0.0:1784093839.944818:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca36e expref: 19 pid: 5772 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093839.944849:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784093839.944857:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024248448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093839.944867:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093839.944872:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca36e expref: 19 pid: 5772 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944882:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca36e expref: 19 pid: 5772 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944894:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214ca375 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca36e expref: 19 pid: 5772 timeout: 1151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944906:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944923:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944936:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944942:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944948:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944955:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944961:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093839.944965:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944972:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944983:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093839.944992:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784093839.945024:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024248448:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093839.945031:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784093839.945059:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024248448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093839.945125:0:72982:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093839.945134:0:72982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093839.945140:0:72982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214ca416 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093840.291590:0:73030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1b6a4d40 20000000:00000080:1.0:1784093840.291605:0:73030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103c400 uarg=0000000000000000 00010000:00010000:1.0:1784093840.291817:0:73030:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784093840.291832:0:73030:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784093840.291846:0:73030:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093840.291865:0:73030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291886:0:73030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291897:0:73030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291904:0:73030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291910:0:73030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291918:0:73030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291924:0:73030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093840.291928:0:73030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291935:0:73030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291947:0:73030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291954:0:73030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093840.291961:0:73030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214ca41d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093840.362579:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024248576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093840.362643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093840.362696:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248576 00000100:00100000:1.0:1784093840.362704:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248576 00000100:00080000:3.0:1784093840.362744:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093840.362759:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784093840.362771:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024248576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784093840.362809:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093840.362864:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024248576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093840.362872:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784093840.362907:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024248576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093840.873577:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093840.883246:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 10000000:01000000:0.0:1784093841.385523:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093841.385530:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093841.385534:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093841.385577:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.385588:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.385600:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093841.385625:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024248704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093841.385696:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093841.385752:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093841.385817:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248704 00000100:00100000:2.0:1784093841.385830:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248704 00000100:00100000:2.0:1784093841.385873:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1784093841.385880:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024248704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093841.385896:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093841.385908:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca424 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.385928:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca424 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.385935:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca424 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.385995:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093841.386039:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024248704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093841.386045:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1784093841.386091:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024248704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093841.386110:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.386121:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093841.386146:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093841.386151:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.386158:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093841.450345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093841.450411:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013709696 00000100:00100000:2.0:1784093841.450441:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013709696 00000100:00080000:3.0:1784093841.450496:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093841.450515:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 590 00000100:00100000:2.0:1784093841.450524:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43191:x1870757013709696:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093841.450543:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093841.450566:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca432 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf578b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.450621:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca439 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.450639:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.450666:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093841.450858:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093841.450863:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093841.450939:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca439 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.450964:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca432 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf578b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.450981:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca439 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf578b expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.450990:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093841.450993:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093841.450996:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093841.451060:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43191:x1870757013709696:12345-192.168.204.57@tcp:101:rm.0 Request processed in 536us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093841.451068:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 590 00000100:00100000:0.0:1784093841.452727:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093841.452781:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013709824 00000100:00100000:3.0:1784093841.452791:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013709824 00000100:00100000:3.0:1784093841.452834:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:3.0:1784093841.452844:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:43191:x1870757013709824:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093841.452858:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093841.452872:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5792 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.452914:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.452927:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.452937:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.452951:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.452958:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.452979:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453264:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453274:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453281:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093841.453366:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00000004:00200000:3.0:1784093841.453370:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093841.453498:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453511:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453518:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453531:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453537:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093841.453541:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453549:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453565:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:3.0:1784093841.453568:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093841.453573:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453579:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453586:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453591:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453594:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453597:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093841.453599:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453602:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453606:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907204fce900) 00010000:00010000:3.0:1784093841.453607:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093841.453609:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453612:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca44e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453644:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5792 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453653:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5792 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.453658:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce800) 00010000:00010000:3.0:1784093841.453659:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093841.453661:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093841.453697:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:43191:x1870757013709824:12345-192.168.204.57@tcp:101:rm.0 Request processed in 855us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093841.453705:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:3.0:1784093841.455568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093841.455616:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013710080 00000100:00100000:1.0:1784093841.455623:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013710080 00000100:00100000:1.0:1784093841.455659:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 592 00000100:00100000:1.0:1784093841.455666:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:43191:x1870757013710080:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093841.455682:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093841.455697:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca45c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5799 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093841.455877:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:1.0:1784093841.456088:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca45c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5799 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.456097:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:1.0:1784093841.456100:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784093841.456102:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214ca45c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5799 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.456119:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093841.456172:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:43191:x1870757013710080:12345-192.168.204.57@tcp:101:rm.0 Request processed in 506us (609us total) trans 4294967524 rc 301/301 00000100:00100000:1.0:1784093841.456180:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 592 00000100:00100000:1.0:1784093841.459194:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093841.459251:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013710208 00000100:00100000:2.0:1784093841.459260:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013710208 00000100:00100000:2.0:1784093841.459311:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 64 00000100:00100000:2.0:1784093841.459321:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:43191:x1870757013710208:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784093841.461503:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:43191:x1870757013710208:12345-192.168.204.57@tcp:37:rm.0 Request processed in 2178us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093841.461512:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 64 00000100:00100000:3.0:1784093841.463206:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093841.463302:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013710464 00000100:00100000:0.0:1784093841.463312:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013710464 00000100:00100000:0.0:1784093841.463402:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 65 00000100:00100000:0.0:1784093841.463411:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:43191:x1870757013710464:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:0.0:1784093841.463822:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:43191:x1870757013710464:12345-192.168.204.57@tcp:35:rm.0 Request processed in 412us (618us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1784093841.463829:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 65 00000100:00100000:1.0:1784093841.465230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093841.465503:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013710720 00000100:00100000:2.0:1784093841.465511:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013710720 00000100:00100000:2.0:1784093841.465552:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 593 00000100:00100000:2.0:1784093841.465559:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:43191:x1870757013710720:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784093841.465599:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093841.465625:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5792 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465650:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff907204fce800) 00010000:00010000:2.0:1784093841.465667:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca439 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf578b expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465677:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093841.465683:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093841.465704:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465716:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465725:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465735:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465741:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.465747:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466030:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466039:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466046:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093841.466842:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 7680 00010000:00010000:2.0:1784093841.466856:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466864:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466871:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466877:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093841.466881:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466888:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466897:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093841.466900:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093841.466903:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466919:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca478 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466935:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466941:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466947:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466952:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093841.466955:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466961:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466968:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784093841.466971:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093841.466973:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.466979:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca46a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093841.466990:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000000cec49f6 reply state 0000000047df1119 transno 4294967526 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093841.466998:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093841.467065:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:43191:x1870757013710720:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1505us (1837us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1784093841.467072:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 593 00010000:00010000:0.0:1784093841.467908:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.467918:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.467925:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.467930:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093841.467934:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.467944:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.467954:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781e00) 00010000:00010000:0.0:1784093841.467957:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093841.467960:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.467978:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca471 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093841.487583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093841.487669:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013710848 00000100:00100000:3.0:1784093841.487680:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013710848 00000100:00100000:3.0:1784093841.487735:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 594 00000100:00100000:3.0:1784093841.487743:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:43195:x1870757013710848:12345-192.168.204.57@tcp:101:mkdir.0 00010000:00010000:3.0:1784093841.487763:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093841.487781:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca47f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57a0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.487842:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca486 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.487856:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.487879:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093841.487929:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093841.487932:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093841.487948:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca486 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.487965:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca47f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57a0 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.487977:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca486 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57a0 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.487983:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093841.487985:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093841.487987:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784093841.488049:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:43195:x1870757013710848:12345-192.168.204.57@tcp:101:mkdir.0 Request processed in 306us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093841.488056:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 594 00000100:00100000:1.0:1784093841.489472:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093841.489496:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013710976 00000100:00100000:3.0:1784093841.489503:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013710976 00000100:00100000:1.0:1784093841.489526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093841.489545:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013711232 00000100:00100000:3.0:1784093841.489550:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013711232 00000100:00100000:0.0:1784093841.489590:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 595 00000100:00100000:2.0:1784093841.489600:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:0.0:1784093841.489602:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:2355:x1870757013710976:12345-192.168.204.57@tcp:41:mkdir.0 00000100:00100000:2.0:1784093841.489616:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:43195:x1870757013711232:12345-192.168.204.57@tcp:36:mkdir.0 00000004:00000024:0.0:1784093841.489634:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:2.0:1784093841.489646:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093841.489663:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca486 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57a0 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.489676:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce900) 00000100:00100000:0.0:1784093841.489683:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:2355:x1870757013710976:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 85us (225us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093841.489686:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784093841.489691:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 595 00010000:00010000:2.0:1784093841.489749:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.489759:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.489768:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.489782:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.489789:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.489796:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093841.490337:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 512 00010000:00010000:2.0:1784093841.490349:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.490357:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.490364:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.490370:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093841.490374:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.490382:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.490390:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784093841.490393:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093841.490397:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.490403:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca48d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093841.490417:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006c85f163 reply state 00000000f2ea6ed5 transno 4294967527 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093841.490457:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093841.490510:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:43195:x1870757013711232:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 899us (985us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1784093841.490515:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 596 00010000:00010000:2.0:1784093841.491171:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.491195:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.491200:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.491209:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093841.491213:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.491219:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.491229:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781f00) 00010000:00010000:2.0:1784093841.491235:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093841.491238:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.491245:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca494 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093841.508925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093841.509020:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013711360 00000100:00100000:3.0:1784093841.509030:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013711360 00000100:00100000:3.0:1784093841.509085:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 597 00000100:00100000:3.0:1784093841.509096:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:43199:x1870757013711360:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784093841.509133:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093841.509150:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca49b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57a7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.509213:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca4a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.509226:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.509235:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093841.509284:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093841.509289:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093841.509324:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.509342:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca49b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57a7 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.509354:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57a7 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.509360:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093841.509362:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093841.509365:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784093841.509410:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:43199:x1870757013711360:12345-192.168.204.57@tcp:101:chown.0 Request processed in 318us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093841.509415:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 597 00000100:00100000:1.0:1784093841.510280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093841.510315:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013711488 00000100:00100000:3.0:1784093841.510319:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013711488 00000100:00100000:3.0:1784093841.510345:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 598 00000100:00100000:3.0:1784093841.510349:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:43199:x1870757013711488:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784093841.510355:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093841.510362:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca4a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57ae expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510386:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510392:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510398:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510405:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510408:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510412:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510496:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca4be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510502:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca4be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510515:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca4be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093841.510535:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 512 00000004:00200000:3.0:1784093841.510537:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093841.510545:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca4be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510552:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510556:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510561:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510565:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093841.510568:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510572:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510577:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093841.510579:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093841.510581:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510585:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ca4b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510598:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510602:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510606:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510609:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093841.510610:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510613:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510617:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907204fce700) 00010000:00010000:3.0:1784093841.510619:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093841.510620:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510623:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca4b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510638:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca4a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ae expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510644:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca4be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ae expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.510656:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784093841.510657:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093841.510659:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784093841.510689:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:43199:x1870757013711488:12345-192.168.204.57@tcp:101:chown.0 Request processed in 339us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093841.510693:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 598 00000100:00100000:1.0:1784093841.511837:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093841.511895:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013711744 00000100:00100000:2.0:1784093841.511901:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013711744 00000100:00100000:2.0:1784093841.511934:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 599 00000100:00100000:2.0:1784093841.511948:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:43199:x1870757013711744:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:2.0:1784093841.511981:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093841.511997:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca4be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ae expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.512022:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784093841.512038:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093841.512053:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.512062:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.512069:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093841.520045:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000004:00010000:3.0:1784093841.520055:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c097d708 reply state 00000000ca124815 transno 4294967528 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093841.520063:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000100:00100000:3.0:1784093841.520073:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093841.520151:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:3.0:1784093841.520233:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093841.520247:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43199:x1870757013711744:12345-192.168.204.57@tcp:36:chown.0 Request processed in 8304us (8408us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1784093841.520255:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 599 00010000:00010000:0.0:1784093841.520272:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.520283:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.520291:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.520297:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093841.520302:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.520311:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.520327:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781f00) 00010000:00010000:0.0:1784093841.520331:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093841.520336:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.520349:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ca4c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093841.815380:0:73227:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec4a940f0 20000000:00000080:1.0:1784093841.815394:0:73227:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103888400 uarg=0000000000000000 00010000:00010000:1.0:1784093841.815849:0:73227:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093841.815881:0:73227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:1.0:1784093841.815885:0:73227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093841.815896:0:73227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca4a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57a7 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.815917:0:73227:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093841.815933:0:73227:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093841.815947:0:73227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.815967:0:73227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca424 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.815976:0:73227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.816011:0:73227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca424 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.816025:0:73227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca424 expref: 18 pid: 5771 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093841.816040:0:73227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73227:1870757024248832:0@lo:104: 00000100:00100000:1.0:1784093841.816095:0:73227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093841.816133:0:73227:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093841.816139:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248832 00000100:00100000:2.0:1784093841.816148:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248832 00000100:00100000:2.0:1784093841.816193:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784093841.816203:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:73227:x1870757024248832:12345-0@lo:104: 00010000:00010000:2.0:1784093841.816216:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093841.816274:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093841.816281:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:73227:x1870757024248832:12345-0@lo:104: Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093841.816289:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1784093841.816294:0:73227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73227:1870757024248832:0@lo:104: 00010000:00010000:3.0:1784093841.816307:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093841.816313:0:73227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.816316:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.816332:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093841.816337:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.816345:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093841.816358:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093841.816371:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093841.816405:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.816412:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093841.816467:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093841.816475:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214ca424 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca42b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093841.816484:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024248960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093841.816492:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093841.816497:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093841.816501:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093841.816519:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093841.816560:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024248960 00000100:00100000:0.0:1784093841.816564:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024248960 00010000:00010000:0.0:1784093841.816582:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca424 expref: 19 pid: 5771 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093841.816601:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784093841.816606:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024248960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093841.816613:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093841.816617:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca424 expref: 19 pid: 5771 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816624:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca424 expref: 19 pid: 5771 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816642:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41400/0x9ce98053214ca42b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca424 expref: 19 pid: 5771 timeout: 1152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816655:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816662:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816675:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816683:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816697:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816705:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816709:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093841.816712:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816717:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816728:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093841.816735:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093841.816753:0:73227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.816763:0:73227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093841.816770:0:73227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214ca4cc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093841.816782:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024248960:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093841.816792:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784093841.816819:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024248960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093841.897636:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093842.124341:0:73275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6cbb93e0 20000000:00000080:3.0:1784093842.124360:0:73275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723caa0400 uarg=0000000000000000 00010000:00010000:3.0:1784093842.124596:0:73275:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093842.124607:0:73275:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093842.124616:0:73275:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093842.124633:0:73275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124648:0:73275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124658:0:73275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124664:0:73275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124679:0:73275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124686:0:73275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124692:0:73275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093842.124696:0:73275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124705:0:73275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124719:0:73275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124726:0:73275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093842.124733:0:73275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214ca4d3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093842.808247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093842.808291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093842.808347:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093842.808347:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013711872 00000100:00100000:0.0:1784093842.808357:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013711872 00000100:00100000:3.0:1784093842.808365:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712000 00000100:00100000:3.0:1784093842.808373:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712000 00000100:00100000:1.0:1784093842.808380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093842.808414:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712256 00000100:00100000:1.0:1784093842.808454:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712256 00000100:00100000:3.0:1784093842.808463:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 662 00000100:00100000:0.0:1784093842.808468:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00100000:3.0:1784093842.808478:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013712000:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093842.808485:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013711872:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093842.808493:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712128 00000100:00100000:1.0:1784093842.808497:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712128 00000100:00100000:1.0:1784093842.808519:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 462 00000100:00100000:1.0:1784093842.808526:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013712256:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093842.808556:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013711872:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 76us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093842.808565:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013712000:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093842.808568:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013712256:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093842.808569:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00100000:1.0:1784093842.808586:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 462 00000100:00100000:3.0:1784093842.808587:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 662 00000100:00100000:1.0:1784093842.808601:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:1.0:1784093842.808610:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013712128:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093842.808635:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093842.808641:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093842.808642:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013712128:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093842.808647:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 463 00010000:00010000:3.0:1784093842.921539:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093843.049491:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093843.049498:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093843.049502:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093843.049542:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.049551:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.049564:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093843.049584:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024249088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093843.049643:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093843.049694:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249088 00000100:00100000:3.0:1784093843.049698:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839600 going to sleep for 11 seconds 00000100:00100000:2.0:1784093843.049701:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249088 00000100:00100000:2.0:1784093843.049754:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1784093843.049765:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024249088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093843.049788:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093843.049807:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca4da expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093843.049829:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca4da expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093843.049841:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca4da expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093843.049850:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784093843.049903:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024249088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093843.049912:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1784093843.049926:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024249088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093843.049943:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.049953:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093843.049971:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093843.049976:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.049983:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093843.117520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093843.117578:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712384 00000100:00100000:3.0:1784093843.117587:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712384 00000100:00080000:0.0:1784093843.117639:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093843.117660:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 10 00000100:00100000:3.0:1784093843.117672:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013712384:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093843.117689:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093843.117692:0:5764:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca4a2) 00010000:00010000:3.0:1784093843.117694:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093843.117754:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013712384:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 84us (239us total) trans 0 rc 116/116 00000100:00100000:3.0:1784093843.117762:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 10 00000100:00100000:2.0:1784093843.433590:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024249216:0@lo:400:kworker.0 00000100:00100000:3.0:1784093843.433666:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024249600:0@lo:400:kworker.0 00000100:00100000:2.0:1784093843.433699:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093843.433712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093843.433778:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024249728:0@lo:400:kworker.0 00000100:00100000:3.0:1784093843.433788:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024249344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093843.433798:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249216 00000100:00100000:0.0:1784093843.433806:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249216 00000100:00100000:2.0:1784093843.433815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093843.433833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093843.433855:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249600 00000100:00100000:0.0:1784093843.433859:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249728 00000100:00100000:2.0:1784093843.433861:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249600 00000100:00100000:0.0:1784093843.433865:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249728 00000100:00100000:3.0:1784093843.433866:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024249856:0@lo:400:kworker.0 00000100:00100000:3.0:1784093843.433909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093843.433910:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1784093843.433921:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024249216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093843.433929:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249856 00000100:00100000:2.0:1784093843.433934:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249856 00000100:00100000:3.0:1784093843.433942:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093843.433950:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024249472:0@lo:400:kworker.0 00000100:00100000:2.0:1784093843.433967:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1784093843.433981:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024249600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093843.433984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093843.433992:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024249216:12345-0@lo:400:kworker.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093843.434002:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1784093843.434018:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1784093843.434026:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249472 00000100:00100000:3.0:1784093843.434027:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024249856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093843.434030:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249472 00000100:00100000:2.0:1784093843.434035:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024249600:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093843.434043:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1784093843.434050:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1784093843.434061:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024249728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093843.434071:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024249856:12345-0@lo:400:kworker.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093843.434079:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1784093843.434090:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1784093843.434094:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024249728:12345-0@lo:400:kworker.0 Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093843.434105:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024249472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093843.434105:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1784093843.434132:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249344 00000100:00100000:0.0:1784093843.434137:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249344 00000100:00100000:3.0:1784093843.434144:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024249856:0@lo:400:kworker.0 00000100:00100000:2.0:1784093843.434151:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024249472:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093843.434159:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1784093843.434167:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1784093843.434171:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024249472:0@lo:400:kworker.0 00000100:00100000:0.0:1784093843.434175:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024249344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093843.434210:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093843.434223:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024249600:0@lo:400:kworker.0 00000100:00100000:2.0:1784093843.434243:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024249728:0@lo:400:kworker.0 00000100:00080000:3.0:1784093843.434258:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093843.434259:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024249344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (425us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093843.434264:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093843.434264:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024249216:0@lo:400:kworker.0 00000100:00100000:0.0:1784093843.434269:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:3.0:1784093843.434270:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093843.434311:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024249344:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1784093843.699174:0:73520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd84949810 20000000:00000080:0.0:1784093843.699192:0:73520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e109c00 uarg=0000000000000000 00010000:00010000:0.0:1784093843.699391:0:73520:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093843.699412:0:73520:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093843.699461:0:73520:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093843.699480:0:73520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093843.699496:0:73520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca4da expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093843.699505:0:73520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093843.699539:0:73520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca4da expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093843.699553:0:73520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca4da expref: 18 pid: 5771 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093843.699567:0:73520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73520:1870757024249984:0@lo:104: 00000100:00100000:0.0:1784093843.699625:0:73520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093843.699678:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024249984 00000100:00100000:0.0:1784093843.699678:0:73520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071034863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093843.699684:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024249984 00000100:00100000:2.0:1784093843.699729:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784093843.699736:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:73520:x1870757024249984:12345-0@lo:104: 00010000:00010000:2.0:1784093843.699746:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093843.699804:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093843.699811:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:73520:x1870757024249984:12345-0@lo:104: Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093843.699820:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00010000:3.0:1784093843.699827:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784093843.699827:0:73520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73520:1870757024249984:0@lo:104: 00010000:00010000:3.0:1784093843.699834:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.699842:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093843.699846:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093843.699850:0:73520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.699859:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093843.699869:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093843.699874:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093843.699909:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093843.699916:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093843.699939:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093843.699942:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024250112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093843.699965:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214ca4da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca4e1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093843.699975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784093843.699980:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093843.699983:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093843.699986:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093843.700012:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250112 00000100:00100000:1.0:1784093843.700017:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250112 00010000:00010000:1.0:1784093843.700043:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca4da expref: 19 pid: 5771 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093843.700069:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784093843.700076:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024250112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093843.700094:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093843.700099:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca4da expref: 19 pid: 5771 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700110:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca4da expref: 19 pid: 5771 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700121:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214ca4e1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca4da expref: 19 pid: 5771 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700134:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700142:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700151:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700156:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700161:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700164:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700168:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093843.700170:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700197:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700216:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093843.700226:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093843.700243:0:73520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093843.700253:0:73520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093843.700258:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024250112:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093843.700271:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00010000:0.0:1784093843.700275:0:73520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214ca4e8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093843.700305:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024250112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093843.945581:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093844.698519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093844.698830:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712512 00000100:00100000:2.0:1784093844.698838:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712512 00000100:00100000:2.0:1784093844.698895:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:2.0:1784093844.698906:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:43375:x1870757013712512:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093844.698925:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093844.698948:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca4ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57b5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.699016:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca4f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.699027:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.699039:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093844.699218:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093844.699222:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093844.699288:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca4f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.699309:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca4ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57b5 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.699324:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca4f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57b5 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.699332:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784093844.699336:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093844.699340:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784093844.699394:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43375:x1870757013712512:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 491us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093844.699412:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:1.0:1784093844.701158:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093844.701210:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712640 00000100:00100000:2.0:1784093844.701219:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712640 00000100:00100000:2.0:1784093844.701280:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 601 00000100:00100000:2.0:1784093844.701290:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43375:x1870757013712640:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093844.701306:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093844.701319:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca4fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57bc expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701360:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701375:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701383:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701392:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701397:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701412:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701732:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701742:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701750:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093844.701845:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:2.0:1784093844.701848:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093844.701927:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701940:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701948:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701955:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701961:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093844.701965:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701973:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701982:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784093844.701984:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093844.701988:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.701993:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702005:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702021:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702028:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702034:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093844.702037:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702044:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702051:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781500) 00010000:00010000:2.0:1784093844.702053:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093844.702055:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702059:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca50b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702079:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ca4fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57bc expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702088:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57bc expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093844.702092:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093844.702094:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093844.702101:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784093844.702149:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:43375:x1870757013712640:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 860us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093844.702157:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 601 00000100:00100000:1.0:1784093844.703974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093844.704028:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013712896 00000100:00100000:0.0:1784093844.704036:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013712896 00000100:00100000:0.0:1784093844.704090:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 602 00000100:00100000:0.0:1784093844.704100:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:43375:x1870757013712896:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093844.704140:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093844.704156:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ca512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57bc expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093844.704168:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781d00) 00010000:00010000:0.0:1784093844.704175:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093844.704193:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093844.704204:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093844.704213:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784093844.716153:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000004:00010000:0.0:1784093844.716161:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000007a5ee3ec reply state 000000000630fd4d transno 4294967529 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093844.716180:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093844.716312:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:0.0:1784093844.716414:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093844.716454:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:43375:x1870757013712896:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 12351us (12478us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1784093844.716467:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 602 00010000:00010000:3.0:1784093844.716478:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.716486:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.716493:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.716497:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093844.716501:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.716506:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.716518:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6b900) 00010000:00010000:3.0:1784093844.716521:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093844.716524:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.716528:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ca519 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093844.905495:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093844.905502:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093844.905510:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093844.905550:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.905561:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.905571:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093844.905598:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024250240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093844.905662:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093844.905706:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e32b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093844.905743:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250240 00000100:00100000:1.0:1784093844.905759:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250240 00000100:00100000:1.0:1784093844.905845:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1784093844.905859:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024250240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093844.905878:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093844.905901:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca520 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093844.905933:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca520 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093844.905956:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca520 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093844.905968:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13400, rc 0) 00000100:00100000:1.0:1784093844.906061:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024250240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093844.906071:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1784093844.906100:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024250240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093844.906120:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.906130:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093844.906146:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093844.906150:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093844.906156:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093844.969492:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093845.010302:0:73715:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff765d3890 20000000:00000080:3.0:1784093845.010318:0:73715:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723caa0000 uarg=0000000000000000 00010000:00010000:3.0:1784093845.010823:0:73715:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093845.010857:0:73715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784093845.010860:0:73715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093845.010872:0:73715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca4f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57b5 expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.010893:0:73715:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093845.010908:0:73715:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093845.010922:0:73715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.010934:0:73715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca520 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.010944:0:73715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.010977:0:73715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca520 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.010990:0:73715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca520 expref: 18 pid: 5770 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093845.011005:0:73715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73715:1870757024250368:0@lo:104: 00000100:00100000:3.0:1784093845.011064:0:73715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093845.011111:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250368 00000100:00100000:3.0:1784093845.011116:0:73715:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e32b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093845.011118:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250368 00000100:00100000:2.0:1784093845.011158:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784093845.011165:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:73715:x1870757024250368:12345-0@lo:104: 00010000:00010000:2.0:1784093845.011175:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093845.011222:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093845.011227:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:73715:x1870757024250368:12345-0@lo:104: Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093845.011234:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00010000:0.0:1784093845.011248:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093845.011256:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093845.011260:0:73715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73715:1870757024250368:0@lo:104: 00010000:00010000:0.0:1784093845.011271:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093845.011276:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.011287:0:73715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011287:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093845.011313:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093845.011320:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093845.011348:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011354:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093845.011376:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011383:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214ca520 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca527 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093845.011390:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024250496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093845.011410:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093845.011413:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093845.011445:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093845.011460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093845.011490:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250496 00000100:00100000:0.0:1784093845.011496:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250496 00010000:00010000:0.0:1784093845.011517:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca520 expref: 19 pid: 5770 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093845.011543:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784093845.011550:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024250496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093845.011560:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093845.011566:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca520 expref: 19 pid: 5770 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011577:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca520 expref: 19 pid: 5770 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011588:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13400/0x9ce98053214ca527 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca520 expref: 19 pid: 5770 timeout: 1156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011600:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011606:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011616:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011619:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011624:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011633:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011637:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093845.011639:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011644:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011654:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093845.011662:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093845.011672:0:73715:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.011679:0:73715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093845.011683:0:73715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68400/0x9ce98053214ca52e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093845.011703:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024250496:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093845.011712:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784093845.011742:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024250496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093845.481536:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024250624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093845.481606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093845.481647:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250624 00000100:00100000:3.0:1784093845.481655:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250624 00000100:00100000:3.0:1784093845.481715:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784093845.481725:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024250624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093845.481761:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784093845.481880:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093845.481937:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024250624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 213us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093845.481945:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1784093845.482053:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024250624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093845.993591:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093846.038362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093846.038457:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013713024 00000100:00100000:2.0:1784093846.038470:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013713024 00000100:00080000:3.0:1784093846.038531:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093846.038562:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 603 00000100:00100000:2.0:1784093846.038581:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:43452:x1870757013713024:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093846.038607:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093846.038631:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57c3 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.038706:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.038738:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.038751:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.038763:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.038768:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.038775:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039216:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca54a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039223:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca54a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039229:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca54a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093846.039288:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:2.0:1784093846.039291:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093846.039354:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca54a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039370:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039399:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039407:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039413:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.039417:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039441:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039454:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784093846.039458:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093846.039462:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039467:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca53c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039478:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039483:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039488:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039491:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.039498:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039502:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039507:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff90721a781c00) 00010000:00010000:2.0:1784093846.039508:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093846.039511:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039514:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca543 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039544:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57c3 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039555:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca54a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57c3 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.039560:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093846.039561:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093846.039563:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093846.039637:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43452:x1870757013713024:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1065us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093846.039643:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 603 00000100:00100000:3.0:1784093846.040692:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093846.040738:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013713280 00000100:00100000:2.0:1784093846.040746:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013713280 00000100:00100000:2.0:1784093846.040789:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 604 00000100:00100000:2.0:1784093846.040794:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43452:x1870757013713280:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093846.040813:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093846.040822:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca551 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57ca expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.041026:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.041037:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.041046:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.041060:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.041068:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.041075:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093846.042121:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:2.0:1784093846.042419:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042453:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042460:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042505:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042510:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042515:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042519:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.042522:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042527:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042537:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093846.042540:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093846.042543:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042547:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca558 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093846.042556:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000039a91edf reply state 0000000073729012 transno 4294967530 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093846.042562:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093846.042588:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca551 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ca expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042607:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ca expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.042612:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784093846.042613:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093846.042615:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784093846.042682:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:43452:x1870757013713280:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1886us (1994us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1784093846.042690:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 604 00010000:00010000:0.0:1784093846.043234:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.043245:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.043251:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.043257:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093846.043261:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.043284:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.043303:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff90721a781900) 00010000:00010000:0.0:1784093846.043306:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093846.043311:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.043318:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca55f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093846.043982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093846.044035:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013713536 00000100:00100000:0.0:1784093846.044046:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013713536 00000100:00100000:0.0:1784093846.044099:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 605 00000100:00100000:0.0:1784093846.044108:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:43452:x1870757013713536:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:0.0:1784093846.044154:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093846.044169:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ca expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.044180:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784093846.044189:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093846.044228:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.044240:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093846.044250:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093846.044397:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004cceb7b2 reply state 00000000669247fe transno 4294967531 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093846.044410:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093846.044541:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:43452:x1870757013713536:12345-192.168.204.57@tcp:36:touch.0 Request processed in 432us (560us total) trans 4294967531 rc 0/0 00000100:00100000:0.0:1784093846.044550:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 605 00010000:00010000:2.0:1784093846.045488:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.045502:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.045511:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.045520:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.045525:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.045534:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.045560:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784093846.045564:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093846.045570:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.045590:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca574 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093846.045937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093846.045989:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013713664 00000100:00100000:2.0:1784093846.045998:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013713664 00000100:00100000:2.0:1784093846.046069:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 606 00000100:00100000:2.0:1784093846.046081:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:43452:x1870757013713664:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093846.046106:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093846.046125:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca57b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57d1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.046181:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca57b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57d1 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.046195:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca57b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57d1 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.046230:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784093846.046233:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784093846.046236:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784093846.046286:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:43452:x1870757013713664:12345-192.168.204.57@tcp:101:touch.0 Request processed in 209us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093846.046294:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 606 00000100:00100000:2.0:1784093846.047512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093846.047544:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013713792 00000100:00100000:0.0:1784093846.047554:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013713792 00000100:00080000:2.0:1784093846.047614:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093846.047620:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 294 00000100:00100000:0.0:1784093846.047632:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013713792:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:0.0:1784093846.048068:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013713792:12345-192.168.204.57@tcp:2:touch.0 Request processed in 437us (557us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1784093846.048077:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 294 00000100:00100000:0.0:1784093846.048907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093846.048949:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013714048 00000100:00100000:2.0:1784093846.048957:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013714048 00000100:00100000:2.0:1784093846.049008:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 66 00000100:00100000:0.0:1784093846.049017:0:5781:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1784093846.049018:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:43452:x1870757013714048:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:0.0:1784093846.049030:0:5781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1784093846.049351:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:43452:x1870757013714048:12345-192.168.204.57@tcp:35:touch.0 Request processed in 334us (445us total) trans 4294967532 rc 0/0 00000100:00100000:2.0:1784093846.049361:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 66 00000100:00100000:0.0:1784093846.066579:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093846.066627:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013714176 00000100:00100000:2.0:1784093846.066638:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013714176 00000100:00100000:2.0:1784093846.066716:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:2.0:1784093846.066726:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:43456:x1870757013714176:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093846.066758:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093846.066784:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca582 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57d8 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.066859:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.066872:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.066883:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.066893:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.066898:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.066902:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067014:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067020:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067027:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093846.067066:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00000004:00200000:2.0:1784093846.067072:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093846.067095:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067105:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067112:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067117:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067124:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067131:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.067135:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067143:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067164:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093846.067167:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093846.067172:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067179:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067193:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067199:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067203:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067206:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.067208:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067212:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067217:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff90721a781c00) 00010000:00010000:2.0:1784093846.067218:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093846.067220:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067223:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ca590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067268:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214ca582 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57d8 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067284:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57d8 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.067292:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784093846.067294:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093846.067297:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41000, rc 0) 00000100:00100000:2.0:1784093846.067367:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:43456:x1870757013714176:12345-192.168.204.57@tcp:101:rm.0 Request processed in 642us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093846.067390:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:0.0:1784093846.068737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093846.068835:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013714304 00000100:00100000:3.0:1784093846.068844:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013714304 00000100:00100000:3.0:1784093846.068894:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 295 00000100:00100000:3.0:1784093846.068903:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013714304:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093846.068918:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093846.068935:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57df expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784093846.068961:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x6a571c96, atime: 0x6a571c96, ctime: 0x6a571c96, blocks: 0x1 00010000:00010000:3.0:1784093846.068978:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1007s v=(0 0) 00010000:00010000:3.0:1784093846.068984:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093846.068994:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.069013:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.069026:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093846.069129:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013714304:12345-192.168.204.57@tcp:101:rm.0 Request processed in 226us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093846.069134:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 295 00000100:00100000:0.0:1784093846.070242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093846.070350:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013714560 00000100:00100000:3.0:1784093846.070356:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013714560 00000100:00100000:3.0:1784093846.070411:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 608 00000100:00100000:3.0:1784093846.070440:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:43456:x1870757013714560:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784093846.070488:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093846.070521:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ca597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57d8 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070544:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ca57b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57d1 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070555:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff90721a781800) 00010000:00010000:3.0:1784093846.070564:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093846.070581:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070602:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070611:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070624:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070632:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070638:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070734:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070742:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.070758:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093846.071334:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:3.0:1784093846.071346:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1007148923271ns, next at 1008148920316ns, rc = 0 00010000:00010000:3.0:1784093846.071457:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071466:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071472:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071477:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071482:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071485:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071502:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093846.071520:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071524:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071526:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093846.071528:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071533:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071548:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093846.071548:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093846.071556:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071556:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071576:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071577:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071595:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784093846.071599:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093846.071603:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071606:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784093846.071612:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093846.071613:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ca5ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071615:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071619:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca5b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071640:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071645:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071646:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093846.071650:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093846.071652:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093846.071653:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093846.071658:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093846.071660:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071663:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071676:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781300) 00010000:00010000:3.0:1784093846.071677:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093846.071679:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.071683:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca5a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093846.071689:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000abf75e9b reply state 00000000e67af239 transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093846.071695:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093846.071761:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:43456:x1870757013714560:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1340us (1518us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1784093846.071769:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 608 00010000:00010000:3.0:1784093846.072401:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.072409:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.072413:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.072416:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093846.072419:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.072446:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.072463:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907204fcea00) 00010000:00010000:3.0:1784093846.072465:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093846.072467:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093846.072471:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca5ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093846.673273:0:73959:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff263d4410 20000000:00000080:1.0:1784093846.673291:0:73959:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e147c00 uarg=0000000000000000 00010000:00010000:1.0:1784093846.673540:0:73959:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093846.673567:0:73959:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781300) 00010000:00010000:1.0:1784093846.673569:0:73959:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093846.673578:0:73959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca54a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57c3 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673596:0:73959:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093846.673610:0:73959:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093846.673626:0:73959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673639:0:73959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673647:0:73959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673651:0:73959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673656:0:73959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673666:0:73959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673670:0:73959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093846.673673:0:73959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673678:0:73959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673683:0:73959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673688:0:73959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093846.673692:0:73959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12e00/0x9ce98053214ca5c1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093847.017479:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093847.017486:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093847.017491:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093847.017531:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093847.017542:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093847.017552:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093847.017578:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024250752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093847.017644:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784093847.017678:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093847.017704:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b935540 going to sleep for 11 seconds 00000100:00100000:2.0:1784093847.017704:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250752 00000100:00100000:2.0:1784093847.017714:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250752 00000100:00100000:2.0:1784093847.017764:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1784093847.017774:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024250752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093847.017788:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093847.017802:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca5c8 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.017827:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.017839:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.017848:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093847.017891:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024250752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093847.017899:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1784093847.017927:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024250752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093847.017945:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093847.017956:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093847.017989:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093847.017995:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093847.018002:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093847.778798:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093847.778839:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013714688 00000100:00100000:1.0:1784093847.778849:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013714688 00000100:00100000:1.0:1784093847.778913:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 609 00000100:00100000:1.0:1784093847.778923:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:43543:x1870757013714688:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093847.778949:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093847.778973:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca5d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57e6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.779056:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca5dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.779072:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.779087:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093847.779158:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1784093847.779164:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093847.779191:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.779216:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ca5d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57e6 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.779238:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca5dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57e6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.779247:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784093847.779250:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093847.779255:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093847.779316:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:43543:x1870757013714688:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 394us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093847.779324:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 609 00000100:00100000:3.0:1784093847.780800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093847.780832:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013714944 00000100:00100000:2.0:1784093847.780838:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013714944 00000100:00100000:2.0:1784093847.780865:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 610 00000100:00100000:2.0:1784093847.780870:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:43543:x1870757013714944:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093847.780898:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093847.780912:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ca5dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57e6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.780925:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca54a) 00010000:00010000:2.0:1784093847.780927:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12b00) 00010000:00010000:2.0:1784093847.780933:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093847.780948:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.780956:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.780965:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784093847.793207:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967531 is committed 00000001:00080000:3.0:1784093847.793228:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967534 is committed 00000004:00010000:2.0:1784093847.793232:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000cfd8d4d0 reply state 000000007a0d480c transno 4294967534 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093847.793242:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 49 committed 00000100:00100000:2.0:1784093847.793250:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093847.793407:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024250880:0@lo:6:osp-syn-0-0.0 00000004:00200000:2.0:1784093847.793415:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000100:00100000:1.0:1784093847.793495:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784093847.793519:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093847.793534:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024250880 00000100:00100000:2.0:1784093847.793535:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43543:x1870757013714944:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 12662us (12735us total) trans 4294967534 rc 0/0 00000100:00100000:0.0:1784093847.793542:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024250880 00000100:00100000:2.0:1784093847.793552:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 610 00010000:00010000:2.0:1784093847.793590:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.793598:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.793604:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093847.793605:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1784093847.793619:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024250880:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784093847.793622:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093847.793628:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.793634:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.793647:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781300) 00002000:00080000:0.0:1784093847.793648:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:19 count 1 00010000:00010000:2.0:1784093847.793650:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093847.793655:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.793660:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca5e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.793675:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.793696:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.793702:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784093847.793705:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093847.793710:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.793734:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.793748:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 6 pid: 6574 timeout: 1108 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093847.793761:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024251008:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093847.793809:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1784093847.793822:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093847.795126:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024251008:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093847.795147:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093847.795452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093847.795486:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715072 00000100:00100000:1.0:1784093847.795493:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715072 00010000:00010000:1.0:1784093847.795521:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 7 pid: 6574 timeout: 1108 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093847.795551:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 261 00000100:00100000:1.0:1784093847.795560:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013715072:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093847.795572:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093847.795578:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 7 pid: 6574 timeout: 1108 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.795591:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 7 pid: 6574 timeout: 1108 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.795611:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058f92f69/0x9ce98053214ca59e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57df expref: 7 pid: 6574 timeout: 1108 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.795624:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093847.795628:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093847.795634:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.795642:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093847.795667:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093847.795686:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093847.795702:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013715072:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 142us (251us total) trans 0 rc 0/0 00010000:00010000:0.0:1784093847.795710:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093847.795725:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 261 00010000:00010000:0.0:1784093847.795726:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.795735:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093847.795763:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093847.796038:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093847.796046:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.796055:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093847.796060:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.796070:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.796083:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093847.796104:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ca5eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093847.796117:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024250880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2502us (2621us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784093847.796128:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00010000:00010000:2.0:1784093847.796136:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093847.796139:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093847.796143:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784093847.796146:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230a52d80/2, rc 0, transno 4294967335 00000100:00100000:1.0:1784093847.796153:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024250880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784093847.928461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093847.928495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093847.928524:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715200 00000100:00100000:0.0:1784093847.928532:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715328 00000100:00100000:1.0:1784093847.928534:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715200 00000100:00100000:0.0:1784093847.928538:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715328 00000100:00100000:1.0:1784093847.928596:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 692 00000100:00100000:0.0:1784093847.928596:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 466 00000100:00100000:0.0:1784093847.928609:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013715328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784093847.928611:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093847.928615:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013715200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093847.928679:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013715328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093847.928689:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 466 00000100:00100000:1.0:1784093847.928690:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013715200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093847.928699:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 692 00010000:00010000:1.0:1784093848.041559:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093848.112722:0:74154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdcf76f9d0 20000000:00000080:0.0:1784093848.112736:0:74154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237458c00 uarg=0000000000000000 00010000:00010000:0.0:1784093848.113154:0:74154:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093848.113168:0:74154:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093848.113179:0:74154:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093848.113200:0:74154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093848.113215:0:74154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093848.113224:0:74154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093848.113258:0:74154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093848.113273:0:74154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 18 pid: 5771 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093848.113288:0:74154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74154:1870757024251136:0@lo:104: 00000100:00100000:0.0:1784093848.113356:0:74154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093848.113408:0:74154:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de666c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093848.113510:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251136 00000100:00100000:2.0:1784093848.113526:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251136 00000100:00100000:2.0:1784093848.113603:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1784093848.113616:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:74154:x1870757024251136:12345-0@lo:104: 00010000:00010000:2.0:1784093848.113634:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093848.113738:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093848.113746:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:74154:x1870757024251136:12345-0@lo:104: Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093848.113750:0:74154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74154:1870757024251136:0@lo:104: 00000100:00100000:2.0:1784093848.113765:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:0.0:1784093848.113776:0:74154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093848.113791:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093848.113802:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093848.113812:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093848.113816:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093848.113826:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093848.113833:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093848.113850:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093848.113886:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093848.113893:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093848.113925:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093848.113932:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca5c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca5cf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093848.113948:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093848.113950:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093848.113953:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024251264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093848.113954:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093848.113991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093848.114029:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251264 00000100:00100000:1.0:1784093848.114036:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251264 00010000:00010000:1.0:1784093848.114056:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 19 pid: 5771 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093848.114081:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784093848.114087:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024251264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093848.114097:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093848.114100:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 19 pid: 5771 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114108:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 19 pid: 5771 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114118:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214ca5cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca5c8 expref: 19 pid: 5771 timeout: 1159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114142:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114150:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114163:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114168:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114172:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114176:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114179:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093848.114182:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114188:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114210:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093848.114219:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093848.114259:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024251264:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093848.114273:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784093848.114284:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024251264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093848.114333:0:74154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093848.114352:0:74154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093848.114358:0:74154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214ca5f2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093848.553687:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024251520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093848.553705:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024251392:0@lo:400:kworker.0 00000100:00100000:3.0:1784093848.553754:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024251648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093848.555007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093848.555086:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093848.555101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093848.555101:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024251904:0@lo:400:kworker.0 00000100:00100000:3.0:1784093848.555166:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784093848.555167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093848.555167:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024252032:0@lo:400:kworker.0 00000100:00100000:3.0:1784093848.555191:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024251776:0@lo:400:kworker.0 00000100:00100000:0.0:1784093848.555224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093848.555238:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251392 00000100:00100000:1.0:1784093848.555247:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251392 00000100:00100000:3.0:1784093848.555272:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251648 00000100:00100000:3.0:1784093848.555281:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251648 00000100:00100000:0.0:1784093848.555307:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251520 00000100:00100000:1.0:1784093848.555310:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251904 00000100:00100000:1.0:1784093848.555316:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251904 00000100:00100000:0.0:1784093848.555335:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251520 00000100:00100000:3.0:1784093848.555367:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1784093848.555382:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1784093848.555384:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024251392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093848.555404:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1784093848.555405:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024251648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093848.555418:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024251520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093848.555489:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093848.555515:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024251392:12345-0@lo:400:kworker.0 Request processed in 135us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093848.555529:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:1.0:1784093848.555532:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024251648:12345-0@lo:400:kworker.0 Request processed in 126us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093848.555548:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1784093848.555559:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024251520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093848.555567:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1784093848.555575:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1784093848.555585:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024251904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093848.555625:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252032 00000100:00100000:1.0:1784093848.555632:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252032 00000100:00100000:0.0:1784093848.555662:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024251520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093848.555670:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024251904:12345-0@lo:400:kworker.0 Request processed in 90us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093848.555677:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1784093848.555698:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1784093848.555709:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024252032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093848.555727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784093848.555735:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093848.555743:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093848.555779:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024252032:12345-0@lo:400:kworker.0 Request processed in 71us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093848.555780:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024251648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093848.555796:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1784093848.555818:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024251776 00000100:00100000:1.0:1784093848.555823:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024251776 00000100:00100000:0.0:1784093848.555842:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024252032:0@lo:400:kworker.0 00000100:00100000:1.0:1784093848.555861:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1784093848.555874:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024251776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093848.555904:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024251904:0@lo:400:kworker.0 00000100:00100000:3.0:1784093848.555931:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024251392:0@lo:400:kworker.0 00000100:00100000:1.0:1784093848.555941:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024251776:12345-0@lo:400:kworker.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093848.555964:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1784093848.555977:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024251776:0@lo:400:kworker.0 00010000:00010000:1.0:1784093849.065513:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093849.203723:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093849.203791:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715456 00000100:00100000:1.0:1784093849.203804:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715456 00000100:00100000:1.0:1784093849.203911:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 611 00000100:00080000:3.0:1784093849.203924:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093849.203925:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:43619:x1870757013715456:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093849.203956:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093849.203980:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca5f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204194:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204215:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204237:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204253:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204261:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204268:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204777:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca60e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204796:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca60e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204804:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca60e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093849.204884:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1784093849.204890:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093849.204957:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca60e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204970:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204976:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.204983:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205003:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093849.205007:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205015:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205026:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093849.205030:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.205034:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205049:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205063:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205069:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205076:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205081:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093849.205084:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205090:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205098:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907219c12a00) 00010000:00010000:1.0:1784093849.205101:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.205103:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205109:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca607 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205144:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca5f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ed expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205160:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca60e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ed expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.205173:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093849.205175:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093849.205177:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784093849.205243:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715456:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1321us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093849.205251:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 611 00000100:00100000:3.0:1784093849.207681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093849.207747:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715712 00000100:00100000:1.0:1784093849.207757:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715712 00000100:00100000:1.0:1784093849.207816:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:1.0:1784093849.207830:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715712:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093849.207848:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093849.207874:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca615 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57f4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208096:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208110:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208121:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208139:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208147:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208165:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093849.208382:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00010000:1.0:1784093849.208399:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208408:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208415:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208442:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093849.208447:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208457:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208469:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093849.208473:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.208477:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208485:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca61c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208508:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208525:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208532:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208537:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093849.208540:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208546:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208554:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907219c12900) 00010000:00010000:1.0:1784093849.208557:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.208560:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208566:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca623 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208596:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca615 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57f4 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208607:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093849.208609:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.208614:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca615 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57f4 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.208646:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093849.208698:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715712:12345-192.168.204.57@tcp:101:touch.0 Request processed in 874us (1028us total) trans 0 rc 301/301 00000100:00100000:1.0:1784093849.208706:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:1.0:1784093849.210513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093849.210599:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715840 00000100:00100000:0.0:1784093849.210606:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715840 00000100:00100000:0.0:1784093849.210650:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 613 00000100:00100000:0.0:1784093849.210660:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715840:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784093849.210675:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093849.210688:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca62a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf57fb expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210743:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210755:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210764:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210776:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210839:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210849:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210988:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.210996:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211002:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211007:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093849.211011:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211025:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211034:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784093849.211036:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093849.211040:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211045:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211054:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211059:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211065:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211069:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093849.211072:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211076:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211082:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907202e6b200) 00010000:00010000:0.0:1784093849.211084:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093849.211086:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211098:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211122:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca62a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57fb expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211129:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784093849.211132:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093849.211135:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca62a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57fb expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.211143:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784093849.211203:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715840:12345-192.168.204.57@tcp:101:touch.0 Request processed in 544us (691us total) trans 0 rc 301/301 00000100:00100000:0.0:1784093849.211209:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 613 00000100:00100000:0.0:1784093849.212912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093849.212960:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013715968 00000100:00100000:1.0:1784093849.212967:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013715968 00000100:00100000:1.0:1784093849.213012:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 614 00000100:00100000:1.0:1784093849.213020:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715968:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093849.213031:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093849.213041:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca63f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5802 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213077:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213085:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213091:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213099:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213103:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213119:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213230:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213237:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213243:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213249:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093849.213253:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213260:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213271:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093849.213273:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.213276:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213282:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213295:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213302:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213326:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213332:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093849.213339:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213346:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213354:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907219c12500) 00010000:00010000:1.0:1784093849.213357:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.213360:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213366:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca64d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213394:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca63f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5802 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213403:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093849.213406:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093849.213409:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca63f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5802 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.213418:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784093849.213538:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43619:x1870757013715968:12345-192.168.204.57@tcp:101:touch.0 Request processed in 518us (629us total) trans 0 rc 301/301 00000100:00100000:1.0:1784093849.213555:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 614 10000000:01000000:0.0:1784093849.321512:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093849.321520:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093849.321525:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093849.321619:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.321632:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.321643:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093849.321670:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024252160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093849.321928:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093849.322003:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252160 00000100:00100000:0.0:1784093849.322006:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093849.322012:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252160 00000100:00100000:2.0:1784093849.322075:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1784093849.322086:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024252160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093849.322109:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093849.322134:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca654 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093849.322156:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca654 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093849.322167:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca654 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093849.322175:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784093849.322224:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024252160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093849.322232:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1784093849.322267:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024252160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093849.322282:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.322292:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093849.322310:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093849.322326:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.322333:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093849.881927:0:74397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda8107460 20000000:00000080:0.0:1784093849.881943:0:74397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237459c00 uarg=0000000000000000 00010000:00010000:0.0:1784093849.882140:0:74397:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093849.882197:0:74397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784093849.882201:0:74397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093849.882212:0:74397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca60e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf57ed expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.882232:0:74397:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093849.882245:0:74397:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093849.882257:0:74397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.882279:0:74397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca654 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.882288:0:74397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.882334:0:74397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca654 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.882347:0:74397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca654 expref: 18 pid: 5771 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093849.882362:0:74397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74397:1870757024252288:0@lo:104: 00000100:00100000:0.0:1784093849.882415:0:74397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093849.882478:0:74397:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720683d540 going to sleep for 11 seconds 00000100:00100000:2.0:1784093849.882542:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252288 00000100:00100000:2.0:1784093849.882550:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252288 00000100:00100000:2.0:1784093849.882598:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1784093849.882607:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:74397:x1870757024252288:12345-0@lo:104: 00010000:00010000:2.0:1784093849.882620:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093849.882677:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093849.882684:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:74397:x1870757024252288:12345-0@lo:104: Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093849.882692:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784093849.882694:0:74397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74397:1870757024252288:0@lo:104: 00010000:00010000:3.0:1784093849.882697:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093849.882706:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.882715:0:74397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093849.882716:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093849.882723:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093849.882734:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093849.882746:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093849.882752:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093849.882781:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093849.882788:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093849.882829:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093849.882834:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214ca654 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca65b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093849.882845:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093849.882846:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093849.882847:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093849.882885:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024252416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093849.882916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093849.882948:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252416 00000100:00100000:0.0:1784093849.882953:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252416 00010000:00010000:0.0:1784093849.882972:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca654 expref: 19 pid: 5771 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093849.882996:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784093849.883003:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024252416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093849.883013:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093849.883017:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca654 expref: 19 pid: 5771 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883032:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca654 expref: 19 pid: 5771 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883042:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214ca65b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca654 expref: 19 pid: 5771 timeout: 1160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883055:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883062:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883073:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883079:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883086:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883093:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883098:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093849.883102:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883109:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883133:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093849.883143:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093849.883165:0:74397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093849.883176:0:74397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093849.883177:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024252416:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (259us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093849.883192:0:74397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214ca662 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093849.883192:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784093849.883214:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024252416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093850.089696:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093850.100214:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000001:00080000:0.0:1784093850.100229:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00000100:00100000:2.0:1784093850.601541:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093850.601560:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024252544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093850.601651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093850.601746:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252544 00000100:00100000:2.0:1784093850.601755:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252544 00000100:00100000:2.0:1784093850.601815:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1784093850.601826:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024252544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093850.601862:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093850.601911:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024252544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093850.601919:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:2.0:1784093850.601939:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093850.601968:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:2.0:1784093850.601974:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230a52d80, transno 4294967335 00000100:00100000:2.0:1784093850.601992:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024252544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093850.920620:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093850.920646:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716096 00000100:00100000:3.0:1784093850.920654:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716096 00000100:00100000:3.0:1784093850.920710:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 615 00000100:00100000:3.0:1784093850.920720:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43705:x1870757013716096:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093850.920741:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093850.920793:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5809 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.920857:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.920871:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.920886:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093850.921110:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:3.0:1784093850.921115:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093850.921190:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.921221:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5809 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.921241:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5809 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.921250:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093850.921253:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093850.921257:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784093850.921376:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43705:x1870757013716096:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 655us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093850.921384:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 615 00000100:00100000:3.0:1784093850.922846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093850.922885:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716352 00000100:00100000:0.0:1784093850.922893:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716352 00000100:00100000:0.0:1784093850.922937:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 616 00000100:00100000:0.0:1784093850.922958:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43705:x1870757013716352:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093850.922995:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093850.923015:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ca670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5809 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093850.923028:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca60e) 00010000:00010000:0.0:1784093850.923032:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fcec00) 00010000:00010000:0.0:1784093850.923039:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093850.923057:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093850.923069:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093850.923077:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093850.923460:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000209c14af reply state 00000000327543bc transno 4294967535 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093850.923470:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093850.923577:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000100:00100000:0.0:1784093850.923642:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:43705:x1870757013716352:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 686us (798us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1784093850.923652:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 616 00010000:00010000:3.0:1784093850.924556:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.924568:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.924575:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.924582:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093850.924586:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.924593:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.924620:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6b900) 00010000:00010000:3.0:1784093850.924623:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093850.924627:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093850.924633:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca677 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093851.113518:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093851.229829:0:74595:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec929b770 20000000:00000080:2.0:1784093851.229846:0:74595:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb3f400 uarg=0000000000000000 00010000:00010000:2.0:1784093851.230057:0:74595:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093851.230072:0:74595:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093851.230085:0:74595:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093851.230104:0:74595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230118:0:74595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230128:0:74595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230135:0:74595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230150:0:74595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230158:0:74595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230165:0:74595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093851.230169:0:74595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230177:0:74595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230190:0:74595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230198:0:74595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093851.230205:0:74595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40400/0x9ce98053214ca67e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093851.561487:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093851.561496:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093851.561500:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093851.561542:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093851.561554:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093851.561565:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093851.561593:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024252672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093851.561665:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093851.561702:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252672 00000100:00100000:1.0:1784093851.561710:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252672 00000100:00100000:0.0:1784093851.561720:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1784093851.561761:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784093851.561771:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024252672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093851.561784:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093851.561798:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca685 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093851.561822:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca685 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093851.561834:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca685 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093851.561843:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13600, rc 0) 00000100:00100000:1.0:1784093851.561888:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024252672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093851.561901:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1784093851.561930:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024252672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093851.561948:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093851.561958:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093851.561983:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093851.561988:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093851.561995:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.138526:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093852.287115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093852.287180:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716480 00000100:00100000:1.0:1784093852.287190:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716480 00000100:00080000:2.0:1784093852.287250:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093852.287278:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:1.0:1784093852.287289:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013716480:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093852.287383:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013716480:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093852.287390:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:2.0:1784093852.287992:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.288027:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716608 00000100:00100000:0.0:1784093852.288033:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716608 00000100:00080000:2.0:1784093852.288065:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093852.288075:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 297 00000100:00100000:0.0:1784093852.288083:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013716608:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093852.288341:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013716608:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 259us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093852.288346:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 297 00000100:00100000:3.0:1784093852.289410:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.289471:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716736 00000100:00100000:0.0:1784093852.289476:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716736 00000100:00080000:2.0:1784093852.289511:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093852.289514:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 298 00000100:00100000:0.0:1784093852.289523:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013716736:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093852.289670:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013716736:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 148us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093852.289677:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 298 00000100:00100000:3.0:1784093852.290281:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093852.290325:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716864 00000100:00100000:1.0:1784093852.290330:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716864 00000100:00100000:1.0:1784093852.290365:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 618 00000100:00100000:1.0:1784093852.290373:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013716864:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093852.290687:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013716864:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 315us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093852.290695:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 618 00000100:00100000:2.0:1784093852.291789:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.291834:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013716992 00000100:00100000:0.0:1784093852.291840:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013716992 00000100:00100000:0.0:1784093852.291870:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 619 00000100:00100000:0.0:1784093852.291876:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013716992:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093852.291939:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013716992:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093852.291946:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 619 00000100:00100000:3.0:1784093852.292522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093852.292561:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013717120 00000100:00100000:1.0:1784093852.292566:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013717120 00000100:00100000:1.0:1784093852.292591:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 299 00000100:00100000:1.0:1784093852.292595:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013717120:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093852.292809:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013717120:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 211us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093852.292816:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 299 00000100:00100000:3.0:1784093852.293351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.293397:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013717248 00000100:00100000:0.0:1784093852.293402:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013717248 00000100:00100000:0.0:1784093852.293444:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:0.0:1784093852.293452:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013717248:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093852.293661:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43789:x1870757013717248:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 209us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093852.293669:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:2.0:1784093852.294213:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093852.294270:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013717376 00000100:00100000:1.0:1784093852.294275:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013717376 00000100:00100000:1.0:1784093852.294311:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:1.0:1784093852.294317:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013717376:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093852.294593:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:43789:x1870757013717376:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 275us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093852.294602:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:3.0:1784093852.315238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093852.315295:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013717504 00000100:00100000:1.0:1784093852.315305:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013717504 00000100:00100000:1.0:1784093852.315358:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 621 00000100:00100000:1.0:1784093852.315368:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:43793:x1870757013717504:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093852.315387:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093852.315408:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5810 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315491:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315504:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315516:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315527:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315534:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315541:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315898:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca6a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315907:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.315915:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093852.315987:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1784093852.315991:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093852.316055:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316066:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316073:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316079:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316085:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093852.316089:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316096:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316107:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093852.316113:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093852.316118:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316124:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca69a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316135:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316141:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316147:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316152:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093852.316155:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316160:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316166:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907219c12a00) 00010000:00010000:1.0:1784093852.316169:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093852.316171:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316176:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca6a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316199:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5810 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316222:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5810 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093852.316230:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093852.316237:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093852.316239:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784093852.316304:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43793:x1870757013717504:12345-192.168.204.57@tcp:101:dd.0 Request processed in 937us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093852.316311:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 621 00000100:00100000:3.0:1784093852.317392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.317446:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013717760 00000100:00100000:0.0:1784093852.317453:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013717760 00000100:00100000:0.0:1784093852.317494:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 622 00000100:00100000:0.0:1784093852.317505:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:43793:x1870757013717760:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:0.0:1784093852.317518:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093852.317529:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca6af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5817 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.317735:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.317747:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.317756:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.317767:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.317777:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.317781:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784093852.318570:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:0.0:1784093852.318828:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca6c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318838:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318845:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318876:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318883:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318889:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318895:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093852.318900:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318906:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318928:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12c00) 00010000:00010000:0.0:1784093852.318931:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093852.318935:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.318941:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca6b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093852.318954:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000403412b8 reply state 00000000cd610ab8 transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093852.318964:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093852.318993:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ca6af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5817 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319006:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5817 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319013:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784093852.319015:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093852.319018:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784093852.319074:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:43793:x1870757013717760:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1571us (1683us total) trans 4294967536 rc 0/0 00000100:00100000:0.0:1784093852.319082:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 622 00010000:00010000:0.0:1784093852.319780:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319789:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319803:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319810:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093852.319813:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319819:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319829:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907202e6bd00) 00010000:00010000:0.0:1784093852.319832:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093852.319835:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.319840:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214ca6bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093852.322316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.322366:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013717888 00000100:00100000:0.0:1784093852.322376:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013717888 00000100:00100000:0.0:1784093852.322515:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 301 00000100:00100000:0.0:1784093852.322526:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:43793:x1870757013717888:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:0.0:1784093852.322545:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093852.322564:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf581e expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784093852.322598:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784093852.322621:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1013s v=(0 0) 00010000:00010000:0.0:1784093852.322636:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093852.322645:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 6 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.322663:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 6 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093852.322675:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784093852.322717:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:43793:x1870757013717888:12345-192.168.204.57@tcp:101:dd.0 Request processed in 194us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093852.322724:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 301 00000100:00100000:2.0:1784093852.331567:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093852.331628:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718016 00000100:00100000:3.0:1784093852.331639:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718016 00002000:00100000:3.0:1784093852.331692:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff907230ce5500 x1870757013718016/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:173/0 lens 488/0 e 0 to 0 dl 1784093863 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784093852.331703:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230ce5500 with x1870757013718016 ext(0->1048575) 00002000:00010000:3.0:1784093852.331709:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230ce5500 00000100:00100000:3.0:1784093852.331748:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 14 00000100:00100000:3.0:1784093852.331757:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013718016:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:0.0:1784093852.340055:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013718016:12345-192.168.204.57@tcp:4:dd.0 Request processed in 8288us (8484us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1784093852.340068:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 14 00002000:00100000:0.0:1784093852.340079:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff907230ce5500 x1870757013718016/t4294967334(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:173/0 lens 488/448 e 0 to 0 dl 1784093863 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784093852.340090:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230ce5500 with x1870757013718016 ext(0->1048575) 00002000:00010000:0.0:1784093852.340097:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230ce5500 00000100:00100000:2.0:1784093852.341207:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093852.341271:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718144 00000100:00100000:1.0:1784093852.341278:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718144 00000100:00100000:1.0:1784093852.341321:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 623 00000100:00100000:1.0:1784093852.341331:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:43793:x1870757013718144:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:3.0:1784093852.354076:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 00000100:00100000:2.0:1784093852.354183:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:43793:x1870757013718144:12345-192.168.204.57@tcp:44:dd.0 Request processed in 12847us (12970us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093852.354195:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 623 00000100:00100000:1.0:1784093852.355314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093852.355360:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718272 00000100:00100000:3.0:1784093852.355376:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718272 00000100:00100000:3.0:1784093852.355440:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 302 00000100:00100000:3.0:1784093852.355452:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013718272:12345-192.168.204.57@tcp:16:dd.0 00000001:00080000:0.0:1784093852.364770:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000100:00100000:3.0:1784093852.364859:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013718272:12345-192.168.204.57@tcp:16:dd.0 Request processed in 9404us (9540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093852.364871:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 302 00000100:00100000:3.0:1784093852.366182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093852.366228:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718528 00000100:00100000:0.0:1784093852.366237:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718528 00000100:00100000:0.0:1784093852.366297:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 67 00000100:00100000:0.0:1784093852.366307:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43793:x1870757013718528:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:0.0:1784093852.366711:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:43793:x1870757013718528:12345-192.168.204.57@tcp:35:dd.0 Request processed in 404us (530us total) trans 4294967537 rc 0/0 00000100:00100000:0.0:1784093852.366719:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 67 00000001:00080000:0.0:1784093852.777815:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967537 is committed 00000100:00100000:0.0:1784093853.048221:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093853.048272:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718656 00000100:00100000:1.0:1784093853.048281:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718656 00000100:00100000:1.0:1784093853.048331:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:1.0:1784093853.048342:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013718656:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093853.048398:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013718656:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093853.048405:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 695 00010000:00010000:2.0:1784093853.162523:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784093853.199378:0:74840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1014276953374ns, next at 1008148920316ns, rc = 0 00000004:00080000:2.0:1784093853.199541:0:74840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1014277118539ns, next at 981450290374ns, rc = 0 00000004:00080000:0.0:1784093853.200415:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 48 committed 00000004:00080000:0.0:1784093853.200466:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 50 committed 00000100:00100000:1.0:1784093853.666326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093853.666384:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718784 00000100:00100000:3.0:1784093853.666393:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718784 00000100:00100000:3.0:1784093853.666463:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:3.0:1784093853.666478:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013718784:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093853.666570:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013718784:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093853.666579:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:3.0:1784093853.667291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093853.667336:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013718912 00000100:00100000:0.0:1784093853.667342:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013718912 00000100:00100000:0.0:1784093853.667382:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 303 00000100:00100000:0.0:1784093853.667392:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43986:x1870757013718912:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093853.667854:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:43986:x1870757013718912:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 463us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093853.667861:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 303 00000100:00100000:0.0:1784093853.668509:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093853.668568:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719040 00000100:00100000:2.0:1784093853.668572:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719040 00000100:00100000:2.0:1784093853.668612:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 304 00000100:00100000:2.0:1784093853.668622:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:43986:x1870757013719040:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093853.668976:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:43986:x1870757013719040:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 356us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093853.668981:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 304 00000100:00100000:3.0:1784093853.669679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093853.669722:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719168 00000100:00100000:0.0:1784093853.669728:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719168 00000100:00100000:0.0:1784093853.669765:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 625 00000100:00100000:0.0:1784093853.669773:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013719168:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093853.670034:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013719168:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 262us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093853.670039:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 625 00000100:00100000:1.0:1784093853.671516:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093853.671541:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719296 00000100:00100000:2.0:1784093853.671547:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719296 00000100:00100000:2.0:1784093853.671582:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 626 00000100:00100000:2.0:1784093853.671589:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013719296:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093853.671640:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013719296:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093853.671644:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 626 00000100:00100000:2.0:1784093853.672275:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093853.672309:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719424 00000100:00100000:3.0:1784093853.672315:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719424 00000100:00100000:3.0:1784093853.672356:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 305 00000100:00100000:3.0:1784093853.672365:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43986:x1870757013719424:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093853.672742:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:43986:x1870757013719424:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 378us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093853.672750:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 305 00000100:00100000:0.0:1784093853.673588:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024252800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093853.673632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093853.673642:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093853.673659:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252800 00000100:00100000:3.0:1784093853.673666:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252800 00000100:00100000:2.0:1784093853.673677:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719552 00000100:00100000:2.0:1784093853.673683:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719552 00000100:00080000:0.0:1784093853.673700:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093853.673718:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1784093853.673737:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024252800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093853.673739:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 306 00000100:00100000:2.0:1784093853.673754:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43986:x1870757013719552:12345-192.168.204.57@tcp:19:lfs.0 00002000:00000024:3.0:1784093853.673758:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784093853.673807:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024252800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093853.673816:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1784093853.673834:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024252800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093853.674165:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:43986:x1870757013719552:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 413us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093853.674174:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 306 00000100:00100000:3.0:1784093853.674522:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024252928:0@lo:400:kworker.0 00000100:00100000:3.0:1784093853.674565:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093853.674577:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024253056:0@lo:400:kworker.0 00000100:00100000:3.0:1784093853.674604:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024253440:0@lo:400:kworker.0 00000100:00100000:2.0:1784093853.674618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093853.674642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093853.674647:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093853.674656:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024253184:0@lo:400:kworker.0 00000100:00100000:3.0:1784093853.674670:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784093853.674678:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024253312:0@lo:400:kworker.0 00000100:00100000:2.0:1784093853.674688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093853.674715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093853.674736:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253056 00000100:00100000:2.0:1784093853.674742:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253056 00000100:00100000:2.0:1784093853.674771:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253440 00000100:00100000:2.0:1784093853.674775:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253440 00000100:00100000:2.0:1784093853.674799:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253184 00000100:00100000:2.0:1784093853.674802:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253184 00000100:00100000:3.0:1784093853.674827:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024252928 00000100:00100000:2.0:1784093853.674828:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1784093853.674833:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024252928 00000100:00100000:2.0:1784093853.674838:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024253056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093853.674870:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1784093853.674881:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024252928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093853.674888:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024253056:12345-0@lo:400:kworker.0 Request processed in 49us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093853.674896:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1784093853.674915:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1784093853.674925:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024253440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093853.674933:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024252928:12345-0@lo:400:kworker.0 Request processed in 55us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093853.674942:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1784093853.674971:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024253440:12345-0@lo:400:kworker.0 Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093853.674979:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1784093853.674993:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093853.674995:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1784093853.675001:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719680 00000100:00100000:2.0:1784093853.675006:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719680 00000100:00100000:3.0:1784093853.675009:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024253184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093853.675040:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 627 00000100:00100000:2.0:1784093853.675049:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013719680:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093853.675054:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024253184:12345-0@lo:400:kworker.0 Request processed in 47us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093853.675063:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1784093853.675099:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024253440:0@lo:400:kworker.0 00000100:00100000:3.0:1784093853.675120:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024252928:0@lo:400:kworker.0 00000100:00100000:1.0:1784093853.675331:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253312 00000100:00100000:1.0:1784093853.675337:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253312 00000100:00100000:1.0:1784093853.675385:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1784093853.675397:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024253312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093853.675480:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024253312:12345-0@lo:400:kworker.0 Request processed in 88us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093853.675486:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:43986:x1870757013719680:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 437us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093853.675490:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1784093853.675499:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 627 00000100:00100000:1.0:1784093853.675520:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024253312:0@lo:400:kworker.0 00000100:00080000:2.0:1784093853.675526:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093853.675533:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093853.675558:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024253184:0@lo:400:kworker.0 00000100:00100000:1.0:1784093853.675564:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024253056:0@lo:400:kworker.0 00000100:00100000:0.0:1784093853.695604:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093853.695642:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013719936 00000100:00100000:3.0:1784093853.695651:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013719936 00000100:00100000:3.0:1784093853.695696:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 628 00000100:00100000:3.0:1784093853.695705:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:43990:x1870757013719936:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784093853.695750:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093853.695770:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ca6c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5817 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.695783:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff907202e6b100) 00010000:00010000:3.0:1784093853.695791:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093853.695808:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.695819:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.695836:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.695853:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.695861:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.695868:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.696498:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.696510:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.696518:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093853.698085:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 64 off9408 00000004:00080000:3.0:1784093853.698094:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1014775671513ns, next at 1015775668712ns, rc = 0 00010000:00010000:3.0:1784093853.698200:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698207:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698213:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698218:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698222:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698226:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698253:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093853.698272:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698276:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698285:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093853.698286:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698295:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093853.698295:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698300:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698311:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093853.698312:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698319:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698322:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093853.698327:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093853.698331:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698333:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698338:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca6e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698348:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784093853.698351:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784093853.698353:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698354:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698367:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698368:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ca6ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698382:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698387:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093853.698389:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698392:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093853.698395:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093853.698400:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093853.698403:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093853.698411:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784093853.698414:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093853.698416:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093853.698435:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca6d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093853.698444:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c689ce2d reply state 00000000743e936c transno 4294967538 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093853.698451:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093853.698516:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:43990:x1870757013719936:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2812us (2919us total) trans 4294967538 rc 0/0 00000100:00100000:3.0:1784093853.698521:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 628 00010000:00010000:2.0:1784093853.699175:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093853.699187:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093853.699194:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093853.699200:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093853.699204:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093853.699211:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093853.699221:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907204fce800) 00010000:00010000:2.0:1784093853.699225:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093853.699228:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093853.699246:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca6e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093854.185591:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784093854.433635:0:74984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1015511210829ns, next at 1008148920316ns, rc = 0 00000004:00080000:3.0:1784093854.433874:0:74984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1015511451136ns, next at 1015775668712ns, rc = 0 00000004:00080000:0.0:1784093854.442456:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000001:00080000:0.0:1784093854.442494:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967538 is committed 00000004:00080000:0.0:1784093854.442500:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000100:00100000:1.0:1784093854.442633:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093854.442654:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024253568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784093854.442742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093854.442778:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253568 00000100:00100000:2.0:1784093854.442786:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253568 00000100:00100000:2.0:1784093854.442840:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784093854.442850:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024253568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784093854.442878:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00010000:00010000:2.0:1784093854.442901:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093854.442933:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093854.442940:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093854.442944:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093854.442948:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093854.442973:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093854.442987:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 5 pid: 6573 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093854.443000:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024253696:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093854.443055:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff907226004b40 going to sleep for 11 seconds 00000004:00080000:1.0:1784093854.443673:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000100:00100000:2.0:1784093854.444349:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024253696:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093854.444375:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093854.444475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093854.444505:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720064 00000100:00100000:1.0:1784093854.444510:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720064 00010000:00010000:1.0:1784093854.444543:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 6 pid: 6573 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784093854.444554:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093854.444574:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 264 00000100:00100000:1.0:1784093854.444584:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013720064:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093854.444601:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093854.444607:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 6 pid: 6573 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444619:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 6 pid: 6573 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444638:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025baed93/0x9ce98053214ca6d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf581e expref: 6 pid: 6573 timeout: 1115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444650:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093854.444653:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093854.444658:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444678:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444699:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093854.444725:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093854.444733:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013720064:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 149us (257us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093854.444744:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093854.444750:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 264 00010000:00010000:2.0:1784093854.444762:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093854.444770:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093854.444787:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093854.444800:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093854.444807:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444816:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093854.444821:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444831:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444843:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444851:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214ca6f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093854.444868:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093854.444878:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093854.444880:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093854.445114:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024253568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2266us (2373us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1784093854.445120:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000004:00080000:1.0:1784093854.445151:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9071026bed80/2, rc 0, transno 4294967335 00000100:00100000:1.0:1784093854.445166:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024253568:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784093855.209579:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093855.721713:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024253824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093855.721811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093855.721874:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253824 00000100:00100000:2.0:1784093855.721885:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253824 00000100:00080000:0.0:1784093855.721959:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093855.721973:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784093855.721998:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024253824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093855.722043:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093855.722107:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024253824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093855.722131:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1784093855.722164:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024253824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093856.233612:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093857.258648:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093858.169071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093858.169101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093858.169136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093858.169168:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720192 00000100:00100000:0.0:1784093858.169178:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720448 00000100:00100000:2.0:1784093858.169180:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720192 00000100:00100000:0.0:1784093858.169185:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720448 00000100:00100000:1.0:1784093858.169191:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093858.169236:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720576 00000100:00100000:2.0:1784093858.169238:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 697 00000100:00100000:0.0:1784093858.169240:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720576 00000100:00100000:2.0:1784093858.169255:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013720192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093858.169280:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720320 00000100:00100000:3.0:1784093858.169286:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720320 00000100:00100000:2.0:1784093858.169328:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013720192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.169336:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 697 00000100:00100000:2.0:1784093858.169397:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 672 00000100:00100000:2.0:1784093858.169405:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013720320:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093858.169471:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013720320:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 66us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.169478:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 672 00000100:00080000:2.0:1784093858.169508:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093858.169513:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093858.169516:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093858.169733:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 470 00000100:00100000:1.0:1784093858.169742:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013720448:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093858.169781:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013720448:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093858.169788:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 470 00000100:00100000:1.0:1784093858.169805:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:1.0:1784093858.169812:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013720576:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093858.169836:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013720576:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093858.170105:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 471 00010000:00010000:1.0:1784093858.281614:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093858.793581:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093858.793647:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024254336:0@lo:400:kworker.0 00000100:00100000:0.0:1784093858.793648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093858.793689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093858.793714:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024254080:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.793735:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093858.793744:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024254464:0@lo:400:kworker.0 00000100:00100000:0.0:1784093858.793753:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093858.793777:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093858.793796:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024254592:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.793822:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254336 00000100:00100000:0.0:1784093858.793829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093858.793831:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254336 00000100:00100000:0.0:1784093858.793862:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784093858.793869:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024254208:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.793885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254592 00000100:00100000:1.0:1784093858.793886:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024253952 00000100:00100000:2.0:1784093858.793890:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254592 00000100:00100000:0.0:1784093858.793895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093858.793898:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024253952 00000100:00100000:0.0:1784093858.793919:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024254720:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.793920:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254208 00000100:00100000:2.0:1784093858.793931:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254208 00000100:00100000:1.0:1784093858.793941:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1784093858.793946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093858.793955:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024253952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093858.793965:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1784093858.793972:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024254336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093858.793976:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254080 00000100:00100000:0.0:1784093858.793980:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254080 00002000:00000024:1.0:1784093858.793989:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784093858.794014:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1784093858.794025:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024254336:12345-0@lo:400:kworker.0 Request processed in 53us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093858.794033:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024254080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093858.794034:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024253952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.794036:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1784093858.794046:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1784093858.794058:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1784093858.794067:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024254592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093858.794086:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024254080:12345-0@lo:400:kworker.0 Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093858.794087:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784093858.794099:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1784093858.794102:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024254208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.794105:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024254592:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.794112:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1784093858.794155:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024254208:12345-0@lo:400:kworker.0 Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.794157:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254464 00000100:00100000:2.0:1784093858.794161:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254464 00000100:00100000:1.0:1784093858.794162:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784093858.794181:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024254208:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.794192:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254720 00000100:00100000:2.0:1784093858.794197:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254720 00000100:00080000:1.0:1784093858.794202:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093858.794207:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093858.794211:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093858.794216:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024254592:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.794224:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1784093858.794234:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024254464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093858.794241:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093858.794257:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024254080:0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.794277:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024254464:12345-0@lo:400:kworker.0 Request processed in 45us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.794285:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1784093858.794302:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1784093858.794309:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024254720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093858.794362:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024254720:12345-0@lo:400:kworker.0 Request processed in 52us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093858.794370:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1784093858.794407:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024254720:0@lo:400:kworker.0 00000100:00100000:1.0:1784093858.794480:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024254464:0@lo:400:kworker.0 00000100:00100000:1.0:1784093858.794496:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024254336:0@lo:400:kworker.0 00000001:00080000:0.0:1784093858.805780:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00010000:00010000:2.0:1784093859.305592:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093860.329569:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093860.841628:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784093860.841650:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024254848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093860.841715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093860.841849:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254848 00000100:00100000:2.0:1784093860.841857:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254848 00000100:00080000:1.0:1784093860.841911:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093860.841960:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1784093860.841971:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024254848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093860.842007:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093860.842065:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024254848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093860.842072:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1784093860.842126:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024254848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093861.353634:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093862.377900:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093863.288638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093863.288678:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093863.288703:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720704 00000100:00100000:2.0:1784093863.288713:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720704 00000100:00100000:2.0:1784093863.288779:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:3.0:1784093863.288782:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720832 00000100:00100000:3.0:1784093863.288790:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720832 00000100:00100000:2.0:1784093863.288791:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013720704:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093863.288791:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093863.288834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093863.288863:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013720704:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093863.288869:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 676 00000100:00100000:2.0:1784093863.288879:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:3.0:1784093863.288885:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013720832:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093863.288891:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013720960 00000100:00100000:0.0:1784093863.288903:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013720960 00000100:00100000:3.0:1784093863.288931:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013720832:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093863.288941:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 676 00000100:00100000:2.0:1784093863.288980:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721088 00000100:00100000:2.0:1784093863.288985:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721088 00000100:00100000:0.0:1784093863.288990:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 474 00000100:00080000:1.0:1784093863.288993:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093863.289000:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093863.289005:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093863.289008:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013720960:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093863.289027:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 475 00000100:00100000:2.0:1784093863.289041:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013721088:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093863.289116:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013720960:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093863.289117:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013721088:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093863.289152:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 474 00000100:00100000:2.0:1784093863.289162:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 475 00010000:00010000:2.0:1784093863.401601:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093863.913694:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024254976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093863.913702:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024255104:0@lo:400:kworker.0 00000100:00100000:1.0:1784093863.913810:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024255232:0@lo:400:kworker.0 00000100:00100000:2.0:1784093863.914030:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093863.914060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093863.914129:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024255616:0@lo:400:kworker.0 00000100:00100000:0.0:1784093863.914130:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024255488:0@lo:400:kworker.0 00000100:00100000:3.0:1784093863.914134:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255104 00000100:00100000:3.0:1784093863.914144:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255104 00000100:00100000:2.0:1784093863.914187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093863.914188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093863.914221:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093863.914229:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024255360:0@lo:400:kworker.0 00000100:00100000:0.0:1784093863.914260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093863.914297:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1784093863.914303:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255616 00000100:00100000:0.0:1784093863.914306:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255616 00000100:00100000:3.0:1784093863.914309:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024255104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093863.914313:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255488 00000100:00100000:2.0:1784093863.914318:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255488 00000100:00100000:0.0:1784093863.914347:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255360 00000100:00100000:0.0:1784093863.914351:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255360 00000100:00100000:2.0:1784093863.914355:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1784093863.914364:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024255488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093863.914377:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1784093863.914378:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024255104:12345-0@lo:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093863.914389:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1784093863.914396:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024255616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093863.914410:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024255488:12345-0@lo:400:kworker.0 Request processed in 47us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093863.914439:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1784093863.914446:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1784093863.914454:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024255360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093863.914489:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024255616:12345-0@lo:400:kworker.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093863.914496:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024255616:0@lo:400:kworker.0 00000100:00100000:0.0:1784093863.914501:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1784093863.914503:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024255360:12345-0@lo:400:kworker.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093863.914512:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00080000:0.0:1784093863.914536:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093863.914541:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093863.914575:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024255360:0@lo:400:kworker.0 00000100:00100000:2.0:1784093863.914592:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024255488:0@lo:400:kworker.0 00000100:00100000:1.0:1784093863.914605:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093863.914606:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024255104:0@lo:400:kworker.0 00000100:00100000:3.0:1784093863.914632:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024254976 00000100:00100000:1.0:1784093863.914637:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024255744:0@lo:400:kworker.0 00000100:00100000:3.0:1784093863.914638:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024254976 00000100:00100000:2.0:1784093863.914663:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255232 00000100:00100000:2.0:1784093863.914667:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255232 00000100:00100000:1.0:1784093863.914668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093863.914702:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1784093863.914708:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255744 00000100:00100000:2.0:1784093863.914710:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024255232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093863.914711:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255744 00000100:00080000:0.0:1784093863.914717:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093863.914722:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784093863.914732:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024254976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093863.914745:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1784093863.914750:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024255232:12345-0@lo:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093863.914753:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024255744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093863.914757:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00002000:00000024:3.0:1784093863.914761:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093863.914792:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024255744:12345-0@lo:400:kworker.0 Request processed in 40us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093863.914799:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1784093863.914819:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024254976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093863.914824:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000100:00100000:1.0:1784093863.914826:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024255232:0@lo:400:kworker.0 00000100:00100000:3.0:1784093863.914830:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000004:00080000:2.0:1784093863.914832:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9071026bed80, transno 4294967335 00000100:00100000:2.0:1784093863.914851:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024254976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093863.914851:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024255744:0@lo:400:kworker.0 00010000:00010000:3.0:1784093864.426380:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093865.449630:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093865.961770:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024255872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093865.961875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093865.962043:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024255872 00000100:00100000:1.0:1784093865.962053:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024255872 00000100:00100000:1.0:1784093865.962134:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784093865.962152:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024255872:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784093865.962171:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784093865.962205:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093865.962274:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024255872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093865.962282:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1784093865.962319:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024255872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093866.473668:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093867.497706:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093868.408513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093868.408550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093868.408587:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093868.408613:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721344 00000100:00100000:2.0:1784093868.408614:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721216 00000100:00100000:0.0:1784093868.408625:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721344 00000100:00100000:2.0:1784093868.408628:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721216 00000100:00100000:1.0:1784093868.408632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093868.408657:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721472 00000100:00100000:1.0:1784093868.408659:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721600 00000100:00100000:3.0:1784093868.408663:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721472 00000100:00100000:1.0:1784093868.408664:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721600 00000100:00100000:1.0:1784093868.408703:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 478 00000100:00100000:0.0:1784093868.408703:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 680 00000100:00100000:3.0:1784093868.408721:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 479 00000100:00100000:1.0:1784093868.408723:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013721600:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093868.408724:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013721344:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093868.408733:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013721472:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093868.408794:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013721600:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093868.408803:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013721344:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093868.408804:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013721472:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093868.408809:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 478 00000100:00100000:3.0:1784093868.408826:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 479 00000100:00100000:0.0:1784093868.408826:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 680 00000100:00080000:0.0:1784093868.408859:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093868.408863:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093868.408865:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093868.408921:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 701 00000100:00100000:2.0:1784093868.408937:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013721216:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093868.409028:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013721216:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 97us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093868.409037:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 701 00010000:00010000:3.0:1784093868.521652:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093869.033651:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024256000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093869.033651:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024256256:0@lo:400:kworker.0 00000100:00100000:2.0:1784093869.033657:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024256128:0@lo:400:kworker.0 00000100:00100000:0.0:1784093869.033693:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024256384:0@lo:400:kworker.0 00000100:00100000:3.0:1784093869.033741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093869.033755:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093869.033771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093869.033834:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024256512:0@lo:400:kworker.0 00000100:00100000:1.0:1784093869.033851:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024256768:0@lo:400:kworker.0 00000100:00100000:2.0:1784093869.033854:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024256640:0@lo:400:kworker.0 00000100:00100000:3.0:1784093869.033877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093869.033916:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256512 00000100:00100000:1.0:1784093869.033924:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256512 00000100:00100000:2.0:1784093869.033930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093869.033969:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256000 00000100:00100000:3.0:1784093869.033975:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256000 00000100:00100000:2.0:1784093869.034012:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256256 00000100:00100000:2.0:1784093869.034021:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256256 00000100:00100000:1.0:1784093869.034028:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1784093869.034032:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784093869.034043:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024256512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093869.034047:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024256000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093869.034074:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256640 00000100:00100000:2.0:1784093869.034081:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256640 00002000:00000024:3.0:1784093869.034082:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093869.034117:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024256512:12345-0@lo:400:kworker.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093869.034127:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1784093869.034135:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024256000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093869.034143:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1784093869.034152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093869.034172:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256384 00000100:00100000:3.0:1784093869.034178:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256384 00000100:00100000:0.0:1784093869.034202:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1784093869.034215:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024256256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093869.034220:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1784093869.034247:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024256384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093869.034262:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024256256:12345-0@lo:400:kworker.0 Request processed in 50us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093869.034282:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1784093869.034309:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024256384:12345-0@lo:400:kworker.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093869.034328:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:0.0:1784093869.034348:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093869.034358:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093869.034364:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00080000:0.0:1784093869.034365:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093869.034380:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093869.034388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093869.034406:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256128 00000100:00100000:2.0:1784093869.034411:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256128 00000100:00100000:1.0:1784093869.034447:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256768 00000100:00100000:1.0:1784093869.034454:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256768 00000100:00100000:0.0:1784093869.034475:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024256256:0@lo:400:kworker.0 00000100:00100000:3.0:1784093869.034477:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024256640:12345-0@lo:400:kworker.0 Request processed in 102us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093869.034489:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784093869.034495:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1784093869.034505:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1784093869.034506:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024256128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093869.034525:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024256768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093869.034561:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024256128:12345-0@lo:400:kworker.0 Request processed in 57us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093869.034568:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1784093869.034581:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024256640:0@lo:400:kworker.0 00000100:00100000:1.0:1784093869.034603:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024256768:12345-0@lo:400:kworker.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093869.034606:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024256128:0@lo:400:kworker.0 00000100:00100000:0.0:1784093869.034613:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024256768:0@lo:400:kworker.0 00000100:00100000:1.0:1784093869.034620:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1784093869.034671:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024256512:0@lo:400:kworker.0 00000100:00100000:3.0:1784093869.034675:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024256384:0@lo:400:kworker.0 00000100:00100000:2.0:1784093869.034712:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024256000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784093869.545593:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093870.569589:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093871.081625:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024256896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093871.081690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093871.081728:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024256896 00000100:00100000:2.0:1784093871.081735:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024256896 00000100:00080000:0.0:1784093871.081797:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093871.081832:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784093871.081843:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024256896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093871.081877:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093871.081948:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024256896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093871.081956:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784093871.082000:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024256896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093871.593560:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093872.617598:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093873.528327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093873.528395:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721856 00000100:00100000:2.0:1784093873.528405:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721856 00000100:00080000:0.0:1784093873.528488:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093873.528505:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 684 00000100:00100000:2.0:1784093873.528518:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013721856:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093873.528586:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013721856:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093873.528594:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 684 00000100:00100000:3.0:1784093873.529191:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093873.529256:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721728 00000100:00100000:2.0:1784093873.529265:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721728 00000100:00100000:2.0:1784093873.529311:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:2.0:1784093873.529319:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013721728:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093873.529381:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013721728:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 62us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093873.529388:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:1.0:1784093873.532821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093873.532851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093873.532896:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013721984 00000100:00100000:3.0:1784093873.532903:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013721984 00000100:00100000:2.0:1784093873.532927:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722112 00000100:00100000:2.0:1784093873.532932:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722112 00000100:00100000:3.0:1784093873.532965:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 482 00000100:00100000:2.0:1784093873.532975:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 308 00000100:00100000:3.0:1784093873.532987:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013722112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093873.532988:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013721984:12345-192.168.204.57@tcp:9:kworker.0 00000100:00080000:0.0:1784093873.532994:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093873.533000:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1784093873.533014:0:8031:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214ca0b2 00000100:00080000:2.0:1784093873.533025:0:8031:0:(import.c:65:import_set_state_nolock()) ffff907101d62800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784093873.533048:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013722112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093873.533058:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 482 00000001:00000004:2.0:1784093873.533080:0:8031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967335 00010000:00010000:1.0:1784093873.533089:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093873.533283:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013721984:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 300us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093873.533289:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 308 00010000:00010000:1.0:1784093873.641587:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093874.153568:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024257024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093874.153574:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024257152:0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.153602:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024257408:0@lo:400:kworker.0 00000100:00100000:2.0:1784093874.153641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093874.153641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093874.153666:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093874.153696:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024257664:0@lo:400:kworker.0 00000100:00100000:0.0:1784093874.153697:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024257536:0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.153716:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257408 00000100:00100000:3.0:1784093874.153724:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257408 00000100:00100000:2.0:1784093874.153727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093874.153753:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784093874.153753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093874.153762:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024257280:0@lo:400:kworker.0 00000100:00100000:2.0:1784093874.153792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093874.153803:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257664 00000100:00100000:0.0:1784093874.153807:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257024 00000100:00100000:3.0:1784093874.153808:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257664 00000100:00100000:0.0:1784093874.153814:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257024 00000100:00100000:2.0:1784093874.153817:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024257792:0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.153842:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257280 00000100:00100000:3.0:1784093874.153857:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257280 00000100:00100000:2.0:1784093874.153863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093874.153882:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784093874.153886:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1784093874.153895:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257536 00000100:00100000:3.0:1784093874.153902:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024257408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093874.153902:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024257024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093874.153903:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257536 00000100:00100000:2.0:1784093874.153905:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257152 00000100:00100000:2.0:1784093874.153912:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257152 00002000:00000024:0.0:1784093874.153941:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093874.153942:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257792 00000100:00100000:1.0:1784093874.153948:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257792 00000100:00100000:2.0:1784093874.153955:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1784093874.153963:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024257408:12345-0@lo:400:kworker.0 Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.153967:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.153977:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1784093874.153979:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1784093874.153995:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024257024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093874.154003:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1784093874.154006:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1784093874.154016:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024257664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093874.154025:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024257152:12345-0@lo:400:kworker.0 Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.154035:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784093874.154035:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024257536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093874.154037:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1784093874.154050:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024257792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.154058:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024257664:12345-0@lo:400:kworker.0 Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093874.154067:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1784093874.154088:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1784093874.154099:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024257664:0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.154100:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024257280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093874.154105:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024257792:12345-0@lo:400:kworker.0 Request processed in 55us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093874.154116:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1784093874.154118:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024257152:0@lo:400:kworker.0 00000100:00100000:1.0:1784093874.154136:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024257536:12345-0@lo:400:kworker.0 Request processed in 147us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.154144:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024257792:0@lo:400:kworker.0 00000100:00100000:1.0:1784093874.154147:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1784093874.154162:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024257280:12345-0@lo:400:kworker.0 Request processed in 65us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093874.154164:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024257536:0@lo:400:kworker.0 00000100:00100000:2.0:1784093874.154171:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024257280:0@lo:400:kworker.0 00000100:00100000:3.0:1784093874.154176:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1784093874.154197:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024257024:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093874.154229:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093874.154235:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093874.154238:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093874.154249:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024257408:0@lo:400:kworker.0 00000001:00100000:3.0:1784093874.161446:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:3.0:1784093874.161452:0:6598:0:(genops.c:906:class_export_put()) final put ffff907101d60800/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:0.0:1784093874.161474:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff907101d60800/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0000 00000020:00000080:0.0:1784093874.161515:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907101d62800 for lustre-OST0000 00000100:00100000:1.0:1784093874.550317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093874.550368:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722240 00000100:00100000:3.0:1784093874.550388:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722240 00000100:00100000:3.0:1784093874.550469:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 629 00000100:00100000:3.0:1784093874.550480:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722240:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093874.550573:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722240:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093874.550578:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 629 00000100:00100000:1.0:1784093874.551390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093874.551451:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722368 00000100:00100000:2.0:1784093874.551456:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722368 00000100:00100000:2.0:1784093874.551488:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 309 00000100:00100000:2.0:1784093874.551493:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1870757013722368:12345-192.168.204.57@tcp:8:lfs.0 00010000:00080000:2.0:1784093874.551511:0:8031:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 1035 last 0 00000020:00000080:2.0:1784093874.551533:0:8031:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214ca6fc 00002000:00100000:2.0:1784093874.551543:0:8031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff907102746000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784093874.551560:0:8031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784093874.551733:0:8031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784093874.551770:0:8031:0:(import.c:65:import_set_state_nolock()) ffff907102745000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784093874.551811:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013722368:12345-192.168.204.57@tcp:8:lfs.0 Request processed in 316us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.551818:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 309 00000100:00100000:0.0:1784093874.552550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093874.552597:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722496 00000100:00100000:1.0:1784093874.552602:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722496 00000100:00100000:1.0:1784093874.552638:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 310 00000100:00100000:1.0:1784093874.552647:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722496:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:2.0:1784093874.552656:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093874.552891:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722496:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 245us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093874.552899:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 310 00000100:00100000:1.0:1784093874.553532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093874.553577:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722624 00000100:00100000:2.0:1784093874.553588:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722624 00000100:00100000:2.0:1784093874.553612:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 311 00000100:00100000:2.0:1784093874.553617:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:44408:x1870757013722624:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093874.553796:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:44408:x1870757013722624:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 178us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.553801:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 311 00000100:00100000:0.0:1784093874.554443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093874.554487:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722752 00000100:00100000:3.0:1784093874.554493:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722752 00000100:00100000:3.0:1784093874.554524:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00100000:3.0:1784093874.554532:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722752:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093874.554812:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722752:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 279us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093874.554820:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00100000:0.0:1784093874.556165:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093874.556214:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013722880 00000100:00100000:2.0:1784093874.556220:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013722880 00000100:00100000:2.0:1784093874.556257:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 631 00000100:00100000:2.0:1784093874.556264:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722880:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093874.556325:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013722880:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.556332:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 631 00000100:00100000:1.0:1784093874.556918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093874.556959:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723008 00000100:00100000:2.0:1784093874.556963:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723008 00000100:00100000:2.0:1784093874.556985:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 312 00000100:00100000:2.0:1784093874.556990:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013723008:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093874.557192:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013723008:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 201us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093874.557197:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 312 00000100:00100000:0.0:1784093874.557811:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093874.557862:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723136 00000100:00100000:1.0:1784093874.557867:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723136 00000100:00100000:1.0:1784093874.557908:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 313 00000100:00100000:1.0:1784093874.557916:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:44408:x1870757013723136:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093874.558119:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:44408:x1870757013723136:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 203us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093874.558125:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 313 00000100:00100000:0.0:1784093874.558904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093874.558941:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723264 00000100:00100000:3.0:1784093874.558946:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723264 00000100:00100000:3.0:1784093874.558976:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 632 00000100:00100000:3.0:1784093874.558983:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013723264:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093874.559224:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44408:x1870757013723264:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 241us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093874.559232:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 632 00010000:00010000:0.0:1784093874.665585:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093875.114412:0:75472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2f9e1810 20000000:00000080:3.0:1784093875.114452:0:75472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907206bb1800 uarg=0000000000000000 00010000:00010000:3.0:1784093875.114875:0:75472:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093875.114904:0:75472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784093875.114908:0:75472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093875.114918:0:75472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca6a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5810 expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.114944:0:75472:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093875.114956:0:75472:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093875.114966:0:75472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.114975:0:75472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca685 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.114981:0:75472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.115009:0:75472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca685 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.115022:0:75472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca685 expref: 18 pid: 5770 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093875.115036:0:75472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75472:1870757024257920:0@lo:104: 00000100:00100000:3.0:1784093875.115094:0:75472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093875.115134:0:75472:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2fa900 going to sleep for 11 seconds 00000100:00100000:1.0:1784093875.115146:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784093875.115157:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024257920 00000100:00100000:1.0:1784093875.115161:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024257920 00000100:00100000:1.0:1784093875.115198:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784093875.115208:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:75472:x1870757024257920:12345-0@lo:104: 00010000:00010000:1.0:1784093875.115220:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093875.115270:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093875.115276:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:75472:x1870757024257920:12345-0@lo:104: Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093875.115283:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00010000:2.0:1784093875.115289:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093875.115295:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093875.115296:0:75472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75472:1870757024257920:0@lo:104: 00010000:00010000:2.0:1784093875.115309:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784093875.115313:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.115317:0:75472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115325:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784093875.115334:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093875.115340:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784093875.115366:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115377:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784093875.115399:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115407:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca685 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca68c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093875.115419:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024258048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093875.115450:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093875.115454:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093875.115457:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093875.115473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093875.115502:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258048 00000100:00100000:2.0:1784093875.115507:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258048 00010000:00010000:2.0:1784093875.115527:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca685 expref: 19 pid: 5770 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093875.115553:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784093875.115562:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024258048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093875.115572:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093875.115578:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca685 expref: 19 pid: 5770 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115588:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca685 expref: 19 pid: 5770 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115599:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214ca68c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca685 expref: 19 pid: 5770 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115611:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115628:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115640:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115648:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115656:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115662:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115668:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093875.115672:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115679:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115692:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093875.115700:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093875.115730:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024258048:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093875.115736:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784093875.115769:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024258048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093875.115809:0:75472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.115842:0:75472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093875.115849:0:75472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca703 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093875.689527:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093876.054693:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093876.054778:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723392 00000100:00100000:3.0:1784093876.054792:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723392 00000100:00080000:0.0:1784093876.054863:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093876.054925:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:3.0:1784093876.054937:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:44494:x1870757013723392:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093876.054964:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093876.054991:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca70a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5825 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.055067:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.055083:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.055097:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093876.055397:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:3.0:1784093876.055401:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093876.055556:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.055587:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5825 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.055616:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5825 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.055625:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784093876.055628:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093876.055631:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784093876.055704:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:44494:x1870757013723392:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 769us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093876.055711:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:1.0:1784093876.057363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093876.057411:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723648 00000100:00100000:2.0:1784093876.057470:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723648 00000100:00100000:2.0:1784093876.057511:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 634 00000100:00100000:2.0:1784093876.057521:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:44494:x1870757013723648:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093876.057564:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093876.057584:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ca711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5825 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093876.057596:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca6a8) 00010000:00010000:2.0:1784093876.057598:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fce100) 00010000:00010000:2.0:1784093876.057605:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093876.057625:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093876.057635:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093876.057647:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784093876.069145:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967539 is committed 00000004:00010000:2.0:1784093876.069162:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000009401e3c reply state 00000000b4f8f54e transno 4294967539 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093876.069177:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784093876.069267:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:2.0:1784093876.069358:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784093876.069381:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:44494:x1870757013723648:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 11858us (12029us total) trans 4294967539 rc 0/0 00000100:00100000:2.0:1784093876.069391:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 634 00010000:00010000:3.0:1784093876.069405:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.069413:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.069418:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.069449:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093876.069452:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.069461:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.069478:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781400) 00010000:00010000:3.0:1784093876.069482:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093876.069487:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093876.069501:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca718 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093876.201561:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024258176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093876.201631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093876.201667:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258176 00000100:00100000:2.0:1784093876.201674:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258176 00000100:00080000:1.0:1784093876.201723:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093876.201749:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784093876.201762:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024258176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093876.201801:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093876.201875:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024258176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093876.201882:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1784093876.201901:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024258176:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784093876.357394:0:75669:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff77d709a0 20000000:00000080:0.0:1784093876.357411:0:75669:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907231063c00 uarg=0000000000000000 00010000:00010000:0.0:1784093876.357964:0:75669:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093876.357977:0:75669:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093876.357989:0:75669:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093876.358013:0:75669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358032:0:75669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358056:0:75669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358063:0:75669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358068:0:75669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358074:0:75669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358078:0:75669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093876.358081:0:75669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358087:0:75669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358098:0:75669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358103:0:75669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.358107:0:75669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214ca71f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093876.458480:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093876.458486:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093876.458489:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093876.458538:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.458547:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.458557:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093876.458583:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024258304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093876.458649:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093876.458681:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258304 00000100:00100000:2.0:1784093876.458690:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258304 00000100:00100000:0.0:1784093876.458713:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1784093876.458735:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1784093876.458744:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024258304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093876.458758:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093876.458771:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca726 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093876.458794:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca726 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093876.458826:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca726 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093876.458835:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093876.458869:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024258304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093876.458875:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1784093876.458906:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024258304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093876.458918:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.458924:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093876.458937:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093876.458942:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093876.458949:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093876.713585:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093877.380026:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093877.380081:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723776 00000100:00100000:3.0:1784093877.380092:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723776 00000100:00100000:3.0:1784093877.380150:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 635 00000100:00100000:3.0:1784093877.380162:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:44570:x1870757013723776:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093877.380186:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093877.380210:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf582c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380275:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380289:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380303:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380320:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380328:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380347:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380957:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380967:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.380975:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093877.381098:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:3.0:1784093877.381103:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093877.381239:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381252:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381260:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381267:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381273:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093877.381277:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381285:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381304:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093877.381307:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093877.381312:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381319:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ca73b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381332:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381338:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381345:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381350:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093877.381353:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381359:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381367:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907204fce600) 00010000:00010000:3.0:1784093877.381369:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093877.381372:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381378:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381443:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ca734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf582c expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381467:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf582c expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.381475:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093877.381478:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093877.381481:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784093877.381539:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44570:x1870757013723776:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1380us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093877.381547:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 635 00010000:00010000:2.0:1784093877.738543:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093877.979454:0:75912:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefb47e630 20000000:00000080:3.0:1784093877.979470:0:75912:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907206bb1000 uarg=0000000000000000 00010000:00010000:3.0:1784093877.979640:0:75912:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784093877.979664:0:75912:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093877.979667:0:75912:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093877.979675:0:75912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf582c expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.979691:0:75912:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784093877.979700:0:75912:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093877.979710:0:75912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.979719:0:75912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca726 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.979732:0:75912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.979760:0:75912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca726 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.979769:0:75912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca726 expref: 18 pid: 5770 timeout: 1189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093877.979821:0:75912:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75912:1870757024258432:0@lo:104: 00000100:00100000:3.0:1784093877.979882:0:75912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093877.979931:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258432 00000100:00100000:2.0:1784093877.979938:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258432 00000100:00100000:3.0:1784093877.979946:0:75912:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093877.979997:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784093877.980011:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:75912:x1870757024258432:12345-0@lo:104: 00010000:00010000:2.0:1784093877.980023:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093877.980078:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093877.980083:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:75912:x1870757024258432:12345-0@lo:104: Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093877.980088:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00010000:0.0:1784093877.980102:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093877.980110:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980128:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1c54c20) 00000100:00100000:3.0:1784093877.980129:0:75912:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75912:1870757024258432:0@lo:104: 10000000:00010000:0.0:1784093877.980136:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.980144:0:75912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980146:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093877.980160:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093877.980167:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093877.980200:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980207:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093877.980236:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980242:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214ca726 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca72d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980255:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093877.980256:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093877.980258:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093877.980294:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024258560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093877.980317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093877.980357:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258560 00000100:00100000:0.0:1784093877.980362:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258560 00010000:00010000:0.0:1784093877.980381:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca726 expref: 19 pid: 5770 timeout: 1189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093877.980411:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784093877.980451:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024258560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093877.980463:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093877.980470:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca726 expref: 19 pid: 5770 timeout: 1189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980481:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca726 expref: 19 pid: 5770 timeout: 1189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980491:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40e00/0x9ce98053214ca72d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca726 expref: 19 pid: 5770 timeout: 1189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980503:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980510:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980522:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980529:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980535:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980542:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980547:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093877.980551:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980564:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980580:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093877.980589:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093877.980595:0:75912:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.980603:0:75912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093877.980608:0:75912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214ca750 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093877.980628:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024258560:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093877.980636:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784093877.980659:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024258560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784093878.648169:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093878.648204:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093878.648228:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013724032 00000100:00100000:2.0:1784093878.648238:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013724032 00000100:00100000:0.0:1784093878.648243:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093878.648280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093878.648304:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00100000:0.0:1784093878.648309:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013723904 00000100:00100000:0.0:1784093878.648315:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013723904 00000100:00100000:2.0:1784093878.648319:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013724032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093878.648354:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 706 00000100:00100000:0.0:1784093878.648364:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013723904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093878.648398:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013724032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093878.648405:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013723904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093878.648410:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00100000:2.0:1784093878.648455:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013724160 00000100:00100000:2.0:1784093878.648459:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013724160 00000100:00100000:2.0:1784093878.648497:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013724288 00000100:00100000:2.0:1784093878.648501:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013724288 00000100:00100000:0.0:1784093878.648517:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 706 00000100:00100000:2.0:1784093878.648533:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 485 00000100:00100000:2.0:1784093878.648543:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013724160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093878.648562:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 486 00000100:00100000:0.0:1784093878.648572:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013724288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093878.648580:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013724160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093878.648596:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 485 00000100:00100000:0.0:1784093878.648611:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013724288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (329us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093878.648620:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093878.648620:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 486 00000100:00080000:2.0:1784093878.648626:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093878.648628:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784093878.761586:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093878.984114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093878.984167:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013724416 00000100:00100000:2.0:1784093878.984185:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013724416 00000100:00100000:2.0:1784093878.984250:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:2.0:1784093878.984261:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:44661:x1870757013724416:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093878.984281:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093878.984303:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5833 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093878.984360:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca75e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093878.984374:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093878.984386:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093878.984632:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:2.0:1784093878.984637:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093878.984747:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca75e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093878.984789:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ca757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5833 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093878.984811:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca75e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5833 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093878.984827:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093878.984830:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093878.984833:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093878.984898:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:44661:x1870757013724416:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 639us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093878.984906:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:2.0:1784093878.987997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093878.988042:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013724672 00000100:00100000:0.0:1784093878.988052:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013724672 00000100:00100000:0.0:1784093878.988092:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 637 00000100:00100000:0.0:1784093878.988099:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44661:x1870757013724672:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093878.988137:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093878.988156:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ca75e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5833 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093878.988168:0:5778:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca749) 00010000:00010000:0.0:1784093878.988172:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff90721a781000) 00010000:00010000:0.0:1784093878.988182:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093878.988214:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093878.988226:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093878.988236:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093879.001230:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967540 is committed 00000004:00010000:1.0:1784093879.002172:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004df7bf97 reply state 00000000ceb6bcd8 transno 4294967540 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093879.002182:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093879.002502:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00080000:1.0:1784093879.002596:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784093879.002624:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:44661:x1870757013724672:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 14521us (14626us total) trans 4294967540 rc 0/0 00000100:00100000:1.0:1784093879.002632:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 637 00010000:00010000:0.0:1784093879.002653:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.002664:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.002673:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.002680:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093879.002685:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.002701:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.002716:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784093879.002719:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093879.002723:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.002729:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ca765 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093879.273534:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024258688:0@lo:400:kworker.0 00000100:00100000:0.0:1784093879.273582:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093879.273589:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024258944:0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.273598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093879.273632:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093879.273637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093879.273665:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024259200:0@lo:400:kworker.0 00000100:00100000:0.0:1784093879.273667:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024259328:0@lo:400:kworker.0 00000100:00100000:3.0:1784093879.273675:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024259456:0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.273716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093879.273718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093879.273733:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258944 00000100:00100000:3.0:1784093879.273740:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258944 00000100:00100000:1.0:1784093879.273769:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093879.273777:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024259072:0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.273823:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258688 00000100:00100000:1.0:1784093879.273827:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258688 00000100:00100000:0.0:1784093879.273830:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024258816 00000100:00100000:0.0:1784093879.273836:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024258816 00000100:00100000:1.0:1784093879.273860:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1784093879.273871:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024258688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093879.273875:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259328 00000100:00100000:3.0:1784093879.273886:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259328 00000100:00100000:0.0:1784093879.273894:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784093879.273924:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1784093879.273935:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024258944:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093879.273937:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093879.273953:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093879.273971:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1784093879.273984:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024259328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093879.273991:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024258944:12345-0@lo:400:kworker.0 Request processed in 56us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093879.273999:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1784093879.274034:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024259328:12345-0@lo:400:kworker.0 Request processed in 53us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093879.274043:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1784093879.274048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093879.274081:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259200 00000100:00100000:2.0:1784093879.274084:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259456 00000100:00100000:1.0:1784093879.274085:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259200 00000100:00100000:3.0:1784093879.274091:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024258944:0@lo:400:kworker.0 00000100:00100000:2.0:1784093879.274091:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259456 00000100:00100000:2.0:1784093879.274132:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1784093879.274141:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024259456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.274148:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1784093879.274161:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024259200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093879.274245:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024259456:12345-0@lo:400:kworker.0 Request processed in 105us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093879.274253:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1784093879.274263:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024259200:12345-0@lo:400:kworker.0 Request processed in 105us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093879.274269:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1784093879.274305:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024258688:12345-0@lo:400:kworker.0 Request processed in 438us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093879.274311:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1784093879.274346:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093879.274373:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024259200:0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.274380:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024258688:0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.274419:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259072 00000100:00100000:3.0:1784093879.274705:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024259456:0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.274912:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259072 00000100:00100000:1.0:1784093879.274949:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1784093879.274961:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024259072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093879.275008:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024259072:12345-0@lo:400:kworker.0 Request processed in 52us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093879.275014:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1784093879.275050:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024259072:0@lo:400:kworker.0 00000100:00080000:3.0:1784093879.275136:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093879.275141:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093879.275171:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024258816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093879.275199:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093879.275240:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024258816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1337us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093879.275249:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1784093879.275282:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024259328:0@lo:400:kworker.0 00000100:00100000:3.0:1784093879.275313:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024258816:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1784093879.283367:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:3.0:1784093879.287898:0:76110:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdecc77560 20000000:00000080:3.0:1784093879.287912:0:76110:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907206bb1800 uarg=0000000000000000 00010000:00010000:3.0:1784093879.288308:0:76110:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093879.288328:0:76110:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093879.288341:0:76110:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093879.288360:0:76110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288376:0:76110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288386:0:76110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288393:0:76110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288401:0:76110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288407:0:76110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288415:0:76110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093879.288419:0:76110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288476:0:76110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288489:0:76110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288497:0:76110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.288514:0:76110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214ca76c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093879.401525:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093879.401531:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093879.401542:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093879.401593:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.401603:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.401611:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093879.401632:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024259584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093879.401690:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093879.401739:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093879.401754:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259584 00000100:00100000:0.0:1784093879.401762:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259584 00000100:00100000:0.0:1784093879.401816:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1784093879.401826:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024259584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093879.401840:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093879.401854:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca773 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.401889:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca773 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.401897:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca773 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093879.401905:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093879.401941:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024259584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093879.401948:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1784093879.401981:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024259584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093879.401995:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.402004:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093879.402021:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093879.402025:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093879.402037:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093879.785574:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093880.288227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093880.288289:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013724800 00000100:00100000:0.0:1784093880.288299:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013724800 00000100:00080000:3.0:1784093880.288357:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093880.288392:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 638 00000100:00100000:0.0:1784093880.288408:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:44737:x1870757013724800:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093880.288463:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093880.288482:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf583a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.288541:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.288554:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.288568:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.288584:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.288606:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.288616:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289136:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289144:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289150:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093880.289235:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:0.0:1784093880.289238:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093880.289300:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289311:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289316:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289321:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289325:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093880.289328:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289337:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289347:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784093880.289349:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093880.289352:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289355:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214ca788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289364:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289368:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289372:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289375:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093880.289377:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289380:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289385:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907202e6b400) 00010000:00010000:0.0:1784093880.289386:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093880.289388:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289400:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ca78f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289444:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf583a expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289458:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf583a expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.289466:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093880.289469:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093880.289473:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784093880.289530:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:44737:x1870757013724800:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1127us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093880.289536:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 638 00000100:00100000:0.0:1784093880.290662:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093880.290762:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013725056 00000100:00100000:1.0:1784093880.290768:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013725056 00000100:00100000:1.0:1784093880.290809:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 639 00000100:00100000:1.0:1784093880.290818:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:44737:x1870757013725056:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784093880.290829:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093880.290838:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca79d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5841 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.291101:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.291112:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.291120:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.291132:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.291150:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.291158:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093880.292009:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:1.0:1784093880.292328:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292338:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292347:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292377:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292385:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292391:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292396:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093880.292400:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292407:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292466:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:1.0:1784093880.292469:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093880.292474:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292480:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093880.292502:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006467b5c9 reply state 00000000e61c3cec transno 4294967541 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093880.292510:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093880.292537:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca79d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5841 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292551:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5841 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.292558:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907219c12300) 00010000:00010000:1.0:1784093880.292560:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093880.292562:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093880.292611:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:44737:x1870757013725056:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1794us (1951us total) trans 4294967541 rc 0/0 00000100:00100000:1.0:1784093880.292619:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 639 00010000:00010000:0.0:1784093880.293355:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.293367:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.293375:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.293381:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093880.293386:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.293405:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.293418:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907219c12b00) 00010000:00010000:0.0:1784093880.293455:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093880.293460:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.293468:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093880.293866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093880.293904:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013725312 00000100:00100000:1.0:1784093880.293911:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013725312 00000100:00100000:1.0:1784093880.293959:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:1.0:1784093880.293971:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:44737:x1870757013725312:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:1.0:1784093880.294020:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093880.294033:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5841 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.294047:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907219c12300) 00010000:00010000:1.0:1784093880.294057:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093880.294081:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.294091:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.294099:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093880.294165:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000026fe58a6 reply state 00000000a109df61 transno 4294967542 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093880.294172:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093880.294220:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:44737:x1870757013725312:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 253us (355us total) trans 4294967542 rc 0/0 00000100:00100000:1.0:1784093880.294227:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 640 00010000:00010000:3.0:1784093880.294760:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.294770:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.294777:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.294783:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093880.294787:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.294794:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.294807:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907219c12000) 00010000:00010000:3.0:1784093880.294810:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093880.294870:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.294879:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093880.294947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093880.294981:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013725440 00000100:00100000:3.0:1784093880.295034:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013725440 00000100:00100000:3.0:1784093880.295077:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 641 00000100:00100000:3.0:1784093880.295088:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:44737:x1870757013725440:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093880.295101:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093880.295117:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca7c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5848 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.295154:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5848 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.295165:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5848 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.295184:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093880.295187:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784093880.295190:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784093880.295228:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:44737:x1870757013725440:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 143us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093880.295238:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 641 00000100:00100000:3.0:1784093880.296381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093880.296414:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013725568 00000100:00100000:3.0:1784093880.296447:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013725568 00000100:00100000:3.0:1784093880.296523:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 314 00000100:00100000:3.0:1784093880.296541:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013725568:12345-192.168.204.57@tcp:2:touch.60003 00000100:00080000:0.0:1784093880.296542:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093880.296945:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013725568:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 412us (570us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1784093880.296958:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 314 00000100:00100000:3.0:1784093880.298605:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093880.298651:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013725824 00000100:00100000:3.0:1784093880.298657:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013725824 00000100:00100000:3.0:1784093880.298710:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 68 00000100:00100000:3.0:1784093880.298724:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:44737:x1870757013725824:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:3.0:1784093880.299042:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:44737:x1870757013725824:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 322us (437us total) trans 4294967543 rc 0/0 00000100:00100000:3.0:1784093880.299056:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 68 00000100:00100000:2.0:1784093880.317555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093880.317623:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013725952 00000100:00100000:1.0:1784093880.317645:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013725952 00000100:00100000:1.0:1784093880.317723:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:1.0:1784093880.317749:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:44741:x1870757013725952:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784093880.317795:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093880.317833:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf584f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.317942:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.317961:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.317975:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.317994:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318001:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318008:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318130:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318140:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318147:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093880.318188:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00000004:00200000:1.0:1784093880.318194:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093880.318216:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318241:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318251:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318258:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318266:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318273:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093880.318277:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318286:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318298:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:1.0:1784093880.318302:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093880.318307:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318313:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca7d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318327:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318333:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318354:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318363:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093880.318366:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318372:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318380:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907219c12300) 00010000:00010000:1.0:1784093880.318382:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093880.318385:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318391:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca7dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318452:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca7ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf584f expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318470:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf584f expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.318477:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784093880.318480:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093880.318482:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784093880.318552:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:44741:x1870757013725952:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 807us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093880.318571:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:3.0:1784093880.319853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093880.319895:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013726080 00000100:00100000:2.0:1784093880.319901:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013726080 00000100:00100000:2.0:1784093880.319936:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 315 00000100:00100000:2.0:1784093880.319951:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013726080:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784093880.319974:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093880.319994:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5856 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093880.320019:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x6a571cb8, atime: 0x6a571cb8, ctime: 0x6a571cb8, blocks: 0x1 00010000:00010000:2.0:1784093880.320035:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1041s v=(0 0) 00010000:00010000:2.0:1784093880.320039:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093880.320047:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.320059:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.320069:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784093880.320119:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013726080:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 177us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093880.320126:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 315 00000100:00100000:0.0:1784093880.322096:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093880.322148:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013726336 00000100:00100000:1.0:1784093880.322158:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013726336 00000100:00100000:1.0:1784093880.322209:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 643 00000100:00100000:1.0:1784093880.322219:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:44741:x1870757013726336:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:1.0:1784093880.322279:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093880.322306:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca7e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf584f expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322327:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ca7c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5848 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322344:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784093880.322358:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093880.322382:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322394:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322404:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322418:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322453:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322479:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322601:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322609:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.322617:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093880.323222:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:1.0:1784093880.323234:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1041400811322ns, next at 1042400808649ns, rc = 0 00010000:00010000:1.0:1784093880.323294:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323301:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323307:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323312:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323316:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323320:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323346:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093880.323370:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323375:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093880.323376:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323381:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323383:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323388:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093880.323392:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323393:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093880.323396:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323400:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323402:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323409:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093880.323412:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093880.323415:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323439:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093880.323439:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca7ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323441:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784093880.323444:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323450:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ca806 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323456:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323463:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093880.323467:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093880.323469:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093880.323472:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093880.323478:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323484:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093880.323487:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323494:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323502:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:1.0:1784093880.323504:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093880.323506:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.323510:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca7f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093880.323518:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e9e999f6 reply state 0000000076ddd4e2 transno 4294967544 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093880.323524:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093880.323611:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:44741:x1870757013726336:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1391us (1518us total) trans 4294967544 rc 0/0 00000100:00100000:1.0:1784093880.323621:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 643 00010000:00010000:3.0:1784093880.324291:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.324305:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.324310:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.324314:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093880.324318:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.324325:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.324341:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907219c12a00) 00010000:00010000:3.0:1784093880.324344:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093880.324348:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.324372:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca7f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.810670:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093880.934182:0:76353:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe38554f20 20000000:00000080:0.0:1784093880.934200:0:76353:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b35c00 uarg=0000000000000000 00010000:00010000:0.0:1784093880.934452:0:76353:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093880.934500:0:76353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093880.934504:0:76353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093880.934517:0:76353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ca796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf583a expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.934538:0:76353:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093880.934554:0:76353:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093880.934567:0:76353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.934591:0:76353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca773 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.934599:0:76353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.934636:0:76353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca773 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.934649:0:76353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca773 expref: 18 pid: 5772 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093880.934664:0:76353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76353:1870757024259712:0@lo:104: 00000100:00100000:0.0:1784093880.934740:0:76353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093880.934789:0:76353:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220c64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784093880.934794:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259712 00000100:00100000:1.0:1784093880.934803:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259712 00000100:00100000:1.0:1784093880.934852:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784093880.934863:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:76353:x1870757024259712:12345-0@lo:104: 00010000:00010000:1.0:1784093880.934884:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.934951:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093880.934959:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:76353:x1870757024259712:12345-0@lo:104: Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093880.934969:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784093880.934973:0:76353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76353:1870757024259712:0@lo:104: 00010000:00010000:0.0:1784093880.934992:0:76353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.935072:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093880.935080:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.935090:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093880.935094:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.935103:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093880.935111:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093880.935118:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093880.935147:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.935151:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093880.935172:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.935177:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca773 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca77a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093880.935188:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093880.935197:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093880.935199:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093880.935208:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024259840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093880.935249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093880.935289:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259840 00000100:00100000:1.0:1784093880.935294:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259840 00010000:00010000:1.0:1784093880.935312:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca773 expref: 19 pid: 5772 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093880.935339:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784093880.935345:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024259840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093880.935356:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093880.935362:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca773 expref: 19 pid: 5772 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935372:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca773 expref: 19 pid: 5772 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935383:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca77a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca773 expref: 19 pid: 5772 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935396:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935404:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935445:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935453:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935461:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935468:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935474:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093880.935478:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935486:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935501:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093880.935512:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093880.935516:0:76353:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.935526:0:76353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093880.935533:0:76353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214ca80d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093880.935561:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024259840:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093880.935570:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784093880.935587:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024259840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784093881.321568:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024259968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093881.321644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093881.321684:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024259968 00000100:00100000:2.0:1784093881.321692:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024259968 00000100:00080000:0.0:1784093881.321742:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093881.321763:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1784093881.321776:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024259968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093881.321814:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093881.321857:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024259968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093881.321870:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1784093881.321896:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024259968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093881.833582:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093881.938210:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093881.938275:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013726464 00000100:00100000:1.0:1784093881.938286:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013726464 00000100:00100000:1.0:1784093881.938349:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 644 00000100:00100000:1.0:1784093881.938361:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:44832:x1870757013726464:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093881.938384:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093881.938405:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf585d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.938487:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.938499:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.938509:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093881.938565:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1784093881.938569:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093881.938595:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.938620:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf585d expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.938641:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf585d expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.938650:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093881.938659:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093881.938663:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093881.938732:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:44832:x1870757013726464:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 373us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093881.938739:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 644 00000100:00100000:2.0:1784093881.941055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093881.941099:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013726720 00000100:00100000:1.0:1784093881.941107:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013726720 00000100:00100000:1.0:1784093881.941158:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:1.0:1784093881.941169:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:44832:x1870757013726720:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093881.941212:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093881.941235:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca81b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf585d expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.941247:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca796) 00010000:00010000:1.0:1784093881.941251:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093881.941259:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093881.941277:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.941288:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093881.941297:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093881.941553:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000003e3d868f reply state 00000000a8fcda86 transno 4294967545 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093881.941563:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093881.941586:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000100:00100000:1.0:1784093881.941655:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:44832:x1870757013726720:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 487us (602us total) trans 4294967545 rc 0/0 00000100:00100000:1.0:1784093881.941664:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 645 00010000:00010000:3.0:1784093881.946293:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093881.946309:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093881.946317:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093881.946324:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093881.946330:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093881.946337:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093881.946354:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784093881.946358:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093881.946363:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093881.946370:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca822 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093882.154483:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093882.154491:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093882.154496:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093882.154543:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.154556:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.154566:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093882.154592:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024260096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093882.154656:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093882.154717:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260096 00000100:00100000:0.0:1784093882.154720:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5900 going to sleep for 11 seconds 00000100:00100000:1.0:1784093882.154725:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260096 00000100:00100000:1.0:1784093882.154801:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1784093882.154812:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024260096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093882.154826:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093882.154840:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca829 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093882.154862:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca829 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093882.154873:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca829 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093882.154882:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093882.154924:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024260096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093882.154932:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1784093882.154958:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024260096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093882.154974:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.154983:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093882.155000:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093882.155005:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.155012:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093882.240052:0:76548:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc700c0530 20000000:00000080:3.0:1784093882.240070:0:76548:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907220b6e000 uarg=0000000000000000 00010000:00010000:3.0:1784093882.240264:0:76548:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093882.240274:0:76548:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093882.240282:0:76548:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093882.240301:0:76548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093882.240316:0:76548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca829 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093882.240324:0:76548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093882.240361:0:76548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca829 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093882.240372:0:76548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca829 expref: 18 pid: 5770 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093882.240384:0:76548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76548:1870757024260224:0@lo:104: 00000100:00100000:3.0:1784093882.240455:0:76548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093882.240508:0:76548:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093882.240511:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260224 00000100:00100000:2.0:1784093882.240518:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260224 00000100:00100000:2.0:1784093882.240557:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784093882.240564:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:76548:x1870757024260224:12345-0@lo:104: 00010000:00010000:2.0:1784093882.240580:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.240627:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093882.240634:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:76548:x1870757024260224:12345-0@lo:104: Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093882.240647:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00010000:0.0:1784093882.240658:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784093882.240665:0:76548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76548:1870757024260224:0@lo:104: 00010000:00010000:0.0:1784093882.240671:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.240681:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:3.0:1784093882.240687:0:76548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093882.240700:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.240723:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093882.240731:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093882.240738:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093882.240770:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.240777:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093882.240801:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093882.240802:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024260352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093882.240814:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214ca829 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca830 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093882.240831:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093882.240833:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093882.240836:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093882.240839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093882.240884:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260352 00000100:00100000:2.0:1784093882.240890:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260352 00010000:00010000:2.0:1784093882.240911:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca829 expref: 19 pid: 5770 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093882.240949:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784093882.240958:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024260352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784093882.240969:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093882.240975:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca829 expref: 19 pid: 5770 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.240987:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca829 expref: 19 pid: 5770 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241000:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214ca830 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca829 expref: 19 pid: 5770 timeout: 1193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241012:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241020:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241043:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241049:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241056:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241062:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241068:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093882.241072:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241079:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241096:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093882.241105:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093882.241116:0:76548:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093882.241127:0:76548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093882.241134:0:76548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca837 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093882.241144:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024260352:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093882.241156:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784093882.241180:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024260352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093882.858511:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093883.270408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.270474:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013726848 00000100:00100000:1.0:1784093883.270483:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013726848 00000100:00080000:0.0:1784093883.270522:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093883.270536:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 646 00000100:00100000:1.0:1784093883.270543:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013726848:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093883.270653:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013726848:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093883.270660:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 646 00000100:00100000:3.0:1784093883.271300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093883.271349:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013726976 00000100:00100000:0.0:1784093883.271355:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013726976 00000100:00080000:3.0:1784093883.271403:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093883.271404:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 316 00000100:00100000:0.0:1784093883.271415:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:44916:x1870757013726976:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093883.271816:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:44916:x1870757013726976:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 402us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093883.271823:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 316 00000100:00100000:3.0:1784093883.272548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093883.272600:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727104 00000100:00100000:0.0:1784093883.272606:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727104 00000100:00080000:3.0:1784093883.272651:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093883.272652:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 317 00000100:00100000:0.0:1784093883.272663:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:44916:x1870757013727104:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093883.272890:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:44916:x1870757013727104:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 227us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093883.272896:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 317 00000100:00100000:3.0:1784093883.273523:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.273562:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727232 00000100:00100000:1.0:1784093883.273568:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727232 00000100:00100000:1.0:1784093883.273601:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 647 00000100:00100000:1.0:1784093883.273606:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013727232:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093883.273816:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013727232:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 209us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093883.273821:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 647 00000100:00100000:3.0:1784093883.274821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.274857:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727360 00000100:00100000:1.0:1784093883.274862:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727360 00000100:00100000:1.0:1784093883.274892:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:1.0:1784093883.274898:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013727360:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093883.274949:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013727360:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 50us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093883.274957:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:3.0:1784093883.275502:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093883.275542:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727488 00000100:00100000:2.0:1784093883.275547:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727488 00000100:00100000:2.0:1784093883.275580:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 318 00000100:00100000:2.0:1784093883.275594:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:44916:x1870757013727488:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093883.275769:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:44916:x1870757013727488:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 175us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093883.275776:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 318 00000100:00100000:3.0:1784093883.276388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093883.276442:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727616 00000100:00100000:0.0:1784093883.276446:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727616 00000100:00100000:0.0:1784093883.276476:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 319 00000100:00100000:0.0:1784093883.276485:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:44916:x1870757013727616:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093883.276630:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:44916:x1870757013727616:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 148us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093883.276635:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 319 00000100:00100000:3.0:1784093883.277250:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.277283:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727744 00000100:00100000:1.0:1784093883.277288:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727744 00000100:00100000:1.0:1784093883.277313:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 649 00000100:00100000:1.0:1784093883.277320:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013727744:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093883.277542:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:44916:x1870757013727744:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 222us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093883.277550:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 649 00000100:00100000:3.0:1784093883.297989:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.298044:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013727872 00000100:00100000:1.0:1784093883.298065:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013727872 00000100:00100000:1.0:1784093883.298119:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:1.0:1784093883.298131:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:44920:x1870757013727872:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784093883.298152:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093883.298174:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ca83e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5864 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298231:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298244:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298257:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298271:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298276:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298280:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298566:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298575:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298582:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093883.298612:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:1.0:1784093883.298616:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093883.298636:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298647:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298653:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298659:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298664:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093883.298668:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298688:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298700:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093883.298702:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093883.298707:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298713:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ca845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298723:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298737:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298743:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298748:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093883.298751:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298757:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298764:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907219c12400) 00010000:00010000:1.0:1784093883.298767:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093883.298770:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298775:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214ca84c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298799:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ca83e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5864 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298815:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5864 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.298822:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093883.298824:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093883.298831:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784093883.298886:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:44920:x1870757013727872:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 758us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093883.298898:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:3.0:1784093883.300288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.300338:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013728128 00000100:00100000:1.0:1784093883.300345:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013728128 00000100:00100000:1.0:1784093883.300385:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 651 00000100:00100000:1.0:1784093883.300397:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:44920:x1870757013728128:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784093883.300412:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093883.300446:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214ca85a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf586b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.300534:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.300545:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.300554:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.300567:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.300575:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.300582:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093883.300980:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:1.0:1784093883.301138:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca86f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301147:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301155:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301185:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301193:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301199:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301206:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093883.301209:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301216:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301227:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093883.301230:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093883.301233:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301239:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214ca861 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093883.301261:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000063a6de94 reply state 00000000d58f1a7c transno 4294967546 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093883.301270:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093883.301293:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214ca85a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf586b expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301305:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf586b expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093883.301313:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784093883.301315:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093883.301318:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093883.301371:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+14:44920:x1870757013728128:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 976us (1084us total) trans 4294967546 rc 0/0 00000100:00100000:1.0:1784093883.301378:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 651 00010000:00010000:0.0:1784093883.302078:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.302089:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.302095:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.302107:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093883.302117:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.302125:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.302135:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff907219c12700) 00010000:00010000:0.0:1784093883.302138:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093883.302141:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.302147:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ca868 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093883.304569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093883.304606:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013728256 00000100:00100000:0.0:1784093883.304616:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013728256 00000100:00100000:0.0:1784093883.304660:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 320 00000100:00100000:0.0:1784093883.304682:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:44920:x1870757013728256:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784093883.304698:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093883.304715:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5872 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784093883.304737:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784093883.304754:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=1044s v=(0 0) 00010000:00010000:0.0:1784093883.304758:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093883.304767:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.304783:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093883.304804:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784093883.304852:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:44920:x1870757013728256:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 183us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093883.304858:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 320 00000100:00100000:3.0:1784093883.313187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.313252:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013728384 00000100:00100000:1.0:1784093883.313261:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013728384 00002000:00100000:1.0:1784093883.313308:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff90723e17c380 x1870757013728384/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:204/0 lens 488/0 e 0 to 0 dl 1784093894 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093883.313329:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723e17c380 with x1870757013728384 ext(0->1048575) 00002000:00010000:1.0:1784093883.313336:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723e17c380 00000100:00100000:1.0:1784093883.313365:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 15 00000100:00100000:1.0:1784093883.313372:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013728384:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:1.0:1784093883.320977:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013728384:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 7596us (7788us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1784093883.320998:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 15 00002000:00100000:1.0:1784093883.321010:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff90723e17c380 x1870757013728384/t4294967336(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:204/0 lens 488/448 e 0 to 0 dl 1784093894 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093883.321020:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723e17c380 with x1870757013728384 ext(0->1048575) 00002000:00010000:1.0:1784093883.321028:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723e17c380 00000100:00100000:0.0:1784093883.323061:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.323121:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013728512 00000100:00100000:1.0:1784093883.323129:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013728512 00000100:00100000:1.0:1784093883.323186:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 652 00000100:00100000:1.0:1784093883.323197:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+13:44920:x1870757013728512:12345-192.168.204.57@tcp:44:dd.60003 00000100:00100000:2.0:1784093883.333039:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+13:44920:x1870757013728512:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 9835us (9974us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093883.333053:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 652 00000001:00080000:2.0:1784093883.333099:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967546 is committed 00000004:00080000:2.0:1784093883.333112:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000100:00100000:1.0:1784093883.333349:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024260480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784093883.333400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093883.333452:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260480 00000100:00100000:2.0:1784093883.333460:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260480 00000100:00080000:3.0:1784093883.333505:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093883.333516:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784093883.333526:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024260480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784093883.333551:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:20 count 1 00010000:00010000:2.0:1784093883.333573:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.333592:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.333601:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1784093883.333604:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093883.333609:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.333635:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.333656:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 6 pid: 6574 timeout: 1144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093883.333669:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024260608:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093883.333726:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484240 going to sleep for 11 seconds 00000100:00100000:0.0:1784093883.334273:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093883.334305:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013728640 00000100:00100000:3.0:1784093883.334311:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013728640 00000100:00100000:3.0:1784093883.334345:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 322 00000100:00100000:3.0:1784093883.334353:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013728640:12345-192.168.204.57@tcp:16:dd.60003 00000100:00100000:3.0:1784093883.335200:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024260608:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784093883.335222:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093883.335809:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.335840:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013728768 00000100:00100000:1.0:1784093883.335846:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013728768 00010000:00010000:1.0:1784093883.335895:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 7 pid: 6574 timeout: 1144 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093883.335942:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 269 00000100:00100000:2.0:1784093883.335955:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013728768:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093883.335969:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093883.335975:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 7 pid: 6574 timeout: 1144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.335987:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 7 pid: 6574 timeout: 1144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336008:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214ca7ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5856 expref: 7 pid: 6574 timeout: 1144 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336018:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093883.336021:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093883.336026:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336031:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336060:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093883.336108:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013728768:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 154us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093883.336116:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 269 00010000:00010000:2.0:1784093883.336149:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336159:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336169:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336177:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093883.336198:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093883.336215:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093883.336224:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093883.336247:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093883.336252:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093883.336264:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093883.336278:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093883.336286:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4c9b07/0x9ce98053214ca884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093883.336304:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093883.336306:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093883.336308:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093883.336648:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024260480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3122us (3247us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1784093883.336656:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000004:00080000:1.0:1784093883.336701:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907101252d80/2, rc 0, transno 4294967337 00000100:00100000:1.0:1784093883.336708:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024260480:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1784093883.344410:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000100:00100000:0.0:1784093883.344486:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013728640:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 10128us (10207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093883.344498:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 322 00000100:00100000:0.0:1784093883.345952:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.346006:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729024 00000100:00100000:1.0:1784093883.346015:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729024 00000100:00100000:1.0:1784093883.346062:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 69 00000100:00100000:1.0:1784093883.346072:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:44920:x1870757013729024:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093883.346467:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:44920:x1870757013729024:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 395us (519us total) trans 4294967547 rc 0/0 00000100:00100000:1.0:1784093883.346485:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 69 00000100:00100000:3.0:1784093883.768227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093883.768293:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729152 00000100:00100000:1.0:1784093883.768304:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729152 00000100:00100000:1.0:1784093883.768371:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 710 00000100:00100000:1.0:1784093883.768381:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013729152:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093883.768476:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013729152:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093883.768484:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 710 00000001:00080000:2.0:1784093883.779552:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967547 is committed 00010000:00010000:1.0:1784093883.881602:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093884.009536:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093884.009544:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093884.009548:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093884.009597:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.009608:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.009619:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093884.009670:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024260736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093884.009739:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093884.009808:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784093884.009898:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260736 00000100:00100000:1.0:1784093884.009905:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260736 00000100:00100000:1.0:1784093884.009956:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1784093884.009967:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024260736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093884.009981:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093884.009994:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca88b expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093884.010016:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca88b expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093884.010024:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca88b expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093884.010032:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13600, rc 0) 00000100:00100000:1.0:1784093884.010103:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024260736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093884.010109:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1784093884.010292:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024260736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093884.010306:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.010324:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093884.010345:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093884.010351:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.010358:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093884.199028:0:76793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1045276603756ns, next at 1042400808649ns, rc = 0 00000004:00080000:2.0:1784093884.199131:0:76793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045276708451ns, next at 1015775668712ns, rc = 0 00000004:00080000:0.0:1784093884.200010:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00000004:00080000:0.0:1784093884.200967:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000100:00100000:3.0:1784093884.394710:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024260864:0@lo:400:kworker.0 00000100:00100000:1.0:1784093884.394713:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024260992:0@lo:400:kworker.0 00000100:00100000:3.0:1784093884.394830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093884.394837:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024261248:0@lo:400:kworker.0 00000100:00100000:1.0:1784093884.394906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093884.394931:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024261376:0@lo:400:kworker.0 00000100:00100000:1.0:1784093884.394963:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784093884.394980:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024261120:0@lo:400:kworker.0 00000100:00100000:3.0:1784093884.394998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093884.395041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093884.395102:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260864 00000100:00100000:1.0:1784093884.395110:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260864 00000100:00100000:1.0:1784093884.395168:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024261248 00000100:00100000:1.0:1784093884.395172:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024261248 00000100:00100000:1.0:1784093884.395219:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1784093884.395235:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024260864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093884.395313:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024260864:12345-0@lo:400:kworker.0 Request processed in 86us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093884.395327:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1784093884.395354:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1784093884.395363:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093884.395409:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024261248:12345-0@lo:400:kworker.0 Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093884.395417:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1784093884.395497:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024261376 00000100:00100000:0.0:1784093884.395504:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024261376 00000100:00100000:0.0:1784093884.395556:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024261120 00000100:00100000:0.0:1784093884.395559:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024261120 00000100:00100000:0.0:1784093884.395606:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1784093884.395616:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024261376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093884.395699:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024261376:12345-0@lo:400:kworker.0 Request processed in 79us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.395718:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1784093884.395757:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1784093884.395769:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024261120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093884.395822:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024261120:12345-0@lo:400:kworker.0 Request processed in 55us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.395846:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1784093884.395936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784093884.395977:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093884.395991:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093884.395994:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024261504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093884.396014:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024260992 00000100:00100000:1.0:1784093884.396030:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024260992 00000100:00100000:0.0:1784093884.396031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093884.396076:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024261504 00000100:00100000:3.0:1784093884.396086:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024261504 00000100:00100000:1.0:1784093884.396105:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784093884.396121:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024260992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093884.396149:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1784093884.396166:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024261504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784093884.396196:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1784093884.396247:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024261120:0@lo:400:kworker.0 00000100:00100000:0.0:1784093884.396279:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024261248:0@lo:400:kworker.0 00000100:00100000:3.0:1784093884.396297:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024261504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093884.396305:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1784093884.396356:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024260864:0@lo:400:kworker.0 00000100:00100000:0.0:1784093884.396391:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024261376:0@lo:400:kworker.0 00000100:00100000:3.0:1784093884.396399:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024261504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093884.396400:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024260992:12345-0@lo:400:kworker.0 Request processed in 281us (463us total) trans 0 rc 0/0 00000100:00080000:0.0:1784093884.396498:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093884.396600:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1784093884.396871:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024260992:0@lo:400:kworker.0 00000001:00080000:0.0:1784093884.406966:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00000001:00080000:0.0:1784093884.406984:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000100:00100000:2.0:1784093884.676664:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093884.676722:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729280 00000100:00100000:0.0:1784093884.676733:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729280 00000100:00100000:0.0:1784093884.676803:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 653 00000100:00100000:0.0:1784093884.676816:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013729280:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093884.676924:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013729280:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.676937:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 653 00000100:00100000:3.0:1784093884.677660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093884.677699:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729408 00000100:00100000:0.0:1784093884.677705:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729408 00000100:00100000:0.0:1784093884.677749:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 323 00000100:00100000:0.0:1784093884.677759:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:45112:x1870757013729408:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093884.678085:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:45112:x1870757013729408:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 327us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.678110:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 323 00000100:00100000:3.0:1784093884.678709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093884.678749:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729536 00000100:00100000:2.0:1784093884.678761:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729536 00000100:00100000:2.0:1784093884.678799:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 324 00000100:00100000:2.0:1784093884.678809:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45112:x1870757013729536:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093884.679110:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45112:x1870757013729536:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 302us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093884.679118:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 324 00000100:00100000:3.0:1784093884.679879:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093884.679918:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729664 00000100:00100000:2.0:1784093884.679922:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729664 00000100:00100000:2.0:1784093884.679950:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:2.0:1784093884.679956:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013729664:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093884.680187:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013729664:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 230us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093884.680195:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:3.0:1784093884.681199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093884.681241:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729792 00000100:00100000:1.0:1784093884.681247:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729792 00000100:00100000:1.0:1784093884.681283:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 655 00000100:00100000:1.0:1784093884.681291:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013729792:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093884.681350:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013729792:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093884.681358:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 655 00000100:00100000:3.0:1784093884.681910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093884.681931:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013729920 00000100:00100000:0.0:1784093884.681938:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013729920 00000100:00100000:0.0:1784093884.681975:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 325 00000100:00100000:0.0:1784093884.681985:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:45112:x1870757013729920:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093884.682276:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:45112:x1870757013729920:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 292us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.682285:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 325 00000100:00100000:2.0:1784093884.682892:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093884.682930:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730048 00000100:00100000:0.0:1784093884.682935:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730048 00000100:00100000:0.0:1784093884.682969:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 326 00000100:00100000:0.0:1784093884.682978:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:45112:x1870757013730048:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093884.683248:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:45112:x1870757013730048:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 271us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.683256:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 326 00000100:00100000:1.0:1784093884.683831:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093884.683867:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730176 00000100:00100000:0.0:1784093884.683872:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730176 00000100:00100000:0.0:1784093884.683901:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 656 00000100:00100000:0.0:1784093884.683908:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013730176:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093884.684195:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:45112:x1870757013730176:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 286us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093884.684202:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 656 00000100:00100000:1.0:1784093884.705610:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093884.705660:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730432 00000100:00100000:2.0:1784093884.705670:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730432 00000100:00100000:2.0:1784093884.705724:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 657 00000100:00100000:2.0:1784093884.705735:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:45116:x1870757013730432:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784093884.705795:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093884.705821:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca86f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf586b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.705839:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff907219c12100) 00010000:00010000:2.0:1784093884.705850:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093884.705872:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.705896:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.705907:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.705921:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.705928:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.705934:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.706357:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.706366:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.706374:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784093884.707286:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9472 00000004:00080000:2.0:1784093884.707296:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045784873375ns, next at 1046784870769ns, rc = 0 00010000:00010000:2.0:1784093884.707383:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707393:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707411:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707419:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707450:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707457:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707475:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093884.707495:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093884.707495:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093884.707504:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707507:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707516:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093884.707533:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093884.707534:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093884.707538:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707540:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093884.707547:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707552:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093884.707571:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff90721a781c00) 00010000:00010000:0.0:1784093884.707574:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093884.707577:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 1/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707578:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff90721a781c00) 00010000:00010000:2.0:1784093884.707585:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093884.707586:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707597:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093884.707598:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093884.707601:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093884.707603:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093884.707609:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ca8a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707629:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707636:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707641:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707660:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093884.707663:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707668:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707676:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784093884.707679:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093884.707682:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093884.707687:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca899 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093884.707696:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000025e09fe5 reply state 000000006ab3934a transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093884.707717:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093884.707786:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:45116:x1870757013730432:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 2053us (2183us total) trans 4294967548 rc 0/0 00000100:00100000:2.0:1784093884.707794:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 657 00010000:00010000:3.0:1784093884.708556:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.708564:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.708568:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.708571:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093884.708573:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.708577:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.708584:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff90721a781900) 00010000:00010000:3.0:1784093884.708585:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093884.708587:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093884.708597:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ca8a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093884.905529:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784093885.403275:0:76939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046480850007ns, next at 1042400808649ns, rc = 0 00000004:00080000:3.0:1784093885.403378:0:76939:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046480955284ns, next at 1046784870769ns, rc = 0 00000001:00080000:2.0:1784093885.413461:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967548 is committed 00000004:00080000:2.0:1784093885.413473:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000004:00080000:2.0:1784093885.413496:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000100:00100000:3.0:1784093885.413597:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024261632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784093885.413689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093885.413734:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024261632 00000100:00100000:1.0:1784093885.413742:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024261632 00000100:00100000:1.0:1784093885.413789:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1784093885.413800:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024261632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784093885.413826:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:20 count 1 00010000:00010000:1.0:1784093885.413847:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.413868:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.413877:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784093885.413881:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093885.413886:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.413920:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.413936:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 5 pid: 53396 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093885.413949:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024261760:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784093885.414017:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208f6c180 going to sleep for 11 seconds 00000004:00080000:2.0:1784093885.414317:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00000100:00100000:2.0:1784093885.415126:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024261760:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093885.415146:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093885.415263:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093885.415312:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730560 00000100:00100000:1.0:1784093885.415316:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730560 00010000:00010000:1.0:1784093885.415357:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 6 pid: 53396 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784093885.415365:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093885.415385:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 270 00000100:00100000:1.0:1784093885.415393:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013730560:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093885.415401:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093885.415405:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 6 pid: 53396 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415414:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 6 pid: 53396 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415462:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214ca87d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5872 expref: 6 pid: 53396 timeout: 1146 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415486:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093885.415498:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093885.415507:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415517:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415537:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093885.415552:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093885.415564:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093885.415572:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013730560:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 179us (307us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093885.415577:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093885.415582:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 270 00010000:00010000:2.0:1784093885.415593:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093885.415615:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093885.415622:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093885.415628:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415645:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093885.415649:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415655:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415665:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415678:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdec3f9d/0x9ce98053214ca8b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093885.415691:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093885.415693:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093885.415695:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093885.416100:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024261632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2301us (2409us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1784093885.416108:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000004:00080000:3.0:1784093885.416135:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723e26d180/2, rc 0, transno 4294967337 00000100:00100000:3.0:1784093885.416149:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024261632:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784093885.929592:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093886.441860:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024261888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093886.441925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093886.441975:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024261888 00000100:00100000:2.0:1784093886.441982:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024261888 00000100:00080000:1.0:1784093886.442043:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093886.442053:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784093886.442061:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024261888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093886.442091:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093886.442147:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024261888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093886.442155:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1784093886.442183:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:0.0:1784093886.442189:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907101252d80, transno 4294967337 00000100:00100000:0.0:1784093886.442218:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024261888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093886.953587:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093887.977563:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093888.888505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093888.888546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093888.888590:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730816 00000100:00100000:1.0:1784093888.888598:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093888.888603:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730816 00000100:00100000:0.0:1784093888.888634:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730688 00000100:00100000:0.0:1784093888.888640:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730688 00000100:00100000:3.0:1784093888.888655:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013730944 00000100:00100000:3.0:1784093888.888662:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013730944 00000100:00100000:2.0:1784093888.888674:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:0.0:1784093888.888684:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 712 00000100:00100000:1.0:1784093888.888685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093888.888691:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013730816:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093888.888700:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013730688:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093888.888710:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731072 00000100:00100000:3.0:1784093888.888717:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731072 00000100:00080000:1.0:1784093888.888720:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093888.888726:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093888.888729:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093888.888753:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:1.0:1784093888.888763:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013730944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093888.888775:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013730688:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093888.888778:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013730816:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093888.888795:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 492 00000100:00100000:2.0:1784093888.888795:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:0.0:1784093888.888795:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 712 00000100:00100000:1.0:1784093888.888804:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013730944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093888.888811:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013731072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093888.888820:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:3.0:1784093888.888850:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013731072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093888.888859:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 492 00010000:00010000:1.0:1784093889.001587:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093889.513635:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024262016:0@lo:400:kworker.0 00000100:00100000:1.0:1784093889.513635:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024262144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093889.513643:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024262272:0@lo:400:kworker.0 00000100:00100000:3.0:1784093889.513676:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024262400:0@lo:400:kworker.0 00000100:00100000:2.0:1784093889.513709:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093889.513709:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093889.513715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093889.513738:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262144 00000100:00100000:3.0:1784093889.513746:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262144 00000100:00100000:2.0:1784093889.513774:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024262528:0@lo:400:kworker.0 00000100:00100000:1.0:1784093889.513774:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024262656:0@lo:400:kworker.0 00000100:00100000:0.0:1784093889.513774:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024262784:0@lo:400:kworker.0 00000100:00100000:3.0:1784093889.513803:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784093889.513816:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024262144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093889.513822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093889.513825:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1784093889.513859:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1784093889.513866:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262784 00000100:00100000:2.0:1784093889.513872:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262784 00000100:00100000:0.0:1784093889.513878:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262272 00000100:00100000:0.0:1784093889.513884:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262272 00000100:00100000:1.0:1784093889.513888:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262016 00000100:00100000:1.0:1784093889.513893:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262016 00000100:00100000:2.0:1784093889.513908:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1784093889.513916:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1870757024262784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093889.513931:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1870757024262144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093889.513931:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262656 00000100:00100000:1.0:1784093889.513932:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1784093889.513938:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262656 00000100:00100000:1.0:1784093889.513944:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024262016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093889.513945:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1784093889.513961:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024262784:12345-0@lo:400:kworker.0 Request processed in 45us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093889.513976:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1784093889.513976:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1784093889.513981:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024262016:12345-0@lo:400:kworker.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093889.513987:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1784093889.513992:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024262272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093889.514000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093889.514009:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1784093889.514017:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024262656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093889.514029:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093889.514034:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093889.514048:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024262016:0@lo:400:kworker.0 00000100:00100000:1.0:1784093889.514048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093889.514054:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024262272:12345-0@lo:400:kworker.0 Request processed in 64us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093889.514062:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024262656:12345-0@lo:400:kworker.0 Request processed in 44us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093889.514069:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1784093889.514076:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1784093889.514092:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262400 00000100:00100000:1.0:1784093889.514093:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262528 00000100:00100000:0.0:1784093889.514098:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262400 00000100:00100000:1.0:1784093889.514100:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262528 00000100:00100000:3.0:1784093889.514125:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024262784:0@lo:400:kworker.0 00000100:00100000:0.0:1784093889.514144:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1784093889.514149:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024262272:0@lo:400:kworker.0 00000100:00100000:1.0:1784093889.514154:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1784093889.514158:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024262400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093889.514167:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024262528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093889.514212:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024262400:12345-0@lo:400:kworker.0 Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093889.514219:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024262528:12345-0@lo:400:kworker.0 Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093889.514222:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1784093889.514232:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1784093889.514245:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024262400:0@lo:400:kworker.0 00000100:00080000:1.0:1784093889.514252:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093889.514257:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093889.514260:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024262528:0@lo:400:kworker.0 00000100:00100000:0.0:1784093889.514283:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024262656:0@lo:400:kworker.0 00000100:00100000:0.0:1784093889.514300:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024262144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784093890.025632:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093890.034809:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00010000:00010000:0.0:1784093891.049568:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093891.561611:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024262912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093891.561675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093891.561713:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024262912 00000100:00100000:2.0:1784093891.561720:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024262912 00000100:00080000:3.0:1784093891.561767:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093891.561777:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784093891.561785:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024262912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093891.561811:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093891.561858:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024262912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093891.561862:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1784093891.561907:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024262912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093892.073574:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093893.097612:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093894.008486:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093894.008519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093894.008539:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731328 00000100:00100000:3.0:1784093894.008546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093894.008549:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731328 00000100:00100000:0.0:1784093894.008555:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731200 00000100:00100000:0.0:1784093894.008561:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731200 00000100:00100000:3.0:1784093894.008587:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093894.008607:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731584 00000100:00080000:3.0:1784093894.008610:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093894.008613:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731584 00000100:00100000:0.0:1784093894.008621:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 714 00000100:00100000:3.0:1784093894.008626:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731456 00000100:00100000:1.0:1784093894.008630:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:3.0:1784093894.008632:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731456 00000100:00100000:0.0:1784093894.008633:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013731200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093894.008644:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013731328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093894.008659:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 495 00000100:00100000:3.0:1784093894.008671:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 496 00000100:00100000:2.0:1784093894.008673:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013731584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093894.008686:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013731456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093894.008706:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013731200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093894.008708:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013731328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093894.008710:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013731584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093894.008718:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 714 00000100:00100000:2.0:1784093894.008725:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 495 00000100:00100000:1.0:1784093894.008729:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:3.0:1784093894.008733:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013731456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093894.008742:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 496 00000100:00080000:2.0:1784093894.008757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093894.008762:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784093894.121591:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093894.633675:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024263296:0@lo:400:kworker.0 00000100:00100000:1.0:1784093894.633675:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024263424:0@lo:400:kworker.0 00000100:00100000:2.0:1784093894.633697:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024263040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093894.633752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093894.633763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093894.633782:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263296 00000100:00100000:1.0:1784093894.633789:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263296 00000100:00100000:0.0:1784093894.633801:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024263168:0@lo:400:kworker.0 00000100:00100000:1.0:1784093894.633834:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1784093894.633841:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024263296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093894.634365:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024263808:0@lo:400:kworker.0 00000100:00100000:2.0:1784093894.634370:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024263552:0@lo:400:kworker.0 00000100:00100000:3.0:1784093894.634404:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093894.634474:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263040 00000100:00100000:2.0:1784093894.634478:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263040 00000100:00100000:3.0:1784093894.634497:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263808 00000100:00100000:3.0:1784093894.634503:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263808 00000100:00100000:2.0:1784093894.634524:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1784093894.634533:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024263040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093894.634542:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1784093894.634552:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024263808:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784093894.634560:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093894.634596:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024263808:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093894.634605:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1784093894.634610:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024263040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093894.634618:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784093894.634630:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784093894.634640:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093894.634654:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263552 00000100:00100000:2.0:1784093894.634657:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263552 00000100:00100000:3.0:1784093894.634674:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:3.0:1784093894.634679:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723e26d180, transno 4294967337 00000100:00100000:2.0:1784093894.634688:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1784093894.634695:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024263552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093894.634700:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024263040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093894.634735:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024263808:0@lo:400:kworker.0 00000100:00100000:2.0:1784093894.634741:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024263552:12345-0@lo:400:kworker.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093894.634749:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00080000:3.0:1784093894.634764:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093894.634778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093894.634794:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024263552:0@lo:400:kworker.0 00000100:00100000:2.0:1784093894.634830:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263424 00000100:00100000:2.0:1784093894.634833:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263424 00000100:00100000:2.0:1784093894.634861:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1784093894.634869:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093894.634906:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024263424:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093894.634912:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00080000:2.0:1784093894.634939:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093894.634957:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024263424:0@lo:400:kworker.0 00000100:00100000:0.0:1784093894.635041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093894.635075:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024263680:0@lo:400:kworker.0 00000100:00100000:0.0:1784093894.635104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093894.635134:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024263296:12345-0@lo:400:kworker.0 Request processed in 1291us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093894.635141:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1784093894.635141:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263680 00000100:00100000:0.0:1784093894.635145:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263680 00000100:00100000:0.0:1784093894.635183:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1784093894.635191:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024263680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093894.635199:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024263296:0@lo:400:kworker.0 00000100:00100000:2.0:1784093894.635289:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263168 00000100:00100000:2.0:1784093894.635293:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263168 00000100:00100000:2.0:1784093894.635322:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1784093894.635328:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024263168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093894.635370:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093894.635379:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024263680:12345-0@lo:400:kworker.0 Request processed in 188us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093894.635386:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1784093894.635446:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024263168:12345-0@lo:400:kworker.0 Request processed in 117us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093894.635452:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1784093894.635515:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024263680:0@lo:400:kworker.0 00000100:00100000:1.0:1784093894.635526:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024263168:0@lo:400:kworker.0 00010000:00010000:0.0:1784093895.146498:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093896.169632:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093896.681654:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024263936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093896.681725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093896.681780:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024263936 00000100:00100000:2.0:1784093896.681788:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024263936 00000100:00100000:2.0:1784093896.681849:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00080000:0.0:1784093896.681857:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093896.681867:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024263936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093896.681905:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093896.681951:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024263936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093896.681959:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1784093896.681985:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024263936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093897.193606:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093898.217571:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093899.128385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093899.128453:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731712 00000100:00100000:2.0:1784093899.128457:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093899.128462:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731712 00000100:00100000:2.0:1784093899.128492:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093899.128513:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 716 00000100:00100000:0.0:1784093899.128520:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731840 00000100:00100000:1.0:1784093899.128527:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013731712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093899.128527:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731840 00000100:00100000:2.0:1784093899.128557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093899.128580:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:0.0:1784093899.128591:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013731840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093899.128595:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013731712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093899.128604:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 716 00000100:00100000:0.0:1784093899.128638:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013731840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00080000:1.0:1784093899.128644:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093899.128661:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:3.0:1784093899.128742:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013731968 00000100:00100000:0.0:1784093899.128742:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732096 00000100:00100000:0.0:1784093899.128746:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732096 00000100:00100000:3.0:1784093899.128753:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013731968 00000100:00080000:1.0:1784093899.128781:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093899.128785:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093899.128792:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:0.0:1784093899.128801:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013732096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093899.128836:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013732096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093899.128843:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:0.0:1784093899.128862:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 500 00000100:00100000:0.0:1784093899.128869:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013731968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093899.128896:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013731968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093899.128904:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 500 00010000:00010000:0.0:1784093899.241570:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093899.753639:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024264192:0@lo:400:kworker.0 00000100:00100000:1.0:1784093899.753659:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024264320:0@lo:400:kworker.0 00000100:00100000:0.0:1784093899.753662:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024264448:0@lo:400:kworker.0 00000100:00100000:2.0:1784093899.753697:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024264576:0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.753721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093899.753722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093899.753747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093899.753764:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264448 00000100:00100000:1.0:1784093899.753773:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264448 00000100:00100000:3.0:1784093899.753790:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024264064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093899.753820:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264576 00000100:00100000:0.0:1784093899.753822:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264192 00000100:00100000:3.0:1784093899.753826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093899.753826:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264576 00000100:00100000:0.0:1784093899.753835:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264192 00000100:00100000:1.0:1784093899.753837:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784093899.753850:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.753860:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024264704:0@lo:400:kworker.0 00000100:00100000:0.0:1784093899.753875:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1784093899.753885:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.753904:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093899.753929:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024264448:12345-0@lo:400:kworker.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093899.753938:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1784093899.753952:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024264192:12345-0@lo:400:kworker.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093899.753953:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024264192:0@lo:400:kworker.0 00000100:00100000:1.0:1784093899.753955:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264704 00000100:00100000:1.0:1784093899.753961:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264704 00000100:00100000:0.0:1784093899.753967:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784093899.753981:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093899.753991:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024264832:0@lo:400:kworker.0 00000100:00100000:1.0:1784093899.753994:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1784093899.754004:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024264704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093899.754010:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093899.754027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093899.754060:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024264704:12345-0@lo:400:kworker.0 Request processed in 56us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093899.754067:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1784093899.754069:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264832 00000100:00100000:2.0:1784093899.754074:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264832 00000100:00100000:3.0:1784093899.754078:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024264704:0@lo:400:kworker.0 00000100:00100000:0.0:1784093899.754079:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264320 00000100:00100000:0.0:1784093899.754086:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264320 00000100:00100000:1.0:1784093899.754099:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1784093899.754110:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024264576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.754128:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1784093899.754128:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1784093899.754138:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024264832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.754144:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024264320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093899.754155:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024264576:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093899.754163:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00080000:0.0:1784093899.754164:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093899.754170:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093899.754175:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093899.754190:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024264832:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093899.754198:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1784093899.754206:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024264448:0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.754213:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024264320:12345-0@lo:400:kworker.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093899.754219:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1784093899.754229:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264064 00000100:00100000:0.0:1784093899.754235:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264064 00000100:00100000:2.0:1784093899.754241:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024264576:0@lo:400:kworker.0 00000100:00100000:1.0:1784093899.754260:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024264832:0@lo:400:kworker.0 00000100:00100000:3.0:1784093899.754266:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024264320:0@lo:400:kworker.0 00000100:00100000:0.0:1784093899.754272:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1784093899.754284:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024264064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093899.754310:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093899.754354:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024264064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093899.754374:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1784093899.754405:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024264064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784093900.265565:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093901.289604:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093901.801625:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024264960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093901.801691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093901.801739:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024264960 00000100:00100000:2.0:1784093901.801747:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024264960 00000100:00080000:0.0:1784093901.801778:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093901.801801:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1784093901.801812:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024264960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093901.801844:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093901.801896:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024264960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093901.801904:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784093901.801938:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024264960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093902.313576:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093903.337552:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093904.248223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093904.248254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093904.248271:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732224 00000100:00100000:1.0:1784093904.248293:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732224 00000100:00100000:0.0:1784093904.248314:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732352 00000100:00100000:0.0:1784093904.248320:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732352 00000100:00100000:1.0:1784093904.248348:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 718 00000100:00100000:1.0:1784093904.248360:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013732224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093904.248378:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 707 00000100:00100000:0.0:1784093904.248390:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013732352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093904.248449:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013732224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093904.248460:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 718 00000100:00100000:0.0:1784093904.248461:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013732352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093904.248471:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093904.248473:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 707 00000100:00100000:1.0:1784093904.250417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093904.250456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093904.250470:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732480 00000100:00100000:0.0:1784093904.250481:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732480 00000100:00100000:2.0:1784093904.250504:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732608 00000100:00100000:2.0:1784093904.250510:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732608 00000100:00080000:3.0:1784093904.250527:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093904.250532:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 328 00000100:00080000:3.0:1784093904.250533:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093904.250544:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013732480:12345-192.168.204.57@tcp:9:kworker.0 00000100:00100000:1.0:1784093904.250558:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:1.0:1784093904.250568:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013732608:12345-192.168.204.57@tcp:400:kworker.0 00000020:00000080:0.0:1784093904.250568:0:8031:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214ca6fc 00000100:00080000:0.0:1784093904.250585:0:8031:0:(import.c:65:import_set_state_nolock()) ffff907102745000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784093904.250603:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013732608:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093904.250609:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 503 00010000:00010000:2.0:1784093904.250628:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784093904.250629:0:8031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:0.0:1784093904.250804:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013732480:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 262us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093904.250812:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 328 00010000:00010000:3.0:1784093904.361560:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093904.873558:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024265216:0@lo:400:kworker.0 00000100:00100000:3.0:1784093904.873565:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024265088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093904.873571:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024265472:0@lo:400:kworker.0 00000100:00100000:2.0:1784093904.873584:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024265344:0@lo:400:kworker.0 00000100:00100000:3.0:1784093904.873636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093904.873637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093904.873642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093904.873677:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265088 00000100:00100000:2.0:1784093904.873683:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265088 00000100:00100000:3.0:1784093904.873687:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024265600:0@lo:400:kworker.0 00000100:00100000:1.0:1784093904.873702:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024265728:0@lo:400:kworker.0 00000100:00100000:0.0:1784093904.873712:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265472 00000100:00100000:3.0:1784093904.873716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093904.873719:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265472 00000100:00100000:1.0:1784093904.873729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093904.873742:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00080000:3.0:1784093904.873755:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093904.873758:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024265088:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784093904.873762:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093904.873763:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265728 00000100:00100000:0.0:1784093904.873768:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265728 00000100:00100000:1.0:1784093904.873770:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265216 00000100:00100000:1.0:1784093904.873775:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265216 00000100:00100000:3.0:1784093904.873789:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00002000:00000024:2.0:1784093904.873796:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093904.873801:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024265472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093904.873810:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1784093904.873816:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1784093904.873821:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024265728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093904.873840:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024265216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093904.873849:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024265088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093904.873860:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024265472:12345-0@lo:400:kworker.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093904.873860:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784093904.873878:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024265728:12345-0@lo:400:kworker.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093904.873879:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1784093904.873886:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024265216:12345-0@lo:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093904.873893:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1784093904.873899:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265600 00000100:00100000:1.0:1784093904.873899:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00080000:3.0:1784093904.873903:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093904.873904:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265600 00000100:00100000:3.0:1784093904.873941:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024265088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093904.873946:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1784093904.873951:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024265728:0@lo:400:kworker.0 00000100:00100000:2.0:1784093904.873956:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024265600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093904.873966:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024265216:0@lo:400:kworker.0 00000100:00080000:3.0:1784093904.873971:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093904.873989:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024265472:0@lo:400:kworker.0 00000100:00100000:3.0:1784093904.873999:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093904.873999:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024265600:12345-0@lo:400:kworker.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093904.874007:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1784093904.874023:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024265856:0@lo:400:kworker.0 00000100:00100000:1.0:1784093904.874030:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265344 00000100:00100000:1.0:1784093904.874034:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265344 00000100:00100000:2.0:1784093904.874045:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024265600:0@lo:400:kworker.0 00000100:00100000:3.0:1784093904.874046:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093904.874072:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1784093904.874080:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024265344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093904.874091:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265856 00000100:00100000:0.0:1784093904.874097:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265856 00000100:00100000:2.0:1784093904.874113:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024265344:12345-0@lo:400:kworker.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093904.874118:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1784093904.874131:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1784093904.874142:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024265856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093904.874146:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024265344:0@lo:400:kworker.0 00000100:00100000:0.0:1784093904.874188:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024265856:12345-0@lo:400:kworker.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093904.874196:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024265856:0@lo:400:kworker.0 00000100:00100000:0.0:1784093904.874197:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1784093905.361297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093905.361361:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732736 00000100:00100000:3.0:1784093905.361374:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732736 00000100:00100000:3.0:1784093905.361468:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 658 00000100:00100000:3.0:1784093905.361477:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013732736:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093905.361585:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013732736:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 109us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093905.361606:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 658 00000100:00100000:2.0:1784093905.362466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093905.362506:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732864 00000100:00100000:0.0:1784093905.362511:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732864 00000100:00100000:0.0:1784093905.362533:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 329 00000100:00100000:0.0:1784093905.362544:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1870757013732864:12345-192.168.204.57@tcp:8:lfs.60003 00010000:00080000:0.0:1784093905.362569:0:8031:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 1066 last 0 00000020:00000080:0.0:1784093905.362597:0:8031:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214ca8bc 00002000:00100000:0.0:1784093905.362616:0:8031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff907102045000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784093905.362640:0:8031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784093905.362728:0:8031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784093905.362759:0:8031:0:(import.c:65:import_set_state_nolock()) ffff907102044800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784093905.362791:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013732864:12345-192.168.204.57@tcp:8:lfs.60003 Request processed in 248us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093905.362798:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 329 00000100:00100000:0.0:1784093905.363503:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093905.363555:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013732992 00000100:00100000:2.0:1784093905.363561:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013732992 00000100:00100000:2.0:1784093905.363612:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:2.0:1784093905.363621:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013732992:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:3.0:1784093905.363622:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093905.363953:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013732992:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 332us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093905.363961:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:1.0:1784093905.364933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093905.364977:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733120 00000100:00100000:0.0:1784093905.364982:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733120 00000100:00100000:0.0:1784093905.365009:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 331 00000100:00100000:0.0:1784093905.365015:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:45534:x1870757013733120:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093905.365213:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:45534:x1870757013733120:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 198us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093905.365218:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 331 00000100:00100000:0.0:1784093905.365936:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093905.365979:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733248 00000100:00100000:2.0:1784093905.365984:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733248 00000100:00100000:2.0:1784093905.366010:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 659 00000100:00100000:2.0:1784093905.366015:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733248:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093905.366276:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733248:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 258us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093905.366291:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 659 00000100:00100000:3.0:1784093905.367542:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093905.367585:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733376 00000100:00100000:2.0:1784093905.367590:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733376 00000100:00100000:2.0:1784093905.367617:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 660 00000100:00100000:2.0:1784093905.367625:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733376:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093905.367690:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733376:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093905.367698:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 660 00000100:00100000:1.0:1784093905.368306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093905.368352:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733504 00000100:00100000:0.0:1784093905.368357:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733504 00000100:00100000:0.0:1784093905.368387:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 332 00000100:00100000:0.0:1784093905.368396:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733504:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093905.368626:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733504:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 230us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093905.368642:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 332 00000100:00100000:0.0:1784093905.369208:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093905.369249:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733632 00000100:00100000:2.0:1784093905.369253:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733632 00000100:00100000:2.0:1784093905.369296:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 333 00000100:00100000:2.0:1784093905.369305:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:45534:x1870757013733632:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093905.369541:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:45534:x1870757013733632:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 236us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093905.369549:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 333 00000100:00100000:3.0:1784093905.370144:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093905.370186:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733760 00000100:00100000:0.0:1784093905.370191:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733760 00000100:00100000:0.0:1784093905.370219:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 661 00000100:00100000:0.0:1784093905.370226:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733760:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093905.370526:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:45534:x1870757013733760:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 299us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093905.370534:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 661 00000100:00100000:1.0:1784093905.380384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093905.380453:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013733888 00000100:00100000:2.0:1784093905.380462:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013733888 00000100:00100000:2.0:1784093905.380518:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 662 00000100:00100000:2.0:1784093905.380529:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:45535:x1870757013733888:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093905.380551:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093905.380573:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca8c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5879 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.380635:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.380663:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.380678:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093905.380851:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00000004:00200000:2.0:1784093905.380855:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093905.380911:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.380934:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ca8c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5879 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.380959:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5879 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.380966:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784093905.380968:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093905.380971:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784093905.381018:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:45535:x1870757013733888:12345-192.168.204.57@tcp:101:rm.0 Request processed in 492us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093905.381025:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 662 00000100:00100000:2.0:1784093905.382041:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093905.382089:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013734144 00000100:00100000:0.0:1784093905.382095:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013734144 00000100:00100000:0.0:1784093905.382133:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 663 00000100:00100000:0.0:1784093905.382142:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:45535:x1870757013734144:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093905.382152:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093905.382166:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca8d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5880 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093905.382317:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 7680 00010000:00010000:0.0:1784093905.382572:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca8d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5880 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093905.382585:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784093905.382588:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784093905.382593:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ca8d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5880 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093905.382617:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784093905.382652:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:45535:x1870757013734144:12345-192.168.204.57@tcp:101:rm.0 Request processed in 511us (611us total) trans 4294967549 rc 301/301 00000100:00100000:0.0:1784093905.382659:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 663 00000100:00100000:3.0:1784093905.383973:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093905.384014:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013734272 00000100:00100000:2.0:1784093905.384021:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013734272 00000100:00100000:2.0:1784093905.384059:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 70 00000100:00100000:2.0:1784093905.384065:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:45535:x1870757013734272:12345-192.168.204.57@tcp:37:rm.0 00010000:00010000:0.0:1784093905.385549:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093905.386222:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:45535:x1870757013734272:12345-192.168.204.57@tcp:37:rm.0 Request processed in 2150us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093905.386235:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 70 00000100:00100000:0.0:1784093905.387756:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093905.387805:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013734528 00000100:00100000:1.0:1784093905.387815:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013734528 00000100:00100000:1.0:1784093905.387872:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 71 00000100:00100000:1.0:1784093905.387884:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:45535:x1870757013734528:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:1.0:1784093905.388497:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:45535:x1870757013734528:12345-192.168.204.57@tcp:35:rm.0 Request processed in 615us (743us total) trans 4294967550 rc 0/0 00000100:00100000:1.0:1784093905.388504:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 71 00000100:00100000:0.0:1784093905.389544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093905.389583:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013734784 00000100:00100000:1.0:1784093905.389589:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013734784 00000100:00100000:1.0:1784093905.389623:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 664 00000100:00100000:1.0:1784093905.389631:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:45535:x1870757013734784:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093905.389683:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784093905.389722:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ca8ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5879 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389748:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5864 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389767:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca4f6) 00010000:00010000:1.0:1784093905.389772:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093905.389784:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093905.389812:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389826:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389839:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389856:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389864:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.389871:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390265:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390280:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390286:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390591:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390601:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390607:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390613:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093905.390617:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390623:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390633:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093905.390636:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093905.390638:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390643:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214ca8ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390661:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390671:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390675:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390679:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093905.390682:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390687:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390694:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784093905.390696:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093905.390698:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390703:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ca8df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390722:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390729:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390735:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390741:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093905.390751:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390758:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390765:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff907219c12400) 00010000:00010000:1.0:1784093905.390767:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093905.390769:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.390774:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ca8e6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093905.390846:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:45535:x1870757013734784:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1213us (1299us total) trans 0 rc -13/-13 00000100:00100000:1.0:1784093905.390855:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 664 00000001:00100000:2.0:1784093905.393831:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000001:00100000:2.0:1784093905.393847:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784093905.393851:0:6598:0:(genops.c:906:class_export_put()) final put ffff907102746000/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:0.0:1784093905.393901:0:73479:0:(genops.c:865:class_export_destroy()) destroying export ffff907102746000/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0000 00000020:00000080:0.0:1784093905.393948:0:73479:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907102745000 for lustre-OST0000 00000001:00080000:2.0:1784093905.906440:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967549 is committed 00000001:00080000:2.0:1784093905.906456:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967550 is committed 00000020:00000080:2.0:1784093905.932465:0:77403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb95d7900 20000000:00000080:2.0:1784093905.932481:0:77403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df0000 uarg=0000000000000000 00010000:00010000:2.0:1784093905.934577:0:77403:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093905.934591:0:77403:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093905.934623:0:77403:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093905.934639:0:77403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.934654:0:77403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca88b expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.934660:0:77403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.934689:0:77403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca88b expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.934698:0:77403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca88b expref: 18 pid: 5770 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093905.934709:0:77403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f11c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77403:1870757024265984:0@lo:104: 00000100:00100000:2.0:1784093905.934753:0:77403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093905.934789:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024265984 00000100:00100000:2.0:1784093905.934791:0:77403:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379aff00 going to sleep for 11 seconds 00000100:00100000:1.0:1784093905.934795:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024265984 00000100:00100000:1.0:1784093905.934831:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784093905.934837:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:77403:x1870757024265984:12345-0@lo:104: 00010000:00010000:1.0:1784093905.934847:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.934898:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093905.934904:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:77403:x1870757024265984:12345-0@lo:104: Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093905.934912:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784093905.934921:0:77403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f11c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77403:1870757024265984:0@lo:104: 00010000:00010000:0.0:1784093905.934931:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093905.934939:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.934946:0:77403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093905.934949:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093905.934956:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093905.934966:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093905.934975:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093905.934981:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093905.935011:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093905.935020:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093905.935061:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093905.935069:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214ca88b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca892 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093905.935078:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024266112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093905.935084:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093905.935096:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093905.935099:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093905.935103:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093905.935140:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266112 00000100:00100000:1.0:1784093905.935145:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266112 00010000:00010000:1.0:1784093905.935174:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca88b expref: 19 pid: 5770 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093905.935197:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784093905.935207:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024266112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093905.935217:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093905.935222:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca88b expref: 19 pid: 5770 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935232:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca88b expref: 19 pid: 5770 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935255:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214ca892 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca88b expref: 19 pid: 5770 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935269:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935276:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935287:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935293:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935300:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935306:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935317:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093905.935321:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935328:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935344:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093905.935353:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093905.935367:0:77403:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.935375:0:77403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093905.935379:0:77403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214ca8f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093905.935388:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024266112:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093905.935396:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784093905.935415:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024266112:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784093906.221875:0:77451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff07bc3950 20000000:00000080:3.0:1784093906.221895:0:77451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d997c00 uarg=0000000000000000 00010000:00010000:3.0:1784093906.222112:0:77451:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093906.222124:0:77451:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093906.222141:0:77451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093906.222158:0:77451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222173:0:77451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222182:0:77451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222187:0:77451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222192:0:77451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222196:0:77451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222201:0:77451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093906.222204:0:77451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222215:0:77451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222227:0:77451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222232:0:77451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093906.222237:0:77451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca8fb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093906.409547:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093906.504486:0:77499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2f607a40 20000000:00000080:0.0:1784093906.504503:0:77499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df4000 uarg=0000000000000000 00010000:00010000:0.0:1784093906.504753:0:77499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093906.504770:0:77499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093906.504788:0:77499:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093906.504812:0:77499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504830:0:77499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504840:0:77499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504844:0:77499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504849:0:77499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504854:0:77499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504864:0:77499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093906.504868:0:77499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504875:0:77499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504886:0:77499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504892:0:77499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093906.504896:0:77499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca902 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093906.921650:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024266240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093906.921722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093906.921787:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266240 00000100:00100000:2.0:1784093906.921800:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266240 00000100:00080000:3.0:1784093906.921868:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093906.921908:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784093906.921923:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024266240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784093906.921956:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093906.922049:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024266240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093906.922058:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784093906.922144:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024266240:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784093907.241481:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093907.241487:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093907.241490:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093907.241525:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.241536:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.241547:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093907.241574:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024266368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093907.241639:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093907.241700:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266368 00000100:00100000:1.0:1784093907.241707:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266368 00000100:00100000:3.0:1784093907.241712:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907101b10c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784093907.241748:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1784093907.241757:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024266368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093907.241771:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093907.241785:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca909 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093907.241809:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca909 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093907.241819:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca909 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093907.241827:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13600, rc 0) 00000100:00100000:1.0:1784093907.241882:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024266368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093907.241888:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1784093907.241922:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024266368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093907.241937:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.241946:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093907.241962:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093907.241967:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.241972:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.434589:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093907.763981:0:77695:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeaa612ad0 20000000:00000080:0.0:1784093907.763997:0:77695:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e230800 uarg=0000000000000000 00010000:00010000:0.0:1784093907.764245:0:77695:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093907.764257:0:77695:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093907.764273:0:77695:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093907.764293:0:77695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.764308:0:77695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca909 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.764315:0:77695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.764372:0:77695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca909 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.764388:0:77695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca909 expref: 18 pid: 5772 timeout: 1218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093907.764406:0:77695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77695:1870757024266496:0@lo:104: 00000100:00100000:0.0:1784093907.764512:0:77695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093907.764572:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266496 00000100:00100000:0.0:1784093907.764575:0:77695:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093907.764580:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266496 00000100:00100000:2.0:1784093907.764638:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1784093907.764649:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:77695:x1870757024266496:12345-0@lo:104: 00010000:00010000:2.0:1784093907.764669:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093907.764729:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093907.764737:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:77695:x1870757024266496:12345-0@lo:104: Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093907.764748:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784093907.764748:0:77695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77695:1870757024266496:0@lo:104: 00010000:00010000:3.0:1784093907.764756:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093907.764766:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.764774:0:77695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.764779:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093907.764786:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.764797:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093907.764805:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093907.764824:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093907.764864:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.764871:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093907.764904:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.764911:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ca909 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca910 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093907.764931:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024266624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093907.764938:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093907.764942:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093907.764945:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093907.764966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093907.765003:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266624 00000100:00100000:3.0:1784093907.765009:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266624 00010000:00010000:3.0:1784093907.765042:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca909 expref: 19 pid: 5772 timeout: 1218 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093907.765077:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784093907.765086:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024266624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093907.765099:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093907.765105:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca909 expref: 19 pid: 5772 timeout: 1218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765117:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca909 expref: 19 pid: 5772 timeout: 1218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765130:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214ca910 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca909 expref: 19 pid: 5772 timeout: 1218 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765151:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765159:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765173:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765188:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765195:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765202:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765220:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093907.765226:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765234:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765250:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093907.765260:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093907.765271:0:77695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.765280:0:77695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093907.765286:0:77695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214ca917 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093907.765300:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024266624:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093907.765312:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1784093907.765332:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024266624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093908.458537:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784093909.033476:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093909.033483:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093909.033495:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093909.033536:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093909.033548:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093909.033567:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093909.033594:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024266752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093909.033645:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093909.033705:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266752 00000100:00100000:0.0:1784093909.033711:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784093909.033714:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266752 00000100:00100000:1.0:1784093909.033773:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1784093909.033783:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024266752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093909.033799:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093909.033812:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca91e expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093909.033834:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca91e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093909.033846:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca91e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093909.033855:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784093909.033897:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024266752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093909.033904:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1784093909.033935:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024266752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093909.033951:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093909.033959:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093909.033977:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093909.033982:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093909.033988:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093909.368171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093909.368222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093909.368252:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013734912 00000100:00100000:3.0:1784093909.368253:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093909.368266:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013734912 00000100:00100000:2.0:1784093909.368270:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735040 00000100:00100000:2.0:1784093909.368279:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735040 00000100:00100000:3.0:1784093909.368294:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093909.368324:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 722 00000100:00080000:3.0:1784093909.368325:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093909.368329:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735296 00000100:00100000:1.0:1784093909.368337:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013734912:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093909.368338:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735296 00000100:00100000:2.0:1784093909.368343:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 711 00000100:00100000:2.0:1784093909.368356:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013735040:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093909.368371:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735168 00000100:00100000:3.0:1784093909.368377:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735168 00000100:00100000:0.0:1784093909.368386:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 506 00000100:00100000:0.0:1784093909.368398:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013735296:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093909.368416:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013734912:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093909.368446:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 507 00000100:00100000:2.0:1784093909.368450:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013735040:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 66us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093909.368458:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013735168:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093909.368459:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 722 00000100:00100000:0.0:1784093909.368464:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013735296:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093909.368469:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 711 00000100:00100000:0.0:1784093909.368490:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 506 00000100:00100000:3.0:1784093909.368505:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013735168:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (210us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093909.368510:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093909.368515:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 507 00000100:00080000:2.0:1784093909.368516:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784093909.481599:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093909.993544:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024266880:0@lo:400:kworker.0 00000100:00100000:1.0:1784093909.993563:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024267264:0@lo:400:kworker.0 00000100:00100000:2.0:1784093909.993591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024267136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093909.993603:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024267008:0@lo:400:kworker.0 00000100:00100000:3.0:1784093909.993616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093909.993627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093909.993655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093909.993689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093909.993693:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024267392:0@lo:400:kworker.0 00000100:00100000:2.0:1784093909.993694:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024267648:0@lo:400:kworker.0 00000100:00100000:1.0:1784093909.993728:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267264 00000100:00100000:1.0:1784093909.993737:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267264 00000100:00100000:3.0:1784093909.993744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093909.993754:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267136 00000100:00100000:2.0:1784093909.993762:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267136 00000100:00100000:0.0:1784093909.993762:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024267520:0@lo:400:kworker.0 00000100:00100000:3.0:1784093909.993793:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024266880 00000100:00100000:3.0:1784093909.993799:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024266880 00000100:00100000:1.0:1784093909.993801:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267008 00000100:00100000:1.0:1784093909.993806:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267008 00000100:00100000:0.0:1784093909.993824:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093909.993826:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784093909.993840:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024267136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093909.993846:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267520 00000100:00100000:1.0:1784093909.993849:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267520 00000100:00100000:3.0:1784093909.993854:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1784093909.993866:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024266880:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784093909.993874:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093909.993879:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1784093909.993890:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024267264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093909.993914:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1784093909.993932:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024267008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093909.993939:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024267136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093909.993945:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024266880:12345-0@lo:400:kworker.0 Request processed in 78us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093909.993946:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024267264:12345-0@lo:400:kworker.0 Request processed in 58us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093909.993965:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1784093909.993969:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1784093909.993969:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1784093909.993990:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1784093909.994000:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024267008:12345-0@lo:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00080000:2.0:1784093909.994001:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093909.994001:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024267520:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784093909.994009:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093909.994028:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267392 00000100:00100000:0.0:1784093909.994028:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1784093909.994040:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267392 00000100:00100000:2.0:1784093909.994054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093909.994058:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024267520:12345-0@lo:400:kworker.0 Request processed in 59us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093909.994066:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1784093909.994110:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267648 00000100:00100000:0.0:1784093909.994118:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267648 00000100:00100000:3.0:1784093909.994120:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1784093909.994125:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024267136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093909.994131:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024267264:0@lo:400:kworker.0 00000100:00100000:3.0:1784093909.994135:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024267392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093909.994197:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00080000:2.0:1784093909.994198:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093909.994208:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024267392:12345-0@lo:400:kworker.0 Request processed in 77us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093909.994215:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024267008:0@lo:400:kworker.0 00000100:00100000:0.0:1784093909.994221:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024267648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093909.994222:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1784093909.994225:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024267392:0@lo:400:kworker.0 00000100:00100000:1.0:1784093909.994244:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024267520:0@lo:400:kworker.0 00000100:00100000:2.0:1784093909.994264:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024266880:0@lo:400:kworker.0 00000100:00100000:0.0:1784093909.994301:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024267648:12345-0@lo:400:kworker.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093909.994310:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1784093909.994337:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024267648:0@lo:400:kworker.0 00010000:00010000:0.0:1784093910.505615:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784093910.824817:0:78036:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 19: test nodemap trusted_admin fileops ========================================================== 01:38:30 (1784093910) 00000004:00000400:2.0:1784093911.219113:0:78086:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1784093911.224063:0:78086:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1784093911.529547:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093911.548239:0:78134:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff762f79d0 20000000:00000080:2.0:1784093911.548255:0:78134:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062d000 uarg=0000000000000000 10000000:01000000:2.0:1784093911.548801:0:78134:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093911.548820:0:78134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.548837:0:78134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca91e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.548846:0:78134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.548875:0:78134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca91e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.548885:0:78134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca91e expref: 18 pid: 5770 timeout: 1222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093911.548905:0:78134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78134:1870757024267776:0@lo:104: 00000100:00100000:2.0:1784093911.548952:0:78134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093911.548988:0:78134:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784093911.549004:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267776 00000100:00100000:1.0:1784093911.549017:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267776 00000100:00100000:1.0:1784093911.549063:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784093911.549074:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:78134:x1870757024267776:12345-0@lo:104: 00010000:00010000:1.0:1784093911.549088:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093911.549157:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093911.549164:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:78134:x1870757024267776:12345-0@lo:104: Request processed in 93us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093911.549172:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784093911.549175:0:78134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78134:1870757024267776:0@lo:104: 00010000:00010000:0.0:1784093911.549180:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093911.549189:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.549193:0:78134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549205:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093911.549211:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549228:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093911.549235:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093911.549241:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093911.549275:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549283:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093911.549308:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549315:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214ca91e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca925 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093911.549329:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024267904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093911.549332:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093911.549336:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093911.549338:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093911.549361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093911.549401:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024267904 00000100:00100000:0.0:1784093911.549407:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024267904 00010000:00010000:0.0:1784093911.549445:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca91e expref: 19 pid: 5770 timeout: 1222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093911.549475:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784093911.549484:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024267904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093911.549494:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093911.549499:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca91e expref: 19 pid: 5770 timeout: 1222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549517:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca91e expref: 19 pid: 5770 timeout: 1222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549529:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214ca925 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca91e expref: 19 pid: 5770 timeout: 1222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549540:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549547:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549559:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549566:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549573:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549579:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549585:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093911.549589:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549596:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549622:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093911.549632:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093911.549643:0:78134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.549654:0:78134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.549659:0:78134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214ca92c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093911.549671:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024267904:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093911.549684:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784093911.549695:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024267904:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784093911.841593:0:78182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3cb9f980 20000000:00000080:2.0:1784093911.841607:0:78182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062d000 uarg=0000000000000000 10000000:01000000:2.0:1784093911.841845:0:78182:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093911.841866:0:78182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841883:0:78182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841894:0:78182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841901:0:78182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841914:0:78182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841921:0:78182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841928:0:78182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093911.841932:0:78182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841941:0:78182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841954:0:78182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841962:0:78182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093911.841969:0:78182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214ca933 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093912.041530:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093912.041549:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024268032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093912.041628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093912.041685:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268032 00000100:00100000:3.0:1784093912.041692:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268032 00000100:00080000:0.0:1784093912.041732:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093912.041746:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1784093912.041771:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024268032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093912.041807:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093912.041862:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024268032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093912.041870:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1784093912.041905:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024268032:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1784093912.146875:0:78230:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd155904a0 20000000:00000080:1.0:1784093912.146891:0:78230:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237458400 uarg=0000000000000000 10000000:01000000:1.0:1784093912.147068:0:78230:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093912.147088:0:78230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147102:0:78230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147113:0:78230:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147141:0:78230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147147:0:78230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147151:0:78230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147156:0:78230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093912.147159:0:78230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147164:0:78230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147173:0:78230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147177:0:78230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.147182:0:78230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13c00/0x9ce98053214ca93a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093912.438646:0:78278:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd8f3a310 20000000:00000080:3.0:1784093912.438661:0:78278:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103c000 uarg=0000000000000000 10000000:01000000:3.0:1784093912.438833:0:78278:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093912.438853:0:78278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438868:0:78278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438879:0:78278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438890:0:78278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438898:0:78278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438905:0:78278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438911:0:78278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093912.438916:0:78278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438923:0:78278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438935:0:78278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438942:0:78278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.438949:0:78278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214ca941 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.553584:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093912.741244:0:78326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee87dab90 20000000:00000080:3.0:1784093912.741256:0:78326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103f400 uarg=0000000000000000 10000000:01000000:3.0:1784093912.741417:0:78326:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093912.741453:0:78326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741466:0:78326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741474:0:78326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741478:0:78326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741483:0:78326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741487:0:78326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741491:0:78326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093912.741494:0:78326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741499:0:78326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741508:0:78326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741513:0:78326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093912.741516:0:78326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214ca948 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093912.809485:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784093912.809492:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784093912.809497:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093912.809543:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093912.809559:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093912.809570:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093912.809597:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024268160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784093912.809660:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093912.809703:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268160 00000100:00100000:1.0:1784093912.809712:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268160 00000100:00100000:0.0:1784093912.809717:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c240 going to sleep for 11 seconds 00000100:00100000:1.0:1784093912.809764:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1784093912.809775:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024268160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784093912.809789:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093912.809810:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca94f expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.809835:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca94f expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.809846:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca94f expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093912.809855:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784093912.809904:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024268160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093912.809913:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1784093912.809944:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024268160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093912.809961:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093912.809972:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093912.809993:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784093912.809996:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093912.810001:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093913.054204:0:78374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc136b5710 20000000:00000080:2.0:1784093913.054219:0:78374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072379a8000 uarg=0000000000000000 10000000:01000000:2.0:1784093913.054387:0:78374:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093913.054407:0:78374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.054441:0:78374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca94f expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.054456:0:78374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.054486:0:78374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca94f expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.054496:0:78374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca94f expref: 18 pid: 5772 timeout: 1224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093913.054507:0:78374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78374:1870757024268288:0@lo:104: 00000100:00100000:2.0:1784093913.054559:0:78374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093913.054597:0:78374:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1784093913.054616:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784093913.054629:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268288 00000100:00100000:3.0:1784093913.054635:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268288 00000100:00100000:3.0:1784093913.054676:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784093913.054685:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:78374:x1870757024268288:12345-0@lo:104: 00010000:00010000:3.0:1784093913.054699:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093913.054750:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093913.054756:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb15450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:78374:x1870757024268288:12345-0@lo:104: Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093913.054763:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00010000:00010000:0.0:1784093913.054771:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093913.054779:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093913.054783:0:78374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78374:1870757024268288:0@lo:104: 00010000:00010000:0.0:1784093913.054796:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093913.054799:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093913.054807:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.054809:0:78374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093913.054812:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093913.054823:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093913.054847:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093913.054851:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093913.054873:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093913.054884:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ca94f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca956 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093913.054897:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1784093913.054902:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093913.054906:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093913.054909:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093913.054911:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024268416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784093913.054938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093913.054979:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268416 00000100:00100000:1.0:1784093913.054983:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268416 00010000:00010000:1.0:1784093913.054999:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca94f expref: 19 pid: 5772 timeout: 1224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093913.055021:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1784093913.055028:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024268416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093913.055037:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093913.055042:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca94f expref: 19 pid: 5772 timeout: 1224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055052:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca94f expref: 19 pid: 5772 timeout: 1224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055064:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13800/0x9ce98053214ca956 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca94f expref: 19 pid: 5772 timeout: 1224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055084:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055089:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055099:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055103:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055108:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055123:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055126:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093913.055129:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055134:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055145:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093913.055153:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093913.055163:0:78374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.055171:0:78374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093913.055177:0:78374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41a00/0x9ce98053214ca95d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093913.055184:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024268416:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093913.055198:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784093913.055215:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024268416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093913.577654:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093914.075290:0:78521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffabaef0c0 20000000:00000080:3.0:1784093914.075304:0:78521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103c400 uarg=0000000000000000 10000000:01000000:3.0:1784093914.075503:0:78521:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093914.075518:0:78521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075531:0:78521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075539:0:78521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075545:0:78521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075550:0:78521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075555:0:78521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075559:0:78521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093914.075562:0:78521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075567:0:78521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075574:0:78521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075579:0:78521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093914.075582:0:78521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214ca964 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784093914.368506:0:78569:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeaf0b4510 20000000:00000080:1.0:1784093914.368520:0:78569:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237458c00 uarg=0000000000000000 10000000:01000000:1.0:1784093914.368676:0:78569:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093914.368692:0:78569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368704:0:78569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368712:0:78569:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368716:0:78569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368720:0:78569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368725:0:78569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368729:0:78569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093914.368732:0:78569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368737:0:78569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368747:0:78569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368766:0:78569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093914.368772:0:78569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214ca96b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093914.488660:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093914.488818:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735424 00000100:00100000:2.0:1784093914.488831:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735424 00000100:00100000:2.0:1784093914.488910:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 725 00000100:00100000:2.0:1784093914.488921:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013735424:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093914.488974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093914.489038:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013735424:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 116us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093914.489049:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093914.489061:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 725 00000100:00100000:0.0:1784093914.489124:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735552 00000100:00100000:0.0:1784093914.489134:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735552 00000100:00100000:2.0:1784093914.489156:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735808 00000100:00100000:2.0:1784093914.489162:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735808 00000100:00080000:1.0:1784093914.489213:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093914.489219:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 510 00000100:00080000:1.0:1784093914.489227:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093914.489234:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013735808:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093914.489245:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 715 00000100:00100000:0.0:1784093914.489262:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013735552:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093914.489302:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013735808:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093914.489317:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 510 00000100:00100000:0.0:1784093914.489347:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013735552:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 87us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093914.489348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093914.489363:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 715 00000100:00100000:2.0:1784093914.489403:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735680 00000100:00100000:2.0:1784093914.489408:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735680 00000100:00080000:0.0:1784093914.489457:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093914.489511:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 511 00000100:00100000:2.0:1784093914.489522:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013735680:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093914.489574:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013735680:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093914.489582:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 511 00010000:00010000:0.0:1784093914.601539:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784093915.050493:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093915.050500:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093915.050504:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093915.050542:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093915.050554:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093915.050566:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093915.050590:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024268544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093915.050641:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093915.050697:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784093915.050704:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268544 00000100:00100000:0.0:1784093915.050718:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268544 00000100:00100000:0.0:1784093915.050800:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1784093915.050817:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024268544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093915.050839:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093915.050861:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca972 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.050901:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca972 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.050913:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca972 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.050926:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784093915.051007:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024268544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093915.051018:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1784093915.051032:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024268544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093915.051053:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093915.051060:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093915.051088:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093915.051093:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093915.051097:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093915.113575:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024268800:0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.113583:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024268928:0@lo:400:kworker.0 00000100:00100000:0.0:1784093915.113595:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024269056:0@lo:400:kworker.0 00000100:00100000:1.0:1784093915.113610:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024268672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093915.113674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093915.113684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093915.113773:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093915.113789:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024269184:0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.113790:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268928 00000100:00100000:3.0:1784093915.113802:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268928 00000100:00100000:0.0:1784093915.113831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093915.113871:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269184 00000100:00100000:3.0:1784093915.113875:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269184 00000100:00100000:0.0:1784093915.113892:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269056 00000100:00100000:0.0:1784093915.113901:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269056 00000100:00100000:3.0:1784093915.113911:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1784093915.113921:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024268928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093915.113966:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1784093915.113976:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024268928:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093915.113986:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024269056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.113993:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1784093915.114015:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784093915.114021:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024269184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.114047:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024269184:12345-0@lo:400:kworker.0 Request processed in 27us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093915.114051:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00080000:3.0:1784093915.114066:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093915.114082:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093915.114097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093915.114131:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268800 00000100:00100000:3.0:1784093915.114135:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268800 00000100:00100000:3.0:1784093915.114158:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1784093915.114162:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.114198:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024268800:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093915.114206:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1784093915.114259:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024268800:0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.114299:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024268928:0@lo:400:kworker.0 00000100:00100000:3.0:1784093915.114320:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024269184:0@lo:400:kworker.0 00000100:00100000:1.0:1784093915.114822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093915.114869:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024268672 00000100:00100000:1.0:1784093915.114875:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024269312:0@lo:400:kworker.0 00000100:00100000:2.0:1784093915.114876:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024268672 00000100:00100000:1.0:1784093915.114913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093915.114936:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1784093915.114952:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024268672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784093915.114995:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093915.115004:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269312 00000100:00100000:1.0:1784093915.115008:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269312 00000100:00100000:1.0:1784093915.115037:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1784093915.115045:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024268672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093915.115047:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024269312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093915.115058:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:2.0:1784093915.115094:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093915.115111:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024269312:12345-0@lo:400:kworker.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093915.115117:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1784093915.115158:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024268672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093915.115168:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024269312:0@lo:400:kworker.0 00000100:00100000:0.0:1784093915.115392:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024269056:12345-0@lo:400:kworker.0 Request processed in 1415us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093915.115405:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1784093915.115472:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024269056:0@lo:400:kworker.0 00010000:00010000:0.0:1784093915.626615:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784093915.644989:0:78766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe89b24210 20000000:00000080:2.0:1784093915.645007:0:78766:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237593800 uarg=0000000000000000 00010000:00010000:2.0:1784093915.645250:0:78766:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093915.645261:0:78766:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093915.645272:0:78766:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093915.645292:0:78766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.645307:0:78766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca972 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.645314:0:78766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.645353:0:78766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca972 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.645365:0:78766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca972 expref: 18 pid: 5772 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093915.645379:0:78766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78766:1870757024269440:0@lo:104: 00000100:00100000:2.0:1784093915.645491:0:78766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093915.645554:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269440 00000100:00100000:3.0:1784093915.645563:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269440 00000100:00100000:2.0:1784093915.645564:0:78766:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484000 going to sleep for 11 seconds 00000100:00100000:3.0:1784093915.645618:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784093915.645629:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:78766:x1870757024269440:12345-0@lo:104: 00010000:00010000:3.0:1784093915.645645:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093915.645710:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784093915.645718:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:78766:x1870757024269440:12345-0@lo:104: Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093915.645727:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784093915.645739:0:78766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78766:1870757024269440:0@lo:104: 00010000:00010000:0.0:1784093915.645741:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093915.645751:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.645762:0:78766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.645763:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093915.645770:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.645782:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093915.645790:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093915.645797:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093915.645833:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.645842:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093915.645866:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093915.645875:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ca972 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca979 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093915.645879:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024269568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093915.645897:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093915.645900:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093915.645901:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093915.645917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093915.645960:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269568 00000100:00100000:1.0:1784093915.645965:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269568 00010000:00010000:1.0:1784093915.645988:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca972 expref: 19 pid: 5772 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093915.646018:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1784093915.646022:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024269568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093915.646032:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093915.646036:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca972 expref: 19 pid: 5772 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646044:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca972 expref: 19 pid: 5772 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646053:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214ca979 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca972 expref: 19 pid: 5772 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646077:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646086:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646099:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646107:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646114:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646121:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646137:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093915.646142:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646150:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646167:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093915.646177:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093915.646191:0:78766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.646199:0:78766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093915.646206:0:78766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40a00/0x9ce98053214ca980 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093915.646213:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024269568:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093915.646221:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784093915.646248:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024269568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093916.650530:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784093916.713532:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093916.713537:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093916.713541:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093916.713574:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093916.713582:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093916.713589:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093916.713608:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024269696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093916.713692:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093916.713716:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269696 00000100:00100000:0.0:1784093916.713723:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269696 00000100:00100000:2.0:1784093916.713748:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907237b79a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784093916.713782:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1784093916.713798:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024269696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093916.713810:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093916.713822:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca987 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.713844:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca987 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.713856:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca987 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.713866:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093916.713915:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024269696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093916.713922:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1784093916.713947:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024269696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093916.713960:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093916.713967:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093916.713980:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093916.713983:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093916.713988:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784093916.869435:0:78963:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb21ebd70 20000000:00000080:3.0:1784093916.869453:0:78963:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723caa0c00 uarg=0000000000000000 00010000:00010000:3.0:1784093916.869918:0:78963:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093916.869933:0:78963:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093916.869947:0:78963:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093916.869965:0:78963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.869983:0:78963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca987 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.869996:0:78963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.870032:0:78963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca987 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.870055:0:78963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca987 expref: 18 pid: 5771 timeout: 1227 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093916.870067:0:78963:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78963:1870757024269824:0@lo:104: 00000100:00100000:3.0:1784093916.870114:0:78963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093916.870159:0:78963:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f54c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784093916.870181:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269824 00000100:00100000:2.0:1784093916.870189:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269824 00000100:00100000:2.0:1784093916.870231:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784093916.870240:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:78963:x1870757024269824:12345-0@lo:104: 00010000:00010000:2.0:1784093916.870258:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093916.870303:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093916.870308:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:78963:x1870757024269824:12345-0@lo:104: Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093916.870314:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784093916.870334:0:78963:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78963:1870757024269824:0@lo:104: 00010000:00010000:0.0:1784093916.870339:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093916.870346:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.870354:0:78963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870354:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093916.870358:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870366:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093916.870373:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093916.870379:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093916.870413:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870418:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093916.870459:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870467:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214ca987 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca98e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093916.870477:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024269952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093916.870487:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093916.870491:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093916.870493:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093916.870511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093916.870538:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024269952 00000100:00100000:0.0:1784093916.870541:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024269952 00010000:00010000:0.0:1784093916.870563:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca987 expref: 19 pid: 5771 timeout: 1227 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093916.870581:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784093916.870586:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024269952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093916.870594:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093916.870597:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca987 expref: 19 pid: 5771 timeout: 1227 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870604:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca987 expref: 19 pid: 5771 timeout: 1227 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870611:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214ca98e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca987 expref: 19 pid: 5771 timeout: 1227 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870620:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870625:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870633:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870640:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870644:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870648:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870651:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093916.870653:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870657:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870669:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093916.870677:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093916.870692:0:78963:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.870699:0:78963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093916.870706:0:78963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214ca995 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093916.870711:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024269952:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093916.870716:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784093916.870755:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024269952:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784093917.145018:0:79011:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb5b51a80 20000000:00000080:0.0:1784093917.145044:0:79011:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e231800 uarg=0000000000000000 00010000:00010000:0.0:1784093917.145235:0:79011:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093917.145251:0:79011:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093917.145264:0:79011:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093917.145280:0:79011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145292:0:79011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145300:0:79011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145304:0:79011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145308:0:79011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145312:0:79011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145316:0:79011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093917.145319:0:79011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145324:0:79011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145331:0:79011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145336:0:79011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093917.145340:0:79011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214ca99c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093917.161555:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024270080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093917.161622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093917.161675:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270080 00000100:00100000:0.0:1784093917.161684:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270080 00000100:00080000:3.0:1784093917.161712:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093917.161743:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784093917.161754:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024270080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093917.161807:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093917.161866:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024270080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093917.161871:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1784093917.161915:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024270080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093917.673597:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784093918.441479:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093918.441486:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093918.441491:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093918.441536:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093918.441553:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093918.441565:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093918.441592:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024270208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093918.441655:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093918.441710:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270208 00000100:00100000:2.0:1784093918.441715:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784093918.441718:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270208 00000100:00100000:0.0:1784093918.441786:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1784093918.441797:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024270208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093918.441812:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093918.441825:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ca9a3 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.441848:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.441859:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.441867:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76800, rc 0) 00000100:00100000:0.0:1784093918.441909:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024270208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093918.441916:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1784093918.441941:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024270208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093918.441957:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093918.441967:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093918.441985:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093918.441990:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093918.441997:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.697546:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784093918.949055:0:79302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3b85b500 20000000:00000080:3.0:1784093918.949072:0:79302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723caa0400 uarg=0000000000000000 00010000:00010000:3.0:1784093918.949317:0:79302:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093918.949332:0:79302:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093918.949344:0:79302:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093918.949365:0:79302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093918.949387:0:79302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093918.949398:0:79302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093918.949464:0:79302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093918.949477:0:79302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 18 pid: 5772 timeout: 1230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093918.949493:0:79302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79302:1870757024270336:0@lo:104: 00000100:00100000:3.0:1784093918.949559:0:79302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093918.949596:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270336 00000100:00100000:1.0:1784093918.949605:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270336 00000100:00100000:3.0:1784093918.949607:0:79302:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220c64480 going to sleep for 11 seconds 00000100:00100000:1.0:1784093918.949653:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784093918.949660:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:79302:x1870757024270336:12345-0@lo:104: 00010000:00010000:1.0:1784093918.949673:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093918.949727:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093918.949732:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:79302:x1870757024270336:12345-0@lo:104: Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093918.949740:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1784093918.949753:0:79302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79302:1870757024270336:0@lo:104: 00010000:00010000:0.0:1784093918.949756:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093918.949765:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.949773:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:3.0:1784093918.949774:0:79302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093918.949777:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.949790:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093918.949797:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093918.949800:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093918.949834:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.949840:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093918.949866:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.949874:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214ca9a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ca9aa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093918.949881:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024270464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093918.949893:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093918.949897:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093918.949899:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093918.949917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093918.949948:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270464 00000100:00100000:0.0:1784093918.949953:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270464 00010000:00010000:0.0:1784093918.949977:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 19 pid: 5772 timeout: 1230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093918.950010:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1784093918.950018:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024270464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093918.950030:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093918.950036:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 19 pid: 5772 timeout: 1230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950047:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 19 pid: 5772 timeout: 1230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950061:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76800/0x9ce98053214ca9aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ca9a3 expref: 19 pid: 5772 timeout: 1230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950073:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950080:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950090:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950095:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950100:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950104:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950109:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093918.950113:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950118:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950129:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093918.950134:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093918.950148:0:79302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093918.950163:0:79302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093918.950168:0:79302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214ca9b1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093918.950172:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024270464:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093918.950183:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784093918.950190:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024270464:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784093919.226678:0:79350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8a21d5c0 20000000:00000080:2.0:1784093919.226690:0:79350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723745b800 uarg=0000000000000000 00010000:00010000:2.0:1784093919.226872:0:79350:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093919.226883:0:79350:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093919.226893:0:79350:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093919.226908:0:79350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226920:0:79350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226929:0:79350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226933:0:79350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226938:0:79350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226944:0:79350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226950:0:79350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093919.226954:0:79350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226962:0:79350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226974:0:79350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.226982:0:79350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093919.227004:0:79350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40e00/0x9ce98053214ca9b8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093919.608312:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093919.608362:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093919.608402:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093919.608405:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013735936 00000100:00100000:2.0:1784093919.608450:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013735936 00000100:00100000:1.0:1784093919.608458:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736192 00000100:00100000:3.0:1784093919.608465:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093919.608466:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736192 00000100:00100000:3.0:1784093919.608496:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736064 00000100:00100000:3.0:1784093919.608501:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736064 00000100:00100000:2.0:1784093919.608522:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 729 00000100:00100000:1.0:1784093919.608527:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736320 00000100:00100000:1.0:1784093919.608532:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736320 00000100:00100000:2.0:1784093919.608536:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013735936:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093919.608561:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 719 00000100:00100000:1.0:1784093919.608571:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 514 00000100:00100000:3.0:1784093919.608574:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013736064:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093919.608584:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013736192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093919.608615:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013735936:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093919.608630:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 729 00000100:00100000:1.0:1784093919.608631:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013736192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093919.608632:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013736064:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093919.608649:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 719 00000100:00100000:1.0:1784093919.608650:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 514 00000100:00100000:1.0:1784093919.608676:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 515 00000100:00100000:1.0:1784093919.608684:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013736320:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093919.608701:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093919.608707:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784093919.608710:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093919.608716:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013736320:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093919.608723:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 515 00010000:00010000:0.0:1784093919.721677:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093920.220252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093920.220293:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736448 00000100:00100000:3.0:1784093920.220302:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736448 00000100:00100000:3.0:1784093920.220352:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 665 00000100:00100000:3.0:1784093920.220359:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:46760:x1870757013736448:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093920.220376:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093920.220473:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca9bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5887 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.220544:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca9c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.220555:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.220564:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093920.220743:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784093920.220746:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093920.220825:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca9c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.220844:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca9bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5887 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.220854:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca9c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5887 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.220860:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784093920.220862:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093920.220865:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784093920.220912:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:46760:x1870757013736448:12345-192.168.204.57@tcp:101:rm.0 Request processed in 553us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093920.220917:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 665 00000100:00100000:2.0:1784093920.222006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093920.222058:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736576 00000100:00100000:1.0:1784093920.222070:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736576 00000100:00100000:1.0:1784093920.222125:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 666 00000100:00100000:1.0:1784093920.222134:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:46760:x1870757013736576:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093920.222151:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093920.222167:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca9cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf588e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222216:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222230:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222256:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222273:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222280:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222288:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222529:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222535:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222540:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222544:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093920.222548:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222553:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222562:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784093920.222564:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093920.222567:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222575:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214ca9d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222583:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222586:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222590:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222594:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093920.222595:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222598:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222602:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907219c12d00) 00010000:00010000:1.0:1784093920.222603:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093920.222605:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222608:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ca9db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222631:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca9cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf588e expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222645:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784093920.222646:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093920.222649:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ca9cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf588e expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093920.222654:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784093920.222700:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:46760:x1870757013736576:12345-192.168.204.57@tcp:101:rm.0 Request processed in 568us (695us total) trans 0 rc 301/301 00000100:00100000:1.0:1784093920.222705:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 666 00000100:00100000:0.0:1784093920.233611:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024270976:0@lo:400:kworker.0 00000100:00100000:2.0:1784093920.233618:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024270720:0@lo:400:kworker.0 00000100:00100000:3.0:1784093920.233634:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093920.233671:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024270848:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.233737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093920.233748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093920.233750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093920.233801:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270976 00000100:00100000:1.0:1784093920.233812:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270976 00000100:00100000:3.0:1784093920.233851:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024271104:0@lo:400:kworker.0 00000100:00100000:2.0:1784093920.233867:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024271232:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.233879:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270720 00000100:00100000:0.0:1784093920.233885:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270720 00000100:00100000:3.0:1784093920.233902:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093920.233925:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1784093920.233926:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093920.233955:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024270976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.233955:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1784093920.233966:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024270720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093920.233988:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270592 00000100:00100000:3.0:1784093920.233997:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270592 00000100:00080000:2.0:1784093920.234016:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093920.234024:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093920.234067:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271232 00000100:00100000:1.0:1784093920.234074:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024270976:12345-0@lo:400:kworker.0 Request processed in 124us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093920.234075:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024270720:12345-0@lo:400:kworker.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093920.234078:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271232 00000100:00100000:3.0:1784093920.234092:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1784093920.234101:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1784093920.234103:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1784093920.234111:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024270592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093920.234144:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00002000:00000024:3.0:1784093920.234152:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093920.234159:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024271232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.234183:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271104 00000100:00100000:0.0:1784093920.234190:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271104 00000100:00100000:1.0:1784093920.234217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093920.234229:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024271232:12345-0@lo:400:kworker.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093920.234245:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1784093920.234248:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024270592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093920.234259:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1784093920.234273:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024271360:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.234277:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1784093920.234278:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024270848 00000100:00100000:2.0:1784093920.234286:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024270848 00000100:00100000:0.0:1784093920.234294:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024271104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093920.234329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093920.234334:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1784093920.234355:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024270848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093920.234358:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093920.234365:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024271104:12345-0@lo:400:kworker.0 Request processed in 73us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093920.234378:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1784093920.234397:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024271104:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.234401:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271360 00000100:00100000:0.0:1784093920.234407:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271360 00000100:00100000:2.0:1784093920.234485:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024270848:12345-0@lo:400:kworker.0 Request processed in 137us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093920.234492:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024270976:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.234493:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1784093920.234513:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024271360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093920.234519:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00080000:3.0:1784093920.234545:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093920.234553:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093920.234565:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024270848:0@lo:400:kworker.0 00000100:00100000:1.0:1784093920.234596:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024271360:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.234598:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024271360:12345-0@lo:400:kworker.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093920.234611:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1784093920.234627:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024271232:0@lo:400:kworker.0 00000100:00100000:2.0:1784093920.234653:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024270720:0@lo:400:kworker.0 00000100:00100000:0.0:1784093920.238215:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093920.238267:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736704 00000100:00100000:1.0:1784093920.238275:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736704 00000100:00100000:0.0:1784093920.238298:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093920.238323:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013736960 00000100:00100000:1.0:1784093920.238328:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013736960 00000100:00100000:1.0:1784093920.238360:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 667 00000100:00100000:1.0:1784093920.238370:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013736704:12345-192.168.204.57@tcp:41:mkdir.0 00000100:00100000:2.0:1784093920.238379:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 668 00000100:00100000:2.0:1784093920.238392:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46764:x1870757013736960:12345-192.168.204.57@tcp:36:mkdir.0 00000004:00000024:1.0:1784093920.238410:0:5778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:2.0:1784093920.238456:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093920.238484:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ca9c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5887 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.238503:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce700) 00010000:00010000:2.0:1784093920.238515:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093920.238516:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013736704:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 146us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093920.238526:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 667 00010000:00010000:2.0:1784093920.238780:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.238794:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.238803:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.238815:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.238827:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.238833:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093920.239715:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 512 00010000:00010000:2.0:1784093920.239723:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.239728:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.239733:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.239736:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093920.239739:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.239743:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.239750:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093920.239752:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093920.239754:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.239758:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093920.239775:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000fc3bed55 reply state 000000005629392c transno 4294967551 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093920.239783:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784093920.239839:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46764:x1870757013736960:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1450us (1540us total) trans 4294967551 rc 0/0 00000100:00100000:2.0:1784093920.239846:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 668 00010000:00010000:3.0:1784093920.240399:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.240408:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.240415:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.240437:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093920.240440:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.240447:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.240458:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781f00) 00010000:00010000:3.0:1784093920.240461:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093920.240464:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.240471:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ca9e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093920.260663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093920.260718:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013737088 00000100:00100000:2.0:1784093920.260729:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013737088 00000100:00100000:2.0:1784093920.260788:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 669 00000100:00100000:2.0:1784093920.260800:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:46768:x1870757013737088:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093920.260824:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093920.260847:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5895 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.260903:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca9f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.260918:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.260930:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093920.261002:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093920.261007:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093920.261032:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.261060:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ca9f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5895 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.261079:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5895 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.261088:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093920.261090:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093920.261094:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784093920.261148:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:46768:x1870757013737088:12345-192.168.204.57@tcp:101:chown.0 Request processed in 350us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093920.261156:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 669 00000100:00100000:0.0:1784093920.262090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093920.262126:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013737216 00000100:00100000:3.0:1784093920.262131:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013737216 00000100:00100000:3.0:1784093920.262154:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 670 00000100:00100000:3.0:1784093920.262160:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:46768:x1870757013737216:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784093920.262170:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093920.262180:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca9fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf589c expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262212:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262220:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262225:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262232:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262237:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262241:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262314:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caa13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262321:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caa13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262329:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caa13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093920.262355:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 512 00000004:00200000:3.0:1784093920.262358:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093920.262373:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caa13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262382:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262386:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262390:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262394:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093920.262396:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262401:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262410:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:3.0:1784093920.262413:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093920.262416:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262443:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214caa05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262453:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262459:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262463:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262466:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093920.262468:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262471:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262476:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fce800) 00010000:00010000:3.0:1784093920.262477:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093920.262479:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262482:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caa0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262502:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214ca9fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf589c expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262509:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caa13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf589c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.262514:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093920.262515:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093920.262516:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093920.262543:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:46768:x1870757013737216:12345-192.168.204.57@tcp:101:chown.0 Request processed in 384us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093920.262547:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 670 00000100:00100000:0.0:1784093920.263747:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093920.263800:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013737472 00000100:00100000:2.0:1784093920.263805:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013737472 00000100:00100000:2.0:1784093920.263835:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 671 00000100:00100000:2.0:1784093920.263842:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:46768:x1870757013737472:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:2.0:1784093920.263865:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093920.263876:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caa13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf589c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.263884:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784093920.263889:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093920.263900:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.263906:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.263911:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093920.264065:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bab1eb9d reply state 00000000289fbd7d transno 4294967552 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093920.264072:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784093920.264079:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 512 00000100:00100000:2.0:1784093920.264113:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:46768:x1870757013737472:12345-192.168.204.57@tcp:36:chown.0 Request processed in 273us (369us total) trans 4294967552 rc 0/0 00000100:00100000:2.0:1784093920.264118:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 671 00010000:00010000:3.0:1784093920.264677:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.264686:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.264692:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.264698:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093920.264701:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.264708:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.264717:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784093920.264720:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093920.264724:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.264731:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caa1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093920.361514:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093920.361520:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093920.361524:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784093920.361561:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.361572:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.361583:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093920.361617:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024271488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093920.361677:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093920.361718:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271488 00000100:00100000:2.0:1784093920.361726:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271488 00000100:00100000:3.0:1784093920.361727:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093920.361788:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1784093920.361798:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024271488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093920.361813:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093920.361827:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214caa21 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.361849:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214caa21 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.361860:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214caa21 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.361869:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093920.361913:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024271488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093920.361922:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1784093920.361963:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024271488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093920.361991:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.362002:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093920.362020:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784093920.362026:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.362032:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784093920.556700:0:79546:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe837166d0 20000000:00000080:0.0:1784093920.556713:0:79546:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720b846c00 uarg=0000000000000000 00010000:00010000:0.0:1784093920.556915:0:79546:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784093920.556947:0:79546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:0.0:1784093920.556951:0:79546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093920.556960:0:79546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ca9f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5895 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.556996:0:79546:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784093920.557011:0:79546:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093920.557024:0:79546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.557038:0:79546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214caa21 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.557046:0:79546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.557080:0:79546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214caa21 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.557094:0:79546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214caa21 expref: 18 pid: 5770 timeout: 1231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093920.557108:0:79546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79546:1870757024271616:0@lo:104: 00000100:00100000:0.0:1784093920.557159:0:79546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093920.557210:0:79546:0:(client.c:2702:ptlrpc_set_wait()) set ffff907202ae60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093920.557215:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271616 00000100:00100000:2.0:1784093920.557222:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271616 00000100:00100000:2.0:1784093920.557262:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1784093920.557270:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:79546:x1870757024271616:12345-0@lo:104: 00010000:00010000:2.0:1784093920.557279:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093920.557328:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093920.557333:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:79546:x1870757024271616:12345-0@lo:104: Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093920.557338:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784093920.557349:0:79546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79546:1870757024271616:0@lo:104: 00010000:00010000:3.0:1784093920.557366:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093920.557370:0:79546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557375:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557385:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784093920.557390:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557399:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093920.557406:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093920.557412:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093920.557455:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557462:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093920.557488:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557495:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa21 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caa28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557516:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093920.557518:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1784093920.557519:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093920.557523:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093920.557533:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024271744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784093920.557563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093920.557622:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271744 00000100:00100000:3.0:1784093920.557627:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271744 00010000:00010000:3.0:1784093920.557649:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214caa21 expref: 19 pid: 5770 timeout: 1231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093920.557678:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784093920.557688:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024271744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093920.557700:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093920.557709:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214caa21 expref: 19 pid: 5770 timeout: 1231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557727:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214caa21 expref: 19 pid: 5770 timeout: 1231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557753:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40e00/0x9ce98053214caa28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214caa21 expref: 19 pid: 5770 timeout: 1231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557768:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557775:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557789:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557801:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557808:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557814:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557824:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093920.557829:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557838:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557857:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.557866:0:79546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093920.557868:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093920.557878:0:79546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.557886:0:79546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76200/0x9ce98053214caa2f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093920.557910:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024271744:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093920.557917:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784093920.558024:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024271744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093920.745564:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093920.844122:0:79594:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8cbd9580 20000000:00000080:0.0:1784093920.844134:0:79594:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720b844000 uarg=0000000000000000 00010000:00010000:0.0:1784093920.844297:0:79594:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093920.844308:0:79594:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093920.844317:0:79594:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093920.844333:0:79594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844348:0:79594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844358:0:79594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844366:0:79594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844373:0:79594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844378:0:79594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844382:0:79594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093920.844384:0:79594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844389:0:79594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844402:0:79594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844407:0:79594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093920.844411:0:79594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214caa36 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093921.267119:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967552 is committed 10000000:01000000:3.0:1784093921.769503:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784093921.769510:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784093921.769514:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784093921.769517:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093921.769565:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093921.769576:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093921.769587:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093921.769612:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024271872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784093921.769689:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093921.769739:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024271872 00000100:00100000:0.0:1784093921.769750:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024271872 00000100:00100000:3.0:1784093921.769757:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722d980900 going to sleep for 11 seconds 00000100:00100000:0.0:1784093921.769819:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1784093921.769833:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024271872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093921.769850:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093921.769866:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214caa3d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093921.769895:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214caa3d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093921.769909:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214caa3d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093921.769920:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784093921.769990:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024271872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093921.769998:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1784093921.770009:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024271872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093921.770029:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093921.770037:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093921.770055:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093921.770059:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093921.770064:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093921.840103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093921.840168:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013737600 00000100:00100000:3.0:1784093921.840179:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013737600 00000100:00100000:3.0:1784093921.840281:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 11 00000100:00080000:0.0:1784093921.840286:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093921.840297:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013737600:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093921.840317:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093921.840320:0:5765:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214ca9f7) 00010000:00010000:3.0:1784093921.840322:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093921.840384:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013737600:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 94us (292us total) trans 0 rc 116/116 00000100:00100000:3.0:1784093921.840391:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 11 00000100:00100000:2.0:1784093922.157454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093922.157499:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013737728 00000100:00100000:0.0:1784093922.157510:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013737728 00000100:00100000:0.0:1784093922.157581:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 672 00000100:00100000:0.0:1784093922.157594:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:46872:x1870757013737728:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784093922.157618:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093922.157658:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214caa4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58a3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.157714:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214caa52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.157728:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214caa52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.157742:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214caa52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093922.157930:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784093922.157934:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093922.158038:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214caa52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.158057:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214caa4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58a3 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.158068:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214caa52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58a3 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.158075:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093922.158077:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784093922.158080:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784093922.158132:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:46872:x1870757013737728:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 543us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093922.158137:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 672 00000100:00100000:0.0:1784093922.159178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.159234:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013737856 00000100:00100000:1.0:1784093922.159240:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013737856 00000100:00100000:1.0:1784093922.159276:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 673 00000100:00100000:1.0:1784093922.159283:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:46872:x1870757013737856:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093922.159293:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093922.159304:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214caa59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58aa expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159344:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159353:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159362:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159387:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159395:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159401:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159688:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caa6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159695:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caa6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159700:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caa6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093922.159796:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1784093922.159800:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093922.159866:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caa6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159876:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159880:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159884:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159896:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.159899:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159904:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159912:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:1.0:1784093922.159913:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.159916:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159920:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caa60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159927:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159931:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159953:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159957:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.159960:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159964:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159978:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907219c12b00) 00010000:00010000:1.0:1784093922.159980:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.159982:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.159985:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caa67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.160006:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214caa59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58aa expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.160014:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caa6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58aa expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.160021:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784093922.160024:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093922.160026:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784093922.160066:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:46872:x1870757013737856:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 783us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.160072:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 673 00000100:00100000:1.0:1784093922.161307:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.161351:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013738112 00000100:00100000:2.0:1784093922.161359:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013738112 00000100:00100000:2.0:1784093922.161406:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 674 00000100:00100000:2.0:1784093922.161415:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46872:x1870757013738112:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093922.161465:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093922.161484:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caa6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58aa expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.161511:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12400) 00010000:00010000:2.0:1784093922.161519:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093922.161536:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.161546:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.161554:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093922.171949:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000817eb1a6 reply state 000000006de2f564 transno 4294967553 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.171966:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093922.172086:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:1.0:1784093922.172185:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:46872:x1870757013738112:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 10768us (10875us total) trans 4294967553 rc 0/0 00000100:00100000:1.0:1784093922.172203:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 674 00000001:00080000:1.0:1784093922.172254:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967553 is committed 00010000:00010000:3.0:1784093922.172306:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.172329:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.172337:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.172345:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093922.172349:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.172357:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.172373:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781700) 00010000:00010000:3.0:1784093922.172375:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093922.172379:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.172385:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214caa75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.191329:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.191382:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013738240 00000100:00100000:2.0:1784093922.191393:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013738240 00000100:00100000:2.0:1784093922.191475:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 675 00000100:00100000:2.0:1784093922.191489:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:46876:x1870757013738240:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093922.191511:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.191534:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214caa7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58b1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.191587:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.191604:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.191615:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.191628:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.191635:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.191641:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192079:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214caa91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192087:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214caa91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192094:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214caa91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093922.192191:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:2.0:1784093922.192195:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093922.192267:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214caa91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192279:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192299:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192305:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192310:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.192314:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192321:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192333:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784093922.192337:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.192342:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192348:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caa83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192360:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192366:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192372:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192378:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.192382:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192388:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192395:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781000) 00010000:00010000:2.0:1784093922.192398:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.192401:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192407:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caa8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192715:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214caa7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58b1 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192729:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214caa91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58b1 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.192738:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784093922.192741:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093922.192744:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093922.192897:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:46876:x1870757013738240:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1410us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.192906:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 675 00000100:00100000:3.0:1784093922.195470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093922.195507:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013738496 00000100:00100000:0.0:1784093922.195517:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013738496 00000100:00100000:0.0:1784093922.195573:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 676 00000100:00100000:0.0:1784093922.195586:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:46876:x1870757013738496:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784093922.195600:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093922.195615:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caa98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58b8 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.195990:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.196006:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.196017:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.196067:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.196073:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.196078:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784093922.196918:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:0.0:1784093922.197176:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214caaad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197187:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214caaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197195:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214caaad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197229:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197236:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197243:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197248:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.197251:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197256:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197264:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093922.197266:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093922.197269:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197276:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caa9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093922.197284:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000df3b0a1e reply state 00000000dc46ef3e transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.197291:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093922.197318:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caa98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58b8 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197331:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214caaad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58b8 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.197338:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784093922.197341:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093922.197343:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784093922.197408:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:46876:x1870757013738496:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1826us (1943us total) trans 4294967554 rc 0/0 00000100:00100000:0.0:1784093922.197415:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 676 00010000:00010000:0.0:1784093922.198170:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.198179:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.198186:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.198192:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.198196:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.198203:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.198212:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907202e6b100) 00010000:00010000:0.0:1784093922.198215:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093922.198219:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.198224:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caaa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093922.198776:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.198822:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013738752 00000100:00100000:1.0:1784093922.198838:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013738752 00000100:00100000:1.0:1784093922.198882:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 677 00000100:00100000:1.0:1784093922.198892:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:46876:x1870757013738752:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:1.0:1784093922.198931:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093922.198959:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214caaad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58b8 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.198972:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff907202e6b900) 00010000:00010000:1.0:1784093922.198978:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093922.199005:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.199015:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.199022:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093922.199098:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000044654df1 reply state 000000000b2a11db transno 4294967555 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.199106:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093922.199166:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:46876:x1870757013738752:12345-192.168.204.57@tcp:36:touch.0 Request processed in 271us (386us total) trans 4294967555 rc 0/0 00000100:00100000:1.0:1784093922.199182:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 677 00010000:00010000:0.0:1784093922.199621:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.199629:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.199635:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.199640:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.199643:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.199649:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.199657:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff907219c12b00) 00010000:00010000:0.0:1784093922.199659:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093922.199663:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.199668:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caabb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093922.200268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.200308:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013738880 00000100:00100000:2.0:1784093922.200314:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013738880 00000100:00100000:2.0:1784093922.200338:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 678 00000100:00100000:2.0:1784093922.200344:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:46876:x1870757013738880:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093922.200355:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.200365:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caac2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58bf expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.200403:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caac2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58bf expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.200416:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caac2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58bf expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.200536:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093922.200539:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784093922.200541:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093922.200570:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:46876:x1870757013738880:12345-192.168.204.57@tcp:101:touch.0 Request processed in 225us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.200576:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 678 00000100:00100000:3.0:1784093922.201454:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.201497:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013739008 00000100:00100000:1.0:1784093922.201502:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013739008 00000100:00080000:0.0:1784093922.201547:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093922.201551:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 334 00000100:00100000:1.0:1784093922.201560:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013739008:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:1.0:1784093922.201876:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013739008:12345-192.168.204.57@tcp:2:touch.0 Request processed in 316us (422us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1784093922.201883:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 334 00000100:00100000:0.0:1784093922.202681:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.202728:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013739264 00000100:00100000:2.0:1784093922.202734:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013739264 00000100:00100000:2.0:1784093922.202767:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 72 00000100:00100000:2.0:1784093922.202776:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:46876:x1870757013739264:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:2.0:1784093922.202976:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:46876:x1870757013739264:12345-192.168.204.57@tcp:35:touch.0 Request processed in 201us (294us total) trans 4294967556 rc 0/0 00000100:00100000:2.0:1784093922.202985:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 72 00000100:00100000:3.0:1784093922.219783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093922.219853:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013739392 00000100:00100000:0.0:1784093922.219868:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013739392 00000100:00100000:0.0:1784093922.219926:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 679 00000100:00100000:0.0:1784093922.219950:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:46880:x1870757013739392:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784093922.219973:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093922.219994:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58c6 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220053:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220067:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220077:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220091:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220098:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220105:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220211:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220219:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220226:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093922.220258:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 0 00000004:00200000:0.0:1784093922.220262:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093922.220281:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220292:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220300:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220306:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220312:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220317:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.220321:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220329:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220341:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093922.220344:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093922.220349:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220354:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220367:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220374:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220379:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220383:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.220385:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220389:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220394:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907202e6b100) 00010000:00010000:0.0:1784093922.220395:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093922.220397:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220400:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220449:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214caac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58c6 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220461:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58c6 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.220466:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff90721a781b00) 00010000:00010000:0.0:1784093922.220468:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093922.220469:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784093922.220516:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:46880:x1870757013739392:12345-192.168.204.57@tcp:101:rm.0 Request processed in 582us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093922.220521:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 679 00000100:00100000:3.0:1784093922.221832:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.221878:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013739520 00000100:00100000:2.0:1784093922.221884:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013739520 00000100:00100000:2.0:1784093922.221919:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 335 00000100:00100000:2.0:1784093922.221928:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013739520:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093922.221952:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.221968:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58cd expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093922.221995:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x6a571ce2, atime: 0x6a571ce2, ctime: 0x6a571ce2, blocks: 0x1 00010000:00010000:2.0:1784093922.222009:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=1083s v=(0 0) 00010000:00010000:2.0:1784093922.222014:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093922.222022:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.222034:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.222046:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093922.222079:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013739520:12345-192.168.204.57@tcp:101:rm.0 Request processed in 152us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.222085:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 335 00000100:00100000:1.0:1784093922.223598:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.223642:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013739776 00000100:00100000:2.0:1784093922.223648:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013739776 00000100:00100000:2.0:1784093922.223686:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 680 00000100:00100000:2.0:1784093922.223696:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:46880:x1870757013739776:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784093922.223729:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093922.223760:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214caade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58c6 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223778:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214caac2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58bf expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223788:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff90721a781b00) 00010000:00010000:2.0:1784093922.223796:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093922.223810:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223820:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223828:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223839:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223844:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223850:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223929:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223946:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.223955:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784093922.224363:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00000004:00080000:2.0:1784093922.224373:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1083301950683ns, next at 1084301949121ns, rc = 0 00010000:00010000:2.0:1784093922.224444:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224454:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224462:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224467:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224472:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224476:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224488:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093922.224512:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224519:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224524:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224531:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.224533:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224538:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224544:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784093922.224546:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784093922.224548:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224553:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214caafa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224562:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093922.224563:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224573:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224573:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224584:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224589:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093922.224591:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.224596:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224597:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224604:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224613:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224614:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784093922.224619:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.224623:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.224628:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214caaec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224628:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff90721a781300) 00010000:00010000:0.0:1784093922.224633:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093922.224637:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224653:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093922.224658:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ef364736 reply state 00000000aba3ee20 transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.224664:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093922.224667:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093922.224668:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093922.224669:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093922.224721:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:46880:x1870757013739776:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1026us (1125us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1784093922.224728:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 680 00010000:00010000:0.0:1784093922.225308:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.225322:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.225331:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.225337:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.225340:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.225347:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.225357:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff90721a781500) 00010000:00010000:0.0:1784093922.225359:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093922.225362:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.225368:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214caaf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.281527:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024272000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093922.281578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093922.281617:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024272000 00000100:00100000:0.0:1784093922.281625:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024272000 00000100:00080000:1.0:1784093922.281655:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093922.281685:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1784093922.281695:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024272000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093922.281728:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093922.281782:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024272000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093922.281790:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1784093922.281813:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024272000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093922.513297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.513347:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013739904 00000100:00100000:2.0:1784093922.513357:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013739904 00000100:00100000:2.0:1784093922.513413:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 681 00000100:00100000:2.0:1784093922.513451:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:46895:x1870757013739904:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093922.513472:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.513488:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58d4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.513550:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.513564:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.513575:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093922.513633:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:2.0:1784093922.513637:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093922.513659:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.513685:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58d4 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.513700:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58d4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.513707:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784093922.513710:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093922.513713:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41000, rc 0) 00000100:00100000:2.0:1784093922.513773:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:46895:x1870757013739904:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 351us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.513780:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 681 00000100:00100000:3.0:1784093922.514800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093922.514846:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013740160 00000100:00100000:0.0:1784093922.514850:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013740160 00000100:00100000:0.0:1784093922.514878:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 682 00000100:00100000:0.0:1784093922.514885:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:46895:x1870757013740160:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093922.514909:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093922.514922:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58d4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.514951:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214caa91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58b1 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.514958:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093922.514964:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093922.514977:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.514984:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.514989:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093922.523959:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967558 is committed 00000004:00010000:0.0:1784093922.523967:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000067cd3166 reply state 0000000037332705 transno 4294967558 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093922.523976:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000100:00100000:0.0:1784093922.523983:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093922.524093:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:1.0:1784093922.524116:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024272128:0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1784093922.524176:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784093922.524185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093922.524193:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:46895:x1870757013740160:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 9306us (9393us total) trans 4294967558 rc 0/0 00000100:00100000:0.0:1784093922.524201:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 682 00010000:00010000:0.0:1784093922.524231:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.524237:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.524243:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.524248:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00000100:00100000:1.0:1784093922.524251:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024272128 00010000:00010000:0.0:1784093922.524252:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.524257:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024272128 00010000:00010000:0.0:1784093922.524260:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.524273:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784093922.524275:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093922.524279:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.524283:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cab16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.524292:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784093922.524302:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024272128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784093922.524326:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:21 count 1 00010000:00010000:1.0:1784093922.524346:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.524370:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.524375:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093922.524378:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093922.524381:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.524399:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.524408:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 6 pid: 53396 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.524416:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024272256:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784093922.524501:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1784093922.525340:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024272256:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784093922.525360:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093922.525612:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093922.525651:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013740288 00000100:00100000:0.0:1784093922.525658:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013740288 00010000:00010000:0.0:1784093922.525681:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 7 pid: 53396 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.525709:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 279 00000100:00100000:0.0:1784093922.525717:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013740288:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784093922.525728:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093922.525734:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 7 pid: 53396 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525746:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 7 pid: 53396 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525763:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214caae5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58cd expref: 7 pid: 53396 timeout: 1183 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525774:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093922.525787:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093922.525793:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525802:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525825:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093922.525847:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.525856:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013740288:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 138us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093922.525861:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.525868:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 279 00010000:00010000:1.0:1784093922.525882:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.525890:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.525909:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093922.525921:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093922.525929:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525949:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093922.525953:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525962:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525974:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.525982:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cab1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.526000:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093922.526002:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093922.526004:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093922.526356:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024272128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2054us (2170us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1784093922.526364:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000004:00080000:2.0:1784093922.526388:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9072373e4e00/2, rc 0, transno 4294967339 00000100:00100000:2.0:1784093922.526397:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024272128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784093922.542115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.542159:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013740416 00000100:00100000:2.0:1784093922.542168:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013740416 00000100:00100000:2.0:1784093922.542217:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 683 00000100:00100000:2.0:1784093922.542226:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:46899:x1870757013740416:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093922.542246:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.542265:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58db expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542314:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542326:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542334:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542343:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542347:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542351:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542670:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cab39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542676:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cab39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542680:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cab39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093922.542755:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:2.0:1784093922.542763:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093922.542819:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cab39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542828:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542832:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542840:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542843:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.542846:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542850:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542858:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784093922.542860:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.542863:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542866:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cab2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542873:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542877:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542880:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542883:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.542885:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542890:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542894:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781b00) 00010000:00010000:2.0:1784093922.542895:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.542897:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542900:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542918:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58db expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542925:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cab39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58db expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.542945:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093922.542947:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093922.542949:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093922.542993:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46899:x1870757013740416:12345-192.168.204.57@tcp:101:touch.0 Request processed in 770us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.542998:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 683 00000100:00100000:0.0:1784093922.544036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.544071:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013740672 00000100:00100000:2.0:1784093922.544077:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013740672 00000100:00100000:2.0:1784093922.544114:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 684 00000100:00100000:2.0:1784093922.544122:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:46899:x1870757013740672:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784093922.544136:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.544145:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab40 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58e2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.544276:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.544283:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.544289:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.544296:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.544300:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.544304:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093922.544900:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:2.0:1784093922.545077:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cab55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545084:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cab55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545089:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cab55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545116:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545123:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545129:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545136:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.545139:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545146:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545155:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093922.545158:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.545161:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545165:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784093922.545172:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005fc3e6c1 reply state 00000000055ea274 transno 4294967559 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093922.545178:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784093922.545195:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab40 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58e2 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545206:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cab55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58e2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.545210:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784093922.545212:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093922.545213:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784093922.545243:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:46899:x1870757013740672:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1123us (1209us total) trans 4294967559 rc 0/0 00000100:00100000:2.0:1784093922.545247:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 684 00010000:00010000:1.0:1784093922.545780:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.545789:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.545796:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.545801:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.545804:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.545810:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.545818:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff90721a781e00) 00010000:00010000:1.0:1784093922.545821:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.545830:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.545836:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cab4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.546295:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.546330:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013740928 00000100:00100000:1.0:1784093922.546336:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013740928 00000100:00100000:1.0:1784093922.546372:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 685 00000100:00100000:1.0:1784093922.546381:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:46899:x1870757013740928:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:1.0:1784093922.546411:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093922.546472:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cab55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58e2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.546487:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff90721a781a00) 00010000:00010000:1.0:1784093922.546499:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093922.546524:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.546533:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.546541:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093922.546621:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005ee4a7d8 reply state 00000000d52872aa transno 4294967560 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.546629:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093922.546679:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:46899:x1870757013740928:12345-192.168.204.57@tcp:36:touch.0 Request processed in 300us (384us total) trans 4294967560 rc 0/0 00000100:00100000:1.0:1784093922.546697:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 685 00010000:00010000:1.0:1784093922.547143:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547152:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547160:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547166:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.547170:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547177:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547185:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093922.547188:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.547191:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547197:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.547326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.547359:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013741056 00000100:00100000:1.0:1784093922.547364:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013741056 00000100:00100000:1.0:1784093922.547401:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 686 00000100:00100000:1.0:1784093922.547410:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:46899:x1870757013741056:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093922.547453:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093922.547471:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cab6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58e9 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547501:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cab6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58e9 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547512:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cab6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58e9 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.547530:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093922.547533:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093922.547536:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093922.547570:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:46899:x1870757013741056:12345-192.168.204.57@tcp:101:touch.0 Request processed in 161us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.547578:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 686 00000100:00100000:0.0:1784093922.548351:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.548401:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013741184 00000100:00100000:1.0:1784093922.548406:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013741184 00000100:00080000:0.0:1784093922.548449:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093922.548523:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 337 00000100:00100000:1.0:1784093922.548535:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013741184:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:1.0:1784093922.548835:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013741184:12345-192.168.204.57@tcp:2:touch.0 Request processed in 302us (484us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1784093922.548844:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 337 00000100:00100000:0.0:1784093922.549555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.549579:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013741440 00000100:00100000:2.0:1784093922.549583:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013741440 00000100:00100000:2.0:1784093922.549607:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 73 00000100:00100000:2.0:1784093922.549613:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:46899:x1870757013741440:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:2.0:1784093922.549738:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:46899:x1870757013741440:12345-192.168.204.57@tcp:35:touch.0 Request processed in 125us (185us total) trans 4294967561 rc 0/0 00000100:00100000:2.0:1784093922.549744:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 73 00000100:00100000:0.0:1784093922.565951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.565993:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013741568 00000100:00100000:2.0:1784093922.566003:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013741568 00000100:00100000:2.0:1784093922.566053:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 687 00000100:00100000:2.0:1784093922.566062:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:46903:x1870757013741568:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093922.566085:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.566103:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58f0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566152:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566164:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566174:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566185:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566191:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566197:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566294:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566301:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566308:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093922.566335:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x39:0x0]: returning size 0 00000004:00200000:2.0:1784093922.566339:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093922.566354:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566364:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566376:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566381:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566387:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566393:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.566396:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566402:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566413:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093922.566415:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.566442:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566449:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cab78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566463:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566470:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566477:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566483:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093922.566486:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566493:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566500:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff90721a781b00) 00010000:00010000:2.0:1784093922.566503:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093922.566505:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566511:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cab7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566539:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cab71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f0 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566552:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.566560:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff907219c12900) 00010000:00010000:2.0:1784093922.566563:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784093922.566565:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784093922.566617:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:46903:x1870757013741568:12345-192.168.204.57@tcp:101:rm.0 Request processed in 556us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.566625:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 687 00000100:00100000:0.0:1784093922.567845:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.567876:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013741696 00000100:00100000:2.0:1784093922.567881:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013741696 00000100:00100000:2.0:1784093922.567907:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 338 00000100:00100000:2.0:1784093922.567912:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013741696:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093922.567922:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093922.567944:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58f7 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093922.567962:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x6a571ce2, atime: 0x6a571ce2, ctime: 0x6a571ce2, blocks: 0x1 00010000:00010000:2.0:1784093922.567974:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1083s v=(0 0) 00010000:00010000:2.0:1784093922.567979:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093922.567987:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.568003:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.568013:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093922.568045:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013741696:12345-192.168.204.57@tcp:101:rm.0 Request processed in 132us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.568052:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 338 00000100:00100000:0.0:1784093922.569051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.569104:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013741952 00000100:00100000:1.0:1784093922.569108:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013741952 00000100:00100000:1.0:1784093922.569134:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00100000:1.0:1784093922.569141:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:46903:x1870757013741952:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093922.569173:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093922.569201:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cab86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569219:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cab6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58e9 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569229:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093922.569236:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093922.569247:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569257:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569264:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569275:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569282:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569288:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569354:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569361:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569380:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093922.569850:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9536 00000004:00080000:1.0:1784093922.569858:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1083647435639ns, next at 1084647434155ns, rc = 0 00010000:00010000:1.0:1784093922.569909:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569917:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569923:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569927:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569945:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569949:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569962:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093922.569974:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569981:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.569987:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.569993:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093922.570003:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570004:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.570011:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.570014:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093922.570020:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570023:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.570034:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570039:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093922.570044:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093922.570047:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.570053:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093922.570054:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caba2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.570059:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093922.570065:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570074:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.570074:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214caba9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570090:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570095:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570099:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093922.570100:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093922.570102:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570105:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.570110:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093922.570113:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093922.570122:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784093922.570124:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.570125:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570129:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cab94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093922.570135:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c7c8b4a9 reply state 00000000709ca97f transno 4294967562 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.570139:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093922.570174:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:46903:x1870757013741952:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1035us (1123us total) trans 4294967562 rc 0/0 00000100:00100000:1.0:1784093922.570179:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 688 00010000:00010000:1.0:1784093922.570722:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570729:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570732:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570735:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.570737:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570741:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570755:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907219c12500) 00010000:00010000:1.0:1784093922.570757:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.570758:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.570762:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cab9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.793582:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093922.878575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.878626:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742080 00000100:00100000:1.0:1784093922.878636:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742080 00000100:00100000:1.0:1784093922.878707:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 689 00000100:00100000:1.0:1784093922.878720:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:46918:x1870757013742080:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093922.878755:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093922.878778:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf58fe expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.878842:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.878857:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.878869:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093922.878952:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1784093922.878957:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093922.878985:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.879025:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58fe expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.879041:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58fe expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.879050:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784093922.879054:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093922.879058:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093922.879121:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:46918:x1870757013742080:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 402us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.879129:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 689 00000100:00100000:0.0:1784093922.880304:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.880351:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742336 00000100:00100000:1.0:1784093922.880358:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742336 00000100:00100000:1.0:1784093922.880394:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 690 00000100:00100000:1.0:1784093922.880404:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:46918:x1870757013742336:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093922.880459:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093922.880477:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58fe expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.880496:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cab39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58db expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.880508:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784093922.880520:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093922.880539:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.880556:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.880565:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093922.880786:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d8f0b537 reply state 0000000041b279f8 transno 4294967563 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.880796:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093922.880808:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:1.0:1784093922.880867:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:46918:x1870757013742336:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 466us (565us total) trans 4294967563 rc 0/0 00000100:00100000:1.0:1784093922.880874:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 690 00010000:00010000:1.0:1784093922.881503:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.881511:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.881518:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.881523:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.881528:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.881535:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.881545:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784093922.881556:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093922.881561:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.881567:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093922.925764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.925818:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742464 00000100:00100000:1.0:1784093922.925831:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742464 00000100:00100000:1.0:1784093922.925898:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 691 00000100:00100000:1.0:1784093922.925912:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013742464:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093922.926050:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013742464:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.926057:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 691 00000100:00100000:0.0:1784093922.926631:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.926684:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742592 00000100:00100000:1.0:1784093922.926689:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742592 00000100:00100000:1.0:1784093922.926719:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 339 00000100:00100000:1.0:1784093922.926727:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:46930:x1870757013742592:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093922.927076:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:46930:x1870757013742592:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 349us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.927084:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 339 00000100:00100000:3.0:1784093922.927572:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.927616:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742720 00000100:00100000:1.0:1784093922.927621:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742720 00000100:00100000:1.0:1784093922.927652:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 340 00000100:00100000:1.0:1784093922.927659:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46930:x1870757013742720:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093922.927846:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46930:x1870757013742720:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 187us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.927865:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 340 00000100:00100000:0.0:1784093922.928360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.928411:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742848 00000100:00100000:1.0:1784093922.928416:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742848 00000100:00100000:1.0:1784093922.928479:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 692 00000100:00100000:1.0:1784093922.928487:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013742848:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093922.928785:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013742848:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 298us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.928802:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 692 00000100:00100000:0.0:1784093922.929635:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.929677:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013742976 00000100:00100000:1.0:1784093922.929684:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013742976 00000100:00100000:1.0:1784093922.929719:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 693 00000100:00100000:1.0:1784093922.929727:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013742976:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093922.929782:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013742976:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.929789:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 693 00000100:00100000:3.0:1784093922.930308:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.930352:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013743104 00000100:00100000:2.0:1784093922.930358:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013743104 00000100:00100000:2.0:1784093922.930389:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 341 00000100:00100000:2.0:1784093922.930397:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:46930:x1870757013743104:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093922.930940:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:46930:x1870757013743104:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 544us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093922.930949:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 341 00000100:00100000:0.0:1784093922.931507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.931546:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013743232 00000100:00100000:1.0:1784093922.931552:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013743232 00000100:00100000:1.0:1784093922.931582:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 342 00000100:00100000:1.0:1784093922.931590:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:46930:x1870757013743232:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093922.931790:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:46930:x1870757013743232:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 201us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.931798:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 342 00000100:00100000:0.0:1784093922.932306:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.932349:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013743360 00000100:00100000:1.0:1784093922.932354:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013743360 00000100:00100000:1.0:1784093922.932383:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 694 00000100:00100000:1.0:1784093922.932399:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013743360:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093922.932664:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:46930:x1870757013743360:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 266us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.932670:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 694 00000100:00100000:3.0:1784093922.951211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.951279:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013743488 00000100:00100000:1.0:1784093922.951293:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013743488 00000100:00100000:1.0:1784093922.951358:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:1.0:1784093922.951367:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:46934:x1870757013743488:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093922.951392:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093922.951453:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5905 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951537:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951555:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951571:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951589:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951595:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951600:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951948:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cabda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951955:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cabda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.951960:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cabda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093922.951989:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1784093922.951992:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093922.952012:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cabda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952022:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952026:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952030:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952035:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.952038:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952043:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952051:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:1.0:1784093922.952057:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.952062:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952065:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cabcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952074:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952077:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952081:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952084:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.952085:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952088:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952092:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907219c12500) 00010000:00010000:1.0:1784093922.952094:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.952095:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952098:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cabd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952122:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cabc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5905 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952141:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cabda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5905 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.952146:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093922.952148:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093922.952149:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784093922.952205:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:46934:x1870757013743488:12345-192.168.204.57@tcp:101:dd.0 Request processed in 840us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.952210:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:3.0:1784093922.953515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.953567:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013743744 00000100:00100000:1.0:1784093922.953576:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013743744 00000100:00100000:1.0:1784093922.953626:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 696 00000100:00100000:1.0:1784093922.953637:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:46934:x1870757013743744:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093922.953656:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093922.953669:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cabe1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf590c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.953772:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.953784:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.953793:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.953814:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.953832:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.953841:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093922.954372:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:1.0:1784093922.955761:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cabf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955780:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cabf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955793:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cabf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955846:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955851:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955855:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955859:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.955862:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955867:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955889:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093922.955891:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.955894:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955898:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cabe8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093922.955907:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004e971da7 reply state 000000000dab4b3c transno 4294967564 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093922.955912:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093922.955958:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cabe1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf590c expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955969:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cabf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf590c expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.955974:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093922.955976:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093922.955977:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784093922.956028:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+15:46934:x1870757013743744:12345-192.168.204.57@tcp:101:dd.0 Request processed in 2395us (2521us total) trans 4294967564 rc 0/0 00000100:00100000:1.0:1784093922.956034:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 696 00010000:00010000:1.0:1784093922.956628:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.956637:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.956650:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.956656:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093922.956659:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.956666:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.956675:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907219c12000) 00010000:00010000:1.0:1784093922.956678:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093922.956682:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.956688:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cabef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093922.958723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.958769:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013743872 00000100:00100000:1.0:1784093922.958780:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013743872 00000100:00100000:1.0:1784093922.958823:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 343 00000100:00100000:1.0:1784093922.958833:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:46934:x1870757013743872:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093922.958850:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093922.958865:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5913 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093922.958886:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784093922.958900:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=1084s v=(0 0) 00010000:00010000:1.0:1784093922.958909:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093922.958916:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.958938:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093922.958946:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784093922.958974:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:46934:x1870757013743872:12345-192.168.204.57@tcp:101:dd.0 Request processed in 145us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.958979:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 343 00000100:00100000:0.0:1784093922.966413:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093922.966459:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744000 00000100:00100000:3.0:1784093922.966467:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744000 00002000:00100000:3.0:1784093922.966504:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff907210e78a80 x1870757013744000/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:243/0 lens 488/0 e 0 to 0 dl 1784093933 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784093922.966517:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907210e78a80 with x1870757013744000 ext(0->1048575) 00002000:00010000:3.0:1784093922.966520:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907210e78a80 00000100:00100000:3.0:1784093922.966543:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 16 00000100:00100000:3.0:1784093922.966553:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013744000:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784093922.972017:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:2352:x1870757013744000:12345-192.168.204.57@tcp:4:dd.0 Request processed in 5460us (5605us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784093922.972028:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 16 00002000:00100000:1.0:1784093922.972037:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff907210e78a80 x1870757013744000/t4294967340(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:243/0 lens 488/448 e 0 to 0 dl 1784093933 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784093922.972043:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907210e78a80 with x1870757013744000 ext(0->1048575) 00002000:00010000:1.0:1784093922.972048:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907210e78a80 00000100:00100000:3.0:1784093922.972916:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093922.972963:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744128 00000100:00100000:1.0:1784093922.972970:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744128 00000100:00100000:1.0:1784093922.973007:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 697 00000100:00100000:1.0:1784093922.973015:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+14:46934:x1870757013744128:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:0.0:1784093922.982447:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967564 is committed 00000004:00080000:0.0:1784093922.982461:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 54 committed 00000100:00100000:1.0:1784093922.982548:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:46934:x1870757013744128:12345-192.168.204.57@tcp:44:dd.0 Request processed in 9528us (9626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093922.982559:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 697 00000100:00100000:3.0:1784093922.982571:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093922.982590:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024272384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784093922.982635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093922.982729:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024272384 00000100:00100000:2.0:1784093922.982743:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024272384 00000100:00100000:2.0:1784093922.982804:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1784093922.982818:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024272384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784093922.982846:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00010000:00010000:2.0:1784093922.982871:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.982891:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.982898:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784093922.982902:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093922.982907:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.982957:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.982975:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 6 pid: 53396 timeout: 1184 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093922.982987:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024272512:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093922.983067:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784093922.983377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093922.983417:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744256 00000100:00100000:0.0:1784093922.983440:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744256 00000100:00100000:0.0:1784093922.983475:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 345 00000100:00100000:0.0:1784093922.983482:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013744256:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:2.0:1784093922.983810:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024272512:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093922.983835:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784093922.983947:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093922.984035:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093922.984059:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744384 00000100:00100000:3.0:1784093922.984063:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744384 00010000:00010000:3.0:1784093922.984091:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 7 pid: 53396 timeout: 1184 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093922.984125:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 280 00000100:00100000:3.0:1784093922.984135:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013744384:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093922.984146:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093922.984153:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 7 pid: 53396 timeout: 1184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.984166:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 7 pid: 53396 timeout: 1184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.984193:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cab8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58f7 expref: 7 pid: 53396 timeout: 1184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.984209:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093922.984213:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093922.984217:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.984224:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093922.984249:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784093922.984289:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013744384:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 156us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093922.984299:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 280 00010000:00010000:0.0:1784093922.984815:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.984823:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.984830:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.984836:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093922.984858:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784093922.984890:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784093922.984898:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.984906:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784093922.984911:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.984919:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.984949:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.984955:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cac0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093922.984976:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093922.984977:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093922.984978:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093922.985316:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024272384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2504us (2679us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1784093922.985324:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000004:00080000:3.0:1784093922.985584:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9072373e5f80/2, rc 0, transno 4294967339 00000100:00100000:3.0:1784093922.985591:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024272384:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1784093922.993690:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000100:00100000:0.0:1784093922.993716:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013744256:12345-192.168.204.57@tcp:16:dd.0 Request processed in 10230us (10335us total) trans 0 rc 0/0 00000001:00080000:2.0:1784093922.993724:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000100:00100000:0.0:1784093922.993730:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 345 00000100:00100000:0.0:1784093922.994810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093922.994871:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744640 00000100:00100000:2.0:1784093922.994884:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744640 00000100:00100000:2.0:1784093922.994963:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 74 00000100:00100000:2.0:1784093922.994978:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:46934:x1870757013744640:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:2.0:1784093922.995491:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:46934:x1870757013744640:12345-192.168.204.57@tcp:35:dd.0 Request processed in 514us (676us total) trans 4294967565 rc 0/0 00000100:00100000:2.0:1784093922.995501:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 74 00000001:00080000:1.0:1784093923.375063:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967565 is committed 00000004:00080000:1.0:1784093923.756776:0:79986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1084834352299ns, next at 1084301949121ns, rc = 0 00000004:00080000:1.0:1784093923.756876:0:79986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1084834453326ns, next at 1084647434155ns, rc = 0 00000004:00080000:0.0:1784093923.757828:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00000004:00080000:0.0:1784093923.758358:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 55 committed 00010000:00010000:0.0:1784093923.817496:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093924.156765:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000001:00080000:0.0:1784093924.156783:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000100:00100000:3.0:1784093924.187136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.187182:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744768 00000100:00100000:1.0:1784093924.187190:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744768 00000100:00080000:0.0:1784093924.187250:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093924.187261:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 698 00000100:00100000:1.0:1784093924.187271:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013744768:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093924.187363:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013744768:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.187372:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 698 00000100:00100000:0.0:1784093924.188160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.188188:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013744896 00000100:00100000:1.0:1784093924.188193:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013744896 00000100:00080000:0.0:1784093924.188217:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093924.188236:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 346 00000100:00100000:1.0:1784093924.188245:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47127:x1870757013744896:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093924.188584:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47127:x1870757013744896:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 341us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.188591:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 346 00000100:00100000:0.0:1784093924.189168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093924.189196:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745024 00000100:00100000:3.0:1784093924.189202:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745024 00000100:00080000:0.0:1784093924.189225:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093924.189242:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:3.0:1784093924.189253:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47127:x1870757013745024:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093924.189484:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47127:x1870757013745024:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 232us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093924.189492:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:3.0:1784093924.190227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.190266:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745152 00000100:00100000:1.0:1784093924.190271:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745152 00000100:00100000:1.0:1784093924.190303:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:1.0:1784093924.190313:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013745152:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093924.190779:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013745152:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 468us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.190788:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:0.0:1784093924.191821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.191866:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745280 00000100:00100000:1.0:1784093924.191874:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745280 00000100:00100000:1.0:1784093924.191915:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 700 00000100:00100000:1.0:1784093924.191925:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013745280:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093924.191977:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013745280:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.191982:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 700 00000100:00100000:0.0:1784093924.192835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.192874:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745408 00000100:00100000:1.0:1784093924.192880:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745408 00000100:00100000:1.0:1784093924.192920:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 348 00000100:00100000:1.0:1784093924.192929:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:47127:x1870757013745408:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093924.193185:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:47127:x1870757013745408:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 256us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.193192:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 348 00000100:00100000:3.0:1784093924.193717:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.193756:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745536 00000100:00100000:1.0:1784093924.193760:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745536 00000100:00100000:1.0:1784093924.193786:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 349 00000100:00100000:1.0:1784093924.193792:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47127:x1870757013745536:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093924.194030:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47127:x1870757013745536:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 236us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.194037:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 349 00000100:00100000:3.0:1784093924.194624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093924.194669:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745664 00000100:00100000:0.0:1784093924.194676:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745664 00000100:00100000:0.0:1784093924.194714:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 701 00000100:00100000:0.0:1784093924.194724:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013745664:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093924.195011:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47127:x1870757013745664:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 289us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093924.195020:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 701 00000100:00100000:0.0:1784093924.213208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093924.213252:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013745920 00000100:00100000:1.0:1784093924.213261:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013745920 00000100:00100000:1.0:1784093924.213303:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 702 00000100:00100000:1.0:1784093924.213310:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47131:x1870757013745920:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093924.213354:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093924.213387:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cabf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf590c expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213408:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093924.213416:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093924.213449:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213460:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213468:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213477:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213482:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213486:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213721:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213727:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.213731:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093924.214542:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9600 00000004:00080000:1.0:1784093924.214554:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1085292131049ns, next at 1086292127691ns, rc = 0 00010000:00010000:1.0:1784093924.214715:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214725:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214734:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214743:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214750:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214757:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214776:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093924.214795:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214801:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214806:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214807:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093924.214815:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093924.214817:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214818:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214835:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214836:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093924.214839:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214858:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214861:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093924.214864:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093924.214867:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214871:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cac20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214872:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784093924.214878:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093924.214881:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214886:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214886:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cac27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214916:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214921:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214924:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093924.214925:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093924.214927:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093924.214929:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.214929:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093924.214936:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214943:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784093924.214944:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093924.214946:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.214950:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cac12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093924.214971:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000000b7eda80 reply state 00000000e3c021d4 transno 4294967566 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093924.214979:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093924.215043:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:47131:x1870757013745920:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1732us (1839us total) trans 4294967566 rc 0/0 00000100:00100000:1.0:1784093924.215051:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 702 00010000:00010000:1.0:1784093924.215618:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.215625:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.215629:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.215633:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093924.215635:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.215639:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.215645:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907219c12700) 00010000:00010000:1.0:1784093924.215647:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093924.215649:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.215652:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093924.728400:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093924.728463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093924.728467:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746048 00000100:00100000:2.0:1784093924.728477:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746048 00000100:00100000:0.0:1784093924.728499:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093924.728546:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 733 00000100:00100000:3.0:1784093924.728547:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746176 00000100:00100000:2.0:1784093924.728559:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013746048:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093924.728561:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746176 00000100:00100000:1.0:1784093924.728567:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746304 00000100:00100000:1.0:1784093924.728576:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746304 00000100:00100000:1.0:1784093924.728629:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 518 00000100:00100000:1.0:1784093924.728643:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013746304:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093924.728652:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013746048:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 92us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093924.728658:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 519 00000100:00100000:2.0:1784093924.728674:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 733 00000100:00100000:3.0:1784093924.728681:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013746176:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093924.728689:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013746304:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093924.728699:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 518 00000100:00100000:3.0:1784093924.728759:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013746176:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093924.728769:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 519 00010000:00010000:3.0:1784093924.841642:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784093924.929482:0:80131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1086007058036ns, next at 1086292127691ns, rc = 0 00000001:00080000:0.0:1784093924.937574:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967566 is committed 00000004:00080000:0.0:1784093924.937584:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000004:00080000:0.0:1784093924.937599:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00000100:00100000:0.0:1784093924.937712:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093924.937731:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024272640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784093924.937790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093924.937836:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024272640 00000100:00100000:1.0:1784093924.937845:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024272640 00000100:00080000:0.0:1784093924.937874:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093924.937911:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784093924.937922:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024272640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784093924.937949:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00010000:00010000:1.0:1784093924.937972:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.937992:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.938001:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784093924.938005:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093924.938010:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.938036:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.938055:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 5 pid: 6572 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093924.938064:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024272768:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784093924.938110:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784093924.939173:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024272768:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784093924.939188:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093924.939394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093924.939478:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746432 00000100:00100000:3.0:1784093924.939483:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746432 00010000:00010000:3.0:1784093924.939502:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 6 pid: 6572 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093924.939522:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 281 00000100:00100000:3.0:1784093924.939527:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013746432:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093924.939534:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093924.939539:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 6 pid: 6572 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093924.939548:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 6 pid: 6572 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093924.939563:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cac04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5913 expref: 6 pid: 6572 timeout: 1186 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093924.939575:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093924.939577:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093924.939581:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093924.939586:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093924.939602:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093924.939622:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093924.939627:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013746432:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093924.939632:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 281 00010000:00010000:1.0:1784093924.939643:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.939652:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.939658:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093924.939675:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093924.939705:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093924.939716:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.939726:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093924.939730:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.939739:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.939756:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.939764:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa34da80/0x9ce98053214cac2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093924.939784:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093924.939786:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093924.939788:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093924.940060:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024272640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2140us (2269us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1784093924.940069:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1784093924.940081:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:0.0:1784093924.940086:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9072373e4e00, transno 4294967339 00000100:00100000:0.0:1784093924.940094:0:3302:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90723d4d2a00 x1870757024272640/t4294967341(4294967341) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784093940 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1784093924.940101:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d4d2a00/2, rc 0, transno 4294967341 00000100:00100000:0.0:1784093924.940111:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024272640:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1784093924.940290:0:80131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1086017867421ns, next at 1084647434155ns, rc = 0 00000004:00080000:0.0:1784093924.947347:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 56 committed 00000100:00100000:1.0:1784093925.353630:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024272896:0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.353649:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024273280:0@lo:400:kworker.0 00000100:00100000:0.0:1784093925.353657:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024273024:0@lo:400:kworker.0 00000100:00100000:0.0:1784093925.353736:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093925.353737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093925.353744:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024273152:0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.353781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093925.353807:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024273408:0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.353824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093925.353839:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024272896 00000100:00100000:1.0:1784093925.353844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093925.353849:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024272896 00000100:00100000:2.0:1784093925.353866:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273024 00000100:00100000:2.0:1784093925.353872:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273024 00000100:00100000:1.0:1784093925.353895:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273152 00000100:00100000:1.0:1784093925.353900:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273152 00000100:00100000:0.0:1784093925.353914:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1784093925.353925:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273280 00000100:00100000:0.0:1784093925.353926:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024272896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.353928:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273280 00000100:00100000:1.0:1784093925.353945:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1784093925.353952:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1784093925.353955:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024273024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.353961:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024273152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093925.353999:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024273024:12345-0@lo:400:kworker.0 Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093925.354000:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024272896:12345-0@lo:400:kworker.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093925.354008:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024273152:12345-0@lo:400:kworker.0 Request processed in 48us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093925.354011:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1784093925.354011:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1784093925.354020:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1784093925.354037:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1784093925.354045:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024273280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.354080:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024273152:0@lo:400:kworker.0 00000100:00080000:0.0:1784093925.354083:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093925.354089:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024273280:12345-0@lo:400:kworker.0 Request processed in 44us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093925.354100:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273408 00000100:00100000:0.0:1784093925.354104:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273408 00000100:00100000:1.0:1784093925.354105:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1784093925.354122:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024273280:0@lo:400:kworker.0 00000100:00100000:0.0:1784093925.354148:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1784093925.354149:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024272896:0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.354153:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024273024:0@lo:400:kworker.0 00000100:00100000:0.0:1784093925.354160:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024273408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784093925.354195:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093925.354212:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024273408:12345-0@lo:400:kworker.0 Request processed in 57us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093925.354219:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1784093925.354242:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:2.0:1784093925.354248:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9072373e5f80, transno 4294967339 00000100:00100000:2.0:1784093925.354265:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024273408:0@lo:400:kworker.0 00000100:00100000:2.0:1784093925.354494:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093925.354502:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024273536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093925.354531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093925.354563:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273536 00000100:00100000:0.0:1784093925.354567:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273536 00000100:00100000:0.0:1784093925.354601:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1784093925.354612:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024273536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093925.354643:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093925.354688:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024273536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093925.354696:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1784093925.354724:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024273536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784093925.865630:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093926.889542:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093927.401669:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024273664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093927.401737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093927.401797:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273664 00000100:00100000:0.0:1784093927.401807:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273664 00000100:00080000:1.0:1784093927.401858:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093927.401875:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784093927.401887:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024273664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093927.401925:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784093927.401980:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024273664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093927.401987:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1784093927.402034:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024273664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093927.913585:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093928.937521:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784093929.460864:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00000100:00100000:0.0:1784093929.848375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093929.848418:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093929.848456:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746560 00000100:00100000:2.0:1784093929.848465:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746560 00000100:00100000:0.0:1784093929.848485:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093929.848488:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746688 00000100:00100000:1.0:1784093929.848495:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746688 00000100:00100000:2.0:1784093929.848508:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 735 00000100:00100000:2.0:1784093929.848525:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013746560:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093929.848532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093929.848553:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746816 00000100:00100000:3.0:1784093929.848559:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746816 00000100:00100000:1.0:1784093929.848560:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 726 00000100:00100000:1.0:1784093929.848573:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013746688:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093929.848579:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013746944 00000100:00100000:0.0:1784093929.848584:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013746944 00000100:00100000:2.0:1784093929.848597:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013746560:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093929.848605:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:2.0:1784093929.848609:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 735 00000100:00100000:3.0:1784093929.848620:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013746816:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093929.848627:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013746688:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093929.848633:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 522 00000100:00100000:1.0:1784093929.848641:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 726 00000100:00100000:3.0:1784093929.848655:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013746816:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093929.848657:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013746944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093929.848666:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00080000:1.0:1784093929.848667:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093929.848672:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093929.848675:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093929.848700:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013746944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093929.848709:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 522 00010000:00010000:0.0:1784093929.961581:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093930.473681:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024273920:0@lo:400:kworker.0 00000100:00100000:0.0:1784093930.473681:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024274048:0@lo:400:kworker.0 00000100:00100000:2.0:1784093930.473682:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024273792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093930.473717:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024274176:0@lo:400:kworker.0 00000100:00100000:0.0:1784093930.473775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093930.473796:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093930.473796:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093930.473819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093930.473879:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024274432:0@lo:400:kworker.0 00000100:00100000:0.0:1784093930.473881:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024274560:0@lo:400:kworker.0 00000100:00100000:2.0:1784093930.473887:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024274304:0@lo:400:kworker.0 00000100:00100000:3.0:1784093930.473912:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274048 00000100:00100000:3.0:1784093930.473920:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274048 00000100:00100000:1.0:1784093930.473924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093930.473931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093930.473946:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273792 00000100:00100000:2.0:1784093930.473952:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273792 00000100:00100000:3.0:1784093930.473963:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274176 00000100:00100000:3.0:1784093930.473968:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274176 00000100:00100000:1.0:1784093930.473968:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274432 00000100:00100000:1.0:1784093930.473974:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274432 00000100:00100000:3.0:1784093930.474004:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1784093930.474005:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024273920 00000100:00100000:2.0:1784093930.474017:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1784093930.474023:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1784093930.474025:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093930.474027:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024273920 00000100:00100000:2.0:1784093930.474031:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024273792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093930.474037:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024274176:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784093930.474068:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093930.474069:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1784093930.474082:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024273920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093930.474096:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024274048:12345-0@lo:400:kworker.0 Request processed in 76us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093930.474105:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1784093930.474115:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024274176:12345-0@lo:400:kworker.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093930.474124:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1784093930.474131:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024273792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093930.474132:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1784093930.474149:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024273920:12345-0@lo:400:kworker.0 Request processed in 65us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093930.474150:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024274432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093930.474150:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784093930.474163:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1784093930.474164:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274560 00000100:00100000:1.0:1784093930.474171:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274560 00000100:00080000:2.0:1784093930.474177:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093930.474184:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093930.474210:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024274432:12345-0@lo:400:kworker.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093930.474218:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1784093930.474221:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1784093930.474231:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024274560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093930.474237:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024274432:0@lo:400:kworker.0 00000100:00100000:0.0:1784093930.474255:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024273920:0@lo:400:kworker.0 00000100:00100000:3.0:1784093930.474277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093930.474281:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024274176:0@lo:400:kworker.0 00000100:00100000:1.0:1784093930.474283:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024274560:12345-0@lo:400:kworker.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093930.474294:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1784093930.474300:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024274560:0@lo:400:kworker.0 00000100:00100000:1.0:1784093930.474311:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274304 00000100:00100000:1.0:1784093930.474316:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274304 00000100:00100000:0.0:1784093930.474325:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024274048:0@lo:400:kworker.0 00000100:00100000:3.0:1784093930.474329:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024273792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784093930.474335:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093930.474354:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1784093930.474361:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024274304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093930.474413:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024274304:12345-0@lo:400:kworker.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093930.474418:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1784093930.474521:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:3.0:1784093930.474527:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d4d2a00, transno 4294967341 00000100:00100000:3.0:1784093930.474551:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024274304:0@lo:400:kworker.0 00010000:00010000:0.0:1784093930.985598:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093932.009619:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093932.521620:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024274688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093932.521673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093932.521719:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274688 00000100:00100000:0.0:1784093932.521728:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274688 00000100:00080000:2.0:1784093932.521793:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093932.521815:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784093932.521825:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024274688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093932.521859:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093932.521912:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024274688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093932.521919:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1784093932.521973:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024274688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093933.033544:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093934.057551:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093934.968378:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093934.968417:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093934.968474:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747072 00000100:00100000:2.0:1784093934.968481:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093934.968485:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747072 00000100:00100000:3.0:1784093934.968505:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747200 00000100:00100000:2.0:1784093934.968507:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093934.968514:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747200 00000100:00100000:0.0:1784093934.968528:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747328 00000100:00100000:0.0:1784093934.968533:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747328 00000100:00100000:2.0:1784093934.968534:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747456 00000100:00100000:2.0:1784093934.968539:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747456 00000100:00100000:1.0:1784093934.968547:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 737 00000100:00100000:1.0:1784093934.968560:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013747072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093934.968577:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 730 00000100:00100000:0.0:1784093934.968577:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 525 00000100:00100000:2.0:1784093934.968585:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 526 00000100:00100000:0.0:1784093934.968592:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013747328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093934.968594:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013747200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093934.968600:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013747456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093934.968632:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013747072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093934.968640:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013747328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093934.968642:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 737 00000100:00100000:2.0:1784093934.968650:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013747456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093934.968656:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013747200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093934.968657:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 525 00000100:00100000:2.0:1784093934.968668:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 526 00000100:00100000:3.0:1784093934.968677:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 730 00000100:00080000:3.0:1784093934.968732:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093934.968737:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093934.968741:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784093935.081519:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093935.593585:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024274816:0@lo:400:kworker.0 00000100:00100000:1.0:1784093935.593595:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024274944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093935.593596:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024275072:0@lo:400:kworker.0 00000100:00100000:1.0:1784093935.593668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093935.593669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093935.593672:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093935.593695:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024275200:0@lo:400:kworker.0 00000100:00100000:3.0:1784093935.593733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093935.593769:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024275328:0@lo:400:kworker.0 00000100:00100000:1.0:1784093935.593772:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024275456:0@lo:400:kworker.0 00000100:00100000:0.0:1784093935.593772:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024275584:0@lo:400:kworker.0 00000100:00100000:3.0:1784093935.593781:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275072 00000100:00100000:3.0:1784093935.593789:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275072 00000100:00100000:2.0:1784093935.593814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093935.593825:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093935.593829:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274816 00000100:00100000:0.0:1784093935.593835:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274816 00000100:00100000:3.0:1784093935.593840:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275200 00000100:00100000:3.0:1784093935.593844:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275200 00000100:00100000:2.0:1784093935.593882:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275456 00000100:00100000:0.0:1784093935.593883:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1784093935.593889:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275456 00000100:00100000:1.0:1784093935.593896:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024274944 00000100:00100000:3.0:1784093935.593897:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1784093935.593899:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024274816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093935.593902:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024274944 00000100:00100000:3.0:1784093935.593911:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024275072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093935.593939:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1784093935.593949:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024275200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093935.593951:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784093935.593960:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024274816:12345-0@lo:400:kworker.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093935.593965:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024274944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093935.593976:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00002000:00000024:1.0:1784093935.593999:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093935.594009:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024275200:12345-0@lo:400:kworker.0 Request processed in 61us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093935.594015:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1784093935.594022:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1784093935.594026:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024275456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093935.594049:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024275072:12345-0@lo:400:kworker.0 Request processed in 141us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093935.594059:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1784093935.594063:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024274944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093935.594069:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024275456:12345-0@lo:400:kworker.0 Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093935.594075:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024275200:0@lo:400:kworker.0 00000100:00100000:1.0:1784093935.594077:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784093935.594081:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00080000:3.0:1784093935.594084:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093935.594088:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093935.594111:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275328 00000100:00100000:1.0:1784093935.594116:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275328 00000100:00100000:0.0:1784093935.594122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093935.594145:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024274816:0@lo:400:kworker.0 00000100:00100000:0.0:1784093935.594162:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024275072:0@lo:400:kworker.0 00000100:00100000:2.0:1784093935.594165:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275584 00000100:00100000:1.0:1784093935.594170:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1784093935.594172:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275584 00000100:00100000:1.0:1784093935.594181:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024275328:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093935.594191:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093935.594212:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024275456:0@lo:400:kworker.0 00000100:00100000:2.0:1784093935.594213:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1784093935.594229:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024275584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093935.594241:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024274944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093935.594247:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024275328:12345-0@lo:400:kworker.0 Request processed in 66us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093935.594255:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1784093935.594269:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024275328:0@lo:400:kworker.0 00000100:00100000:2.0:1784093935.594285:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024275584:12345-0@lo:400:kworker.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093935.594295:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1784093935.594305:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024275584:0@lo:400:kworker.0 00010000:00010000:1.0:1784093936.105605:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093937.129512:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093937.641602:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024275712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093937.641676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093937.641724:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275712 00000100:00100000:0.0:1784093937.641733:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275712 00000100:00080000:3.0:1784093937.641777:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093937.641797:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1784093937.641809:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024275712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093937.641855:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093937.641911:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024275712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093937.641920:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1784093937.641955:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024275712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093938.153552:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093939.177680:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093940.088395:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093940.088455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093940.088460:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747584 00000100:00100000:0.0:1784093940.088470:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747584 00000100:00100000:2.0:1784093940.088476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093940.088501:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747712 00000100:00100000:3.0:1784093940.088507:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747712 00000100:00100000:2.0:1784093940.088511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093940.088530:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 739 00000100:00100000:0.0:1784093940.088542:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013747584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093940.088543:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747968 00000100:00100000:2.0:1784093940.088550:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013747840 00000100:00100000:1.0:1784093940.088551:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747968 00000100:00100000:3.0:1784093940.088556:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 734 00000100:00100000:2.0:1784093940.088558:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013747840 00000100:00100000:3.0:1784093940.088567:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013747712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093940.088596:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 529 00000100:00100000:1.0:1784093940.088618:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013747968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093940.088623:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 530 00000100:00100000:3.0:1784093940.088630:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013747712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093940.088630:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013747584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093940.088638:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013747840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093940.088642:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 734 00000100:00100000:0.0:1784093940.088642:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 739 00000100:00100000:1.0:1784093940.088668:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013747968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093940.088670:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093940.088678:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093940.088678:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 529 00000100:00080000:3.0:1784093940.088683:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093940.088686:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013747840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093940.088697:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 530 00010000:00010000:3.0:1784093940.201576:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093940.713629:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024275840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093940.713705:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093940.713748:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275840 00000100:00100000:0.0:1784093940.713755:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275840 00000100:00080000:1.0:1784093940.713797:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093940.713820:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1784093940.713829:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024275840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093940.713864:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093940.713928:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024275840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093940.713937:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1784093940.713944:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024275968:0@lo:400:kworker.0 00000100:00100000:2.0:1784093940.713964:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024276224:0@lo:400:kworker.0 00000100:00100000:3.0:1784093940.714011:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024276352:0@lo:400:kworker.0 00000100:00100000:1.0:1784093940.714326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093940.714354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093940.714366:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024276480:0@lo:400:kworker.0 00000100:00100000:0.0:1784093940.714376:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024275968 00000100:00100000:0.0:1784093940.714382:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024275968 00000100:00100000:2.0:1784093940.714392:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784093940.714405:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024276096:0@lo:400:kworker.0 00000100:00100000:1.0:1784093940.714405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093940.714417:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1784093940.714450:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024275968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093940.714463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093940.714511:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024275968:12345-0@lo:400:kworker.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093940.714513:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276224 00000100:00100000:2.0:1784093940.714520:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276224 00000100:00100000:0.0:1784093940.714523:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1784093940.714525:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024275968:0@lo:400:kworker.0 00000100:00080000:1.0:1784093940.714552:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093940.714570:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276480 00000100:00100000:0.0:1784093940.714574:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276480 00000100:00100000:1.0:1784093940.714580:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276096 00000100:00100000:1.0:1784093940.714601:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276096 00000100:00100000:0.0:1784093940.714615:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1784093940.714624:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024276224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093940.714630:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1784093940.714634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093940.714639:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1784093940.714644:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024276480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093940.714653:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024276096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093940.714677:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024275840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093940.714685:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024276224:12345-0@lo:400:kworker.0 Request processed in 62us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093940.714693:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1784093940.714699:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024276480:12345-0@lo:400:kworker.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093940.714707:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1784093940.714712:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024276096:12345-0@lo:400:kworker.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.714720:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276352 00000100:00100000:3.0:1784093940.714725:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276352 00000100:00100000:1.0:1784093940.714726:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00080000:0.0:1784093940.714727:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093940.714745:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024276096:0@lo:400:kworker.0 00000100:00100000:2.0:1784093940.714761:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024276224:0@lo:400:kworker.0 00000100:00080000:0.0:1784093940.714763:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093940.714776:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1784093940.714776:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024276480:0@lo:400:kworker.0 00000100:00100000:3.0:1784093940.714787:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024276352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093940.714841:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024276352:12345-0@lo:400:kworker.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.714847:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1784093940.714920:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024276352:0@lo:400:kworker.0 00000100:00100000:1.0:1784093940.856405:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093940.856463:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748096 00000100:00100000:3.0:1784093940.856475:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748096 00000100:00100000:3.0:1784093940.856550:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:3.0:1784093940.856559:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748096:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093940.856648:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748096:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.856653:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:0.0:1784093940.857411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093940.857461:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748224 00000100:00100000:1.0:1784093940.857467:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748224 00000100:00100000:1.0:1784093940.857504:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 351 00000100:00100000:1.0:1784093940.857512:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748224:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093940.857826:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748224:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 313us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093940.857833:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 351 00000100:00100000:2.0:1784093940.858473:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093940.858526:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748352 00000100:00100000:3.0:1784093940.858530:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748352 00000100:00100000:3.0:1784093940.858556:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 352 00000100:00100000:3.0:1784093940.858561:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748352:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093940.858771:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748352:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 207us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.858782:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 352 00000100:00100000:0.0:1784093940.859463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093940.859507:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748480 00000100:00100000:3.0:1784093940.859512:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748480 00000100:00100000:3.0:1784093940.859550:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 704 00000100:00100000:3.0:1784093940.859558:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748480:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093940.859815:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748480:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 257us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.859822:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 704 00000100:00100000:0.0:1784093940.861016:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093940.861075:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748608 00000100:00100000:1.0:1784093940.861081:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748608 00000100:00100000:1.0:1784093940.861115:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 705 00000100:00100000:1.0:1784093940.861125:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748608:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093940.861179:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748608:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 55us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093940.861188:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 705 00000100:00100000:2.0:1784093940.861795:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093940.861838:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748736 00000100:00100000:3.0:1784093940.861844:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748736 00000100:00100000:3.0:1784093940.861875:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 353 00000100:00100000:3.0:1784093940.861882:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748736:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093940.862119:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748736:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 237us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.862127:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 353 00000100:00100000:0.0:1784093940.862859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093940.862905:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748864 00000100:00100000:1.0:1784093940.862910:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748864 00000100:00100000:1.0:1784093940.862939:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 354 00000100:00100000:1.0:1784093940.862944:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748864:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093940.863145:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47428:x1870757013748864:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 200us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093940.863150:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 354 00000100:00100000:0.0:1784093940.863819:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093940.863863:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013748992 00000100:00100000:3.0:1784093940.863867:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013748992 00000100:00100000:3.0:1784093940.863897:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 706 00000100:00100000:3.0:1784093940.863903:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748992:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093940.864143:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47428:x1870757013748992:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 239us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093940.864151:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 706 00010000:00010000:0.0:1784093941.226751:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093941.350976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.351016:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013749120 00000100:00100000:3.0:1784093941.351025:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013749120 00000100:00100000:3.0:1784093941.351080:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 707 00000100:00100000:3.0:1784093941.351091:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47442:x1870757013749120:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093941.351111:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093941.351131:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf591a expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.351187:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.351200:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.351211:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093941.351414:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1784093941.351418:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093941.351539:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.351564:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf591a expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.351590:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf591a expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.351599:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12900) 00010000:00010000:3.0:1784093941.351602:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093941.351605:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784093941.351660:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47442:x1870757013749120:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 572us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093941.351668:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 707 00000100:00100000:0.0:1784093941.352827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.352864:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013749376 00000100:00100000:3.0:1784093941.352869:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013749376 00000100:00100000:3.0:1784093941.352899:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 708 00000100:00100000:3.0:1784093941.352909:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47442:x1870757013749376:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093941.352940:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093941.352958:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf591a expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.352978:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cabda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5905 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.352988:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907219c12900) 00010000:00010000:3.0:1784093941.352998:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093941.353017:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.353027:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.353036:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093941.361164:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967567 is committed 00000004:00010000:3.0:1784093941.361180:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004e9970f4 reply state 0000000040fc8d60 transno 4294967567 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093941.361194:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093941.361291:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00080000:3.0:1784093941.361380:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093941.361398:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47442:x1870757013749376:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 8487us (8568us total) trans 4294967567 rc 0/0 00000100:00100000:3.0:1784093941.361408:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 708 00010000:00010000:1.0:1784093941.361445:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.361456:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.361462:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.361467:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093941.361471:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.361476:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.361490:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784093941.361494:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093941.361499:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.361506:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093941.377392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.377483:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013749504 00000100:00100000:3.0:1784093941.377494:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013749504 00000100:00100000:3.0:1784093941.377559:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 709 00000100:00100000:3.0:1784093941.377572:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47446:x1870757013749504:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093941.377609:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093941.377631:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5921 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.377689:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.377704:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.377716:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.377732:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.377740:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.377748:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378293:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cac5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378302:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cac5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378310:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cac5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093941.378417:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1784093941.378443:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093941.378542:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cac5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378555:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378561:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378568:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378574:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.378590:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378597:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378609:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:3.0:1784093941.378613:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.378617:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378623:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cac51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378633:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378638:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378644:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378649:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.378653:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378659:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378668:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fce500) 00010000:00010000:3.0:1784093941.378671:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.378674:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378680:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cac58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378713:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cac4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5921 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378733:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cac5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5921 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.378740:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093941.378743:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093941.378745:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093941.378808:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47446:x1870757013749504:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1240us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093941.378815:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 709 00000100:00100000:2.0:1784093941.379824:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.380039:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013749760 00000100:00100000:3.0:1784093941.380045:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013749760 00000100:00100000:3.0:1784093941.380077:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 710 00000100:00100000:3.0:1784093941.380085:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47446:x1870757013749760:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093941.380094:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093941.380105:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cac66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5928 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.380280:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.380290:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.380298:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.380311:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.380319:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.380326:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093941.381270:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:3.0:1784093941.381544:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cac7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381553:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cac7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381560:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cac7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381603:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381611:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381617:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381622:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.381625:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381632:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381645:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093941.381647:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.381650:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381656:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cac6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093941.381664:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000dce12c61 reply state 0000000094099e6e transno 4294967568 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093941.381673:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784093941.381693:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cac66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5928 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381705:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cac7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5928 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.381712:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784093941.381714:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093941.381716:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093941.381758:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:47446:x1870757013749760:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1673us (1934us total) trans 4294967568 rc 0/0 00000100:00100000:3.0:1784093941.381764:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 710 00010000:00010000:2.0:1784093941.382268:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.382276:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.382283:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.382289:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093941.382292:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.382298:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.382308:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907204fce900) 00010000:00010000:2.0:1784093941.382311:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093941.382313:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.382320:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cac74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093941.382992:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.383064:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013750016 00000100:00100000:3.0:1784093941.383070:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013750016 00000100:00100000:3.0:1784093941.383102:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 711 00000100:00100000:3.0:1784093941.383111:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:47446:x1870757013750016:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:3.0:1784093941.383138:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093941.383152:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cac7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5928 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.383163:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784093941.383169:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093941.383189:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.383198:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.383205:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093941.383272:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bb9592af reply state 00000000c9ea159f transno 4294967569 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093941.383279:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093941.383327:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:47446:x1870757013750016:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 216us (335us total) trans 4294967569 rc 0/0 00000100:00100000:3.0:1784093941.383335:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 711 00010000:00010000:3.0:1784093941.384598:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.384608:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.384615:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.384625:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.384629:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.384636:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.384648:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784093941.384651:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.384656:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093941.384657:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:3.0:1784093941.384667:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cac89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093941.384695:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013750144 00000100:00100000:1.0:1784093941.384701:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013750144 00000100:00100000:1.0:1784093941.384739:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 712 00000100:00100000:1.0:1784093941.384751:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:47446:x1870757013750144:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784093941.384764:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093941.384780:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf592f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.384815:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf592f expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.384829:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf592f expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.384845:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093941.384847:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784093941.384849:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784093941.384880:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:47446:x1870757013750144:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 135us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093941.384887:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 712 00000100:00100000:3.0:1784093941.385681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093941.385734:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013750272 00000100:00100000:1.0:1784093941.385739:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013750272 00000100:00100000:1.0:1784093941.385782:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 355 00000100:00100000:1.0:1784093941.385794:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013750272:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:1.0:1784093941.386100:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013750272:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 310us (422us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1784093941.386106:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 355 00000100:00100000:3.0:1784093941.386835:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093941.386873:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013750528 00000100:00100000:0.0:1784093941.386878:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013750528 00000100:00100000:0.0:1784093941.386909:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 75 00000100:00100000:0.0:1784093941.386915:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:47446:x1870757013750528:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:0.0:1784093941.387080:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:47446:x1870757013750528:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 164us (245us total) trans 4294967570 rc 0/0 00000100:00100000:0.0:1784093941.387086:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 75 00000100:00100000:0.0:1784093941.402772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.402817:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013750656 00000100:00100000:3.0:1784093941.402825:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013750656 00000100:00100000:3.0:1784093941.402866:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 713 00000100:00100000:3.0:1784093941.402874:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:47450:x1870757013750656:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:3.0:1784093941.402893:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093941.402908:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214cac97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5936 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.402954:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.402963:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.402972:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.402979:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.402983:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.402987:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403076:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403084:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403091:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093941.403118:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 0 00000004:00200000:3.0:1784093941.403121:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093941.403134:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403143:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403148:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403155:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403160:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403163:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200030600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.403166:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403171:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403190:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093941.403193:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.403198:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403203:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030600/0x9ce98053214cac9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403213:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403219:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403226:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403232:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907200031400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.403235:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403241:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403246:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907204fce600) 00010000:00010000:3.0:1784093941.403248:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.403249:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403253:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031400/0x9ce98053214caca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403273:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200031a00/0x9ce98053214cac97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5936 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403281:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5936 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.403286:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907219c12000) 00010000:00010000:3.0:1784093941.403287:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093941.403289:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907200030800, rc 0) 00000100:00100000:3.0:1784093941.403340:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:47450:x1870757013750656:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 468us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093941.403345:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 713 00000100:00100000:3.0:1784093941.404607:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093941.404665:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013750784 00000100:00100000:2.0:1784093941.404671:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013750784 00000100:00100000:2.0:1784093941.404706:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 356 00000100:00100000:2.0:1784093941.404713:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013750784:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784093941.404723:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093941.404736:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf593d expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093941.404757:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x6a571cf5, atime: 0x6a571cf5, ctime: 0x6a571cf5, blocks: 0x1 00010000:00010000:2.0:1784093941.404770:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1102s v=(0 0) 00010000:00010000:2.0:1784093941.404774:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093941.404782:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.404797:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.404807:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093941.404838:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013750784:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 126us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093941.404845:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 356 00000100:00100000:2.0:1784093941.406370:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.406398:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013751040 00000100:00100000:3.0:1784093941.406402:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013751040 00000100:00100000:3.0:1784093941.406443:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 714 00000100:00100000:3.0:1784093941.406449:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:47450:x1870757013751040:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:3.0:1784093941.406474:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093941.406487:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907200030800/0x9ce98053214cacac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5936 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406498:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cac90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf592f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406504:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907219c12000) 00010000:00010000:3.0:1784093941.406511:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093941.406521:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406528:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406533:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406540:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406544:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406548:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406626:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406634:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.406638:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093941.407010:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:3.0:1784093941.407017:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1102484594712ns, next at 1103484593207ns, rc = 0 00010000:00010000:3.0:1784093941.407062:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407068:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407073:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407077:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407081:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407085:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407099:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093941.407117:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407121:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407125:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093941.407126:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407133:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.407135:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407141:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407142:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407153:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093941.407159:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093941.407162:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407166:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cacc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407166:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093941.407174:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407179:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407185:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407186:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407200:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407205:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.407206:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407208:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff907204fce500) 00010000:00010000:0.0:1784093941.407216:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784093941.407217:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407221:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407225:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093941.407229:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093941.407232:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.407235:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caccf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.407238:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cacba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093941.407253:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006c870d03 reply state 000000007cf298e9 transno 4294967571 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093941.407259:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093941.407262:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093941.407266:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093941.407269:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093941.407297:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:47450:x1870757013751040:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 848us (929us total) trans 4294967571 rc 0/0 00000100:00100000:3.0:1784093941.407302:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 714 00010000:00010000:2.0:1784093941.407901:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.407911:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.407921:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.407926:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093941.407929:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.407936:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.407945:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907204fce000) 00010000:00010000:2.0:1784093941.407948:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093941.407951:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.407957:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cacc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093941.705911:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093941.705965:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013751168 00000100:00100000:1.0:1784093941.705973:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013751168 00000100:00100000:1.0:1784093941.706028:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 715 00000100:00100000:1.0:1784093941.706039:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:47465:x1870757013751168:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093941.706061:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093941.706080:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cacd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5944 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.706137:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cacdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.706151:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cacdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.706163:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cacdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093941.706220:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:1.0:1784093941.706224:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093941.706251:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cacdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.706274:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cacd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5944 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.706285:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cacdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5944 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.706291:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093941.706293:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093941.706296:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093941.706352:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:47465:x1870757013751168:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 315us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093941.706359:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 715 00000100:00100000:1.0:1784093941.707403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093941.707480:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013751424 00000100:00100000:3.0:1784093941.707486:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013751424 00000100:00100000:3.0:1784093941.707523:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 716 00000100:00100000:3.0:1784093941.707533:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:47465:x1870757013751424:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093941.707561:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093941.707596:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cacdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5944 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.707613:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cac5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5921 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.707630:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093941.707639:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093941.707655:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.707664:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.707672:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784093941.715153:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967570 is committed 00000001:00080000:2.0:1784093941.715166:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967572 is committed 00000004:00010000:1.0:1784093941.715166:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008ed56007 reply state 00000000fe449f5a transno 4294967572 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784093941.715171:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 57 committed 00000100:00100000:1.0:1784093941.715178:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093941.715274:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:2.0:1784093941.715290:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024276608:0@lo:6:osp-syn-1-0.0 00010000:00080000:1.0:1784093941.715344:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784093941.715345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093941.715361:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47465:x1870757013751424:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 7830us (7956us total) trans 4294967572 rc 0/0 00010000:00010000:3.0:1784093941.715370:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093941.715370:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 716 00010000:00010000:3.0:1784093941.715380:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.715386:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.715391:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093941.715395:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.715400:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093941.715403:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276608 00010000:00010000:3.0:1784093941.715411:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce200) 00000100:00100000:2.0:1784093941.715411:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276608 00010000:00010000:3.0:1784093941.715415:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784093941.715418:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093941.715445:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cace4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093941.715471:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1784093941.715481:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024276608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784093941.715500:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00010000:00010000:2.0:1784093941.715516:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.715533:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.715542:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093941.715547:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093941.715551:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.715589:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.715604:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 6 pid: 6573 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093941.715616:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024276736:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093941.715660:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907101b106c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784093941.716444:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024276736:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784093941.716462:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093941.716556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093941.716598:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013751552 00000100:00100000:1.0:1784093941.716602:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013751552 00010000:00010000:1.0:1784093941.716619:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 7 pid: 6573 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093941.716640:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 282 00000100:00100000:1.0:1784093941.716648:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013751552:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093941.716655:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093941.716660:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 7 pid: 6573 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716668:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 7 pid: 6573 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716680:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d4c9b07/0x9ce98053214cacb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf593d expref: 7 pid: 6573 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716689:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093941.716692:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093941.716696:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716701:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716720:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093941.716742:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093941.716749:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013751552:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 102us (193us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093941.716757:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093941.716758:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 282 00010000:00010000:2.0:1784093941.716766:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.716774:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093941.716792:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093941.716802:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093941.716808:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716815:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093941.716819:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716826:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716837:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716844:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214caceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093941.716864:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093941.716866:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093941.716867:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093941.717205:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024276608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1725us (1858us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1784093941.717213:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000004:00080000:1.0:1784093941.717224:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907226111500/2, rc 0, transno 4294967341 00000100:00100000:1.0:1784093941.717230:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024276608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784093941.730678:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093941.730730:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013751680 00000100:00100000:0.0:1784093941.730741:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013751680 00000100:00100000:0.0:1784093941.730796:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 717 00000100:00100000:0.0:1784093941.730806:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:47469:x1870757013751680:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093941.730828:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093941.730846:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cacf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf594b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.730902:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.730916:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.730928:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.730958:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.730964:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.730970:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731549:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cad07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731555:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cad07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731561:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cad07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784093941.731681:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:0.0:1784093941.731685:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784093941.731779:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cad07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731790:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731794:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731799:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731803:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093941.731806:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731810:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731819:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093941.731821:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093941.731823:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731827:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cacf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731835:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731839:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731846:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731849:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093941.731851:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731854:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731858:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907202e6b600) 00010000:00010000:0.0:1784093941.731860:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093941.731861:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731864:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cad00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731890:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cacf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf594b expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731904:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cad07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf594b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093941.731912:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784093941.731914:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784093941.731917:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784093941.731966:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47469:x1870757013751680:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1163us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093941.731974:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 717 00000100:00100000:0.0:1784093942.031350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093942.031596:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013751808 00000100:00100000:3.0:1784093942.031608:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013751808 00000100:00080000:0.0:1784093942.031670:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093942.031751:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 718 00000100:00100000:3.0:1784093942.031763:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47483:x1870757013751808:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093942.031784:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093942.031809:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5952 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.031875:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.031891:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.031907:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093942.032118:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1784093942.032122:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093942.032197:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.032226:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5952 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.032248:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5952 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.032257:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:3.0:1784093942.032260:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093942.032263:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093942.032328:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47483:x1870757013751808:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 569us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093942.032335:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 718 00000100:00100000:0.0:1784093942.033961:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093942.034010:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752064 00000100:00100000:3.0:1784093942.034017:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752064 00000100:00100000:3.0:1784093942.034053:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 719 00000100:00100000:3.0:1784093942.034062:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47483:x1870757013752064:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093942.034099:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093942.034116:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5952 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.034129:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cad07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf594b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.034139:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:3.0:1784093942.034149:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093942.034170:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.034182:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.034192:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093942.034640:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e543aec2 reply state 00000000f8eebecb transno 4294967573 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093942.034650:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093942.034708:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000100:00100000:3.0:1784093942.034787:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47483:x1870757013752064:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 725us (827us total) trans 4294967573 rc 0/0 00000100:00100000:3.0:1784093942.034798:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 719 00010000:00010000:1.0:1784093942.035407:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.035622:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.035629:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.035635:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093942.035639:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.035647:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.035659:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fceb00) 00010000:00010000:1.0:1784093942.035663:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093942.035667:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.035674:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cad1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093942.079203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093942.079246:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752192 00000100:00100000:3.0:1784093942.079256:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752192 00000100:00100000:3.0:1784093942.079309:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 720 00000100:00100000:3.0:1784093942.079319:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013752192:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093942.079412:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013752192:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093942.079418:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 720 00000100:00100000:3.0:1784093942.080094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093942.080134:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752320 00000100:00100000:1.0:1784093942.080140:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752320 00000100:00100000:1.0:1784093942.080180:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 358 00000100:00100000:1.0:1784093942.080188:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47495:x1870757013752320:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:0.0:1784093942.080192:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093942.080444:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47495:x1870757013752320:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 233us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093942.080453:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 358 00000100:00100000:1.0:1784093942.081038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093942.081087:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752448 00000100:00100000:2.0:1784093942.081092:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752448 00000100:00100000:2.0:1784093942.081132:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 359 00000100:00080000:1.0:1784093942.081137:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093942.081144:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:47495:x1870757013752448:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093942.081328:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:47495:x1870757013752448:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 187us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093942.081336:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 359 00000100:00100000:0.0:1784093942.082323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093942.082360:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752576 00000100:00100000:3.0:1784093942.082365:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752576 00000100:00100000:3.0:1784093942.082395:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 721 00000100:00100000:3.0:1784093942.082403:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013752576:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093942.082724:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013752576:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 320us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093942.082731:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 721 00000100:00100000:3.0:1784093942.084111:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093942.084148:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752704 00000100:00100000:1.0:1784093942.084154:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752704 00000100:00100000:1.0:1784093942.084186:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 722 00000100:00100000:1.0:1784093942.084192:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013752704:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093942.084249:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013752704:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 58us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093942.084254:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 722 00000100:00100000:1.0:1784093942.084776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093942.084829:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752832 00000100:00100000:2.0:1784093942.084835:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752832 00000100:00100000:2.0:1784093942.084867:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 360 00000100:00100000:2.0:1784093942.084874:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47495:x1870757013752832:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093942.085104:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:47495:x1870757013752832:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 229us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093942.085111:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 360 00000100:00100000:0.0:1784093942.085726:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093942.085757:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013752960 00000100:00100000:1.0:1784093942.085762:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013752960 00000100:00100000:1.0:1784093942.085795:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 361 00000100:00100000:1.0:1784093942.085802:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47495:x1870757013752960:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093942.085962:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47495:x1870757013752960:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 160us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093942.085966:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 361 00000100:00100000:3.0:1784093942.086472:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093942.086509:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753088 00000100:00100000:0.0:1784093942.086514:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753088 00000100:00100000:0.0:1784093942.086541:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 723 00000100:00100000:0.0:1784093942.086546:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013753088:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093942.086783:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:47495:x1870757013753088:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 235us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093942.086788:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 723 00000100:00100000:0.0:1784093942.105099:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093942.105143:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753216 00000100:00100000:3.0:1784093942.105151:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753216 00000100:00100000:3.0:1784093942.105195:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 724 00000100:00100000:3.0:1784093942.105203:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:47499:x1870757013753216:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784093942.105219:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093942.105234:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5959 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105289:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105303:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105312:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105322:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105327:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105330:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105709:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cad38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105715:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cad38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105720:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cad38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093942.105769:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:3.0:1784093942.105772:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093942.105820:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cad38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105830:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105833:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105838:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105841:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093942.105844:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105849:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105856:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:3.0:1784093942.105858:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093942.105861:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105864:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cad2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105874:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105878:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105881:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105884:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093942.105885:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105888:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105892:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fce300) 00010000:00010000:3.0:1784093942.105893:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093942.105894:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105897:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cad31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105915:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cad23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5959 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105923:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cad38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5959 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.105931:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784093942.105932:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093942.105934:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784093942.105979:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47499:x1870757013753216:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 778us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093942.105984:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 724 00000100:00100000:2.0:1784093942.106938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093942.106997:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753472 00000100:00100000:1.0:1784093942.107003:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753472 00000100:00100000:1.0:1784093942.107039:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 725 00000100:00100000:1.0:1784093942.107048:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47499:x1870757013753472:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784093942.107058:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093942.107067:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cad3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5960 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.107287:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.107297:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.107305:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.107316:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.107324:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.107331:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093942.107987:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:1.0:1784093942.108153:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cad54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108160:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cad54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108165:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cad54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108188:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108195:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108201:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108207:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093942.108210:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108215:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108223:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fcef00) 00010000:00010000:1.0:1784093942.108226:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093942.108230:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108236:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cad46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093942.108245:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000001dc96154 reply state 00000000dd98563b transno 4294967574 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093942.108251:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093942.108268:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cad3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5960 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108278:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cad54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5960 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093942.108283:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093942.108285:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093942.108286:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784093942.108319:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:47499:x1870757013753472:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1273us (1383us total) trans 4294967574 rc 0/0 00000100:00100000:1.0:1784093942.108323:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 725 00010000:00010000:2.0:1784093942.108942:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093942.108950:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093942.108957:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093942.108963:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093942.108967:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093942.108972:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093942.108981:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907219c12c00) 00010000:00010000:2.0:1784093942.108983:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093942.108986:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093942.108992:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cad4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093942.111321:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093942.111359:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753600 00000100:00100000:3.0:1784093942.111368:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753600 00000100:00100000:3.0:1784093942.111509:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:3.0:1784093942.111518:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:47499:x1870757013753600:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784093942.111531:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093942.111547:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5967 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784093942.111580:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784093942.111596:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=1103s v=(0 0) 00010000:00010000:3.0:1784093942.111600:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093942.111608:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 6 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.111623:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 6 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093942.111633:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784093942.111673:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:47499:x1870757013753600:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 157us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093942.111680:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:0.0:1784093942.120763:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093942.120823:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753728 00000100:00100000:1.0:1784093942.120831:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753728 00002000:00100000:1.0:1784093942.120871:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff907226110700 x1870757013753728/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:263/0 lens 488/0 e 0 to 0 dl 1784093953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093942.120878:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907226110700 with x1870757013753728 ext(0->1048575) 00002000:00010000:1.0:1784093942.120883:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907226110700 00000100:00100000:1.0:1784093942.120907:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 17 00000100:00100000:1.0:1784093942.120913:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013753728:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:1.0:1784093942.127160:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013753728:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 6237us (6396us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1784093942.127172:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 17 00002000:00100000:1.0:1784093942.127186:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff907226110700 x1870757013753728/t4294967342(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:263/0 lens 488/448 e 0 to 0 dl 1784093953 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093942.127197:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907226110700 with x1870757013753728 ext(0->1048575) 00002000:00010000:1.0:1784093942.127206:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907226110700 00000100:00100000:2.0:1784093942.130825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093942.130884:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753856 00000100:00100000:0.0:1784093942.130894:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753856 00000100:00100000:0.0:1784093942.130948:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 726 00000100:00100000:0.0:1784093942.130959:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:47499:x1870757013753856:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:2.0:1784093942.140007:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967574 is committed 00000100:00100000:3.0:1784093942.140123:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47499:x1870757013753856:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 9161us (9297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093942.140141:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 726 00000100:00100000:0.0:1784093942.141147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093942.141190:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013753984 00000100:00100000:2.0:1784093942.141199:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013753984 00000100:00100000:2.0:1784093942.141244:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 363 00000100:00100000:2.0:1784093942.141253:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013753984:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:3.0:1784093942.149999:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000100:00100000:1.0:1784093942.150090:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013753984:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 8831us (8936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093942.150102:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 363 00000100:00100000:0.0:1784093942.151311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093942.151463:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013754240 00000100:00100000:1.0:1784093942.151472:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013754240 00000100:00100000:1.0:1784093942.151519:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 76 00000100:00100000:1.0:1784093942.151529:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47499:x1870757013754240:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784093942.151918:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:47499:x1870757013754240:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 391us (608us total) trans 4294967575 rc 0/0 00000100:00100000:1.0:1784093942.151926:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 76 00010000:00010000:3.0:1784093942.249554:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784093942.574670:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967575 is committed 00000100:00100000:1.0:1784093942.762540:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024276864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093942.762611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093942.762655:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276864 00000100:00100000:0.0:1784093942.762663:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276864 00000100:00080000:3.0:1784093942.762699:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093942.762723:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1784093942.762732:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024276864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093942.762761:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1784093942.762810:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024276864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093942.762816:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1784093942.762865:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024276864:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1784093942.991658:0:80636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1104069233310ns, next at 1086292127691ns, rc = 0 00000004:00080000:0.0:1784093942.991756:0:80636:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1104069333158ns, next at 1103484593207ns, rc = 0 00000004:00080000:2.0:1784093942.992633:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 59 committed 00000004:00080000:2.0:1784093942.993212:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 58 committed 00010000:00010000:0.0:1784093943.273597:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093943.462205:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000001:00080000:0.0:1784093943.462224:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00000100:00100000:0.0:1784093943.494586:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093943.494634:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013754368 00000100:00100000:3.0:1784093943.494642:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013754368 00000100:00100000:3.0:1784093943.494690:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 727 00000100:00100000:3.0:1784093943.494699:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013754368:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093943.494793:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013754368:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 95us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093943.494800:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 727 00000100:00100000:0.0:1784093943.495578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093943.495609:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013754496 00000100:00100000:1.0:1784093943.495614:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013754496 00000100:00100000:1.0:1784093943.495641:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 364 00000100:00100000:1.0:1784093943.495649:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47691:x1870757013754496:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093943.495905:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:47691:x1870757013754496:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 258us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093943.495910:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 364 00000100:00100000:0.0:1784093943.496528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093943.496582:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013754624 00000100:00100000:3.0:1784093943.496587:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013754624 00000100:00100000:3.0:1784093943.496624:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 365 00000100:00100000:3.0:1784093943.496632:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:47691:x1870757013754624:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093943.496876:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:47691:x1870757013754624:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 244us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093943.496884:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 365 00000100:00100000:0.0:1784093943.497561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093943.497590:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013754752 00000100:00100000:1.0:1784093943.497594:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013754752 00000100:00100000:1.0:1784093943.497620:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 728 00000100:00100000:1.0:1784093943.497626:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013754752:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784093943.497871:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013754752:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 245us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093943.497876:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 728 00000100:00100000:0.0:1784093943.499499:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093943.499548:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013754880 00000100:00100000:3.0:1784093943.499556:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013754880 00000100:00100000:3.0:1784093943.499601:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 729 00000100:00100000:3.0:1784093943.499611:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013754880:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093943.499678:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013754880:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093943.499687:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 729 00000100:00100000:0.0:1784093943.500441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093943.500485:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755008 00000100:00100000:1.0:1784093943.500490:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755008 00000100:00100000:1.0:1784093943.500526:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 366 00000100:00100000:1.0:1784093943.500546:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:47691:x1870757013755008:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093943.500876:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:47691:x1870757013755008:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 341us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093943.500882:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 366 00000100:00100000:1.0:1784093943.501925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093943.501957:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755136 00000100:00100000:2.0:1784093943.501963:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755136 00000100:00100000:2.0:1784093943.502002:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 367 00000100:00100000:2.0:1784093943.502010:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47691:x1870757013755136:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093943.502313:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:47691:x1870757013755136:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 302us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093943.502321:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 367 00000100:00100000:0.0:1784093943.503101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093943.503130:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755264 00000100:00100000:0.0:1784093943.503135:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755264 00000100:00100000:0.0:1784093943.503173:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 730 00000100:00100000:0.0:1784093943.503181:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013755264:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093943.503680:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:47691:x1870757013755264:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 498us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093943.503688:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 730 00000100:00100000:3.0:1784093943.525549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093943.525587:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755520 00000100:00100000:1.0:1784093943.525596:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755520 00000100:00100000:1.0:1784093943.525649:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 731 00000100:00100000:1.0:1784093943.525660:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:47695:x1870757013755520:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:1.0:1784093943.525706:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093943.525734:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cad54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5960 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.525750:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093943.525762:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093943.525783:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.525797:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.525812:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.525826:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.525832:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.525838:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526125:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526134:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526142:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093943.526761:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9664 00000004:00080000:1.0:1784093943.526769:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1104604346520ns, next at 1105604344405ns, rc = 0 00010000:00010000:1.0:1784093943.526834:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526844:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526852:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526863:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526870:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526877:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526896:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093943.526914:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526917:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093943.526921:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526924:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526926:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526932:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093943.526932:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093943.526937:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526937:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526945:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526945:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526953:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093943.526956:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093943.526959:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526962:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff907219c12c00) 00010000:00010000:0.0:1784093943.526964:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093943.526967:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526970:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cad77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526973:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cad7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526984:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093943.526984:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093943.526985:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093943.526987:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093943.526990:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.526995:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527000:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093943.527003:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527008:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527016:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fcef00) 00010000:00010000:1.0:1784093943.527018:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093943.527021:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527026:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cad69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093943.527035:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b5083a84 reply state 00000000fa1913e8 transno 4294967576 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093943.527044:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093943.527115:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:47695:x1870757013755520:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1456us (1583us total) trans 4294967576 rc 0/0 00000100:00100000:1.0:1784093943.527123:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 731 00010000:00010000:1.0:1784093943.527772:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527781:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527787:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527793:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093943.527795:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527799:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527806:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff907219c12500) 00010000:00010000:1.0:1784093943.527808:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093943.527809:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093943.527817:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cad70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093944.257626:0:80783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1105335201930ns, next at 1105604344405ns, rc = 0 00000001:00080000:2.0:1784093944.266021:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967576 is committed 00000004:00080000:2.0:1784093944.266032:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 60 committed 00000004:00080000:2.0:1784093944.266049:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 61 committed 00000100:00100000:0.0:1784093944.266169:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024276992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784093944.266235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093944.266272:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024276992 00000100:00100000:3.0:1784093944.266279:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024276992 00000100:00100000:3.0:1784093944.266325:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1784093944.266332:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024276992:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1784093944.266335:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1784093944.266354:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:23 count 1 00010000:00010000:3.0:1784093944.266373:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093944.266390:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093944.266395:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1784093944.266398:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784093944.266401:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093944.266435:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093944.266445:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 5 pid: 6573 timeout: 1205 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093944.266457:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024277120:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093944.266508:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907225ccb540 going to sleep for 11 seconds 00000100:00100000:3.0:1784093944.267655:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024277120:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784093944.267674:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093944.267812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093944.267864:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755648 00000100:00100000:2.0:1784093944.267868:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755648 00000100:00080000:1.0:1784093944.267895:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784093944.267900:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 6 pid: 6573 timeout: 1205 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093944.267926:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 283 00000100:00100000:2.0:1784093944.267933:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013755648:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093944.267948:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093944.267954:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 6 pid: 6573 timeout: 1205 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093944.267967:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 6 pid: 6573 timeout: 1205 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093944.267987:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cad62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5967 expref: 6 pid: 6573 timeout: 1205 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093944.267998:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093944.268002:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093944.268007:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093944.268016:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093944.268034:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093944.268042:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093944.268050:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093944.268060:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093944.268066:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013755648:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 134us (256us total) trans 0 rc 0/0 00010000:00010000:3.0:1784093944.268068:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093944.268074:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 283 00010000:00010000:3.0:1784093944.268087:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093944.268115:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093944.268124:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093944.268135:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093944.268140:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093944.268159:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093944.268172:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093944.268179:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093395f5f/0x9ce98053214cad85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093944.268197:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093944.268199:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093944.268200:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093944.268565:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024276992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2233us (2331us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1784093944.268571:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000004:00080000:0.0:1784093944.268607:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9071026bea00/2, rc 0, transno 4294967343 00000100:00100000:0.0:1784093944.268620:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024276992:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1784093944.268767:0:80783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1105346344874ns, next at 1103484593207ns, rc = 0 00000004:00080000:2.0:1784093944.269627:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 59 committed 00010000:00010000:1.0:1784093944.297552:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093945.208416:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093945.208545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093945.208574:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093945.208603:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755904 00000100:00100000:0.0:1784093945.208612:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093945.208614:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755904 00000100:00100000:0.0:1784093945.208640:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756160 00000100:00100000:0.0:1784093945.208645:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756160 00000100:00100000:3.0:1784093945.208680:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 738 00000100:00100000:0.0:1784093945.208684:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756032 00000100:00100000:0.0:1784093945.208688:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756032 00000100:00100000:3.0:1784093945.208693:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013755904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093945.208709:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 532 00000100:00100000:0.0:1784093945.208718:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013756160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093945.208768:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013755904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093945.208776:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 738 00000100:00100000:1.0:1784093945.208803:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 533 00000100:00100000:1.0:1784093945.208814:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013756032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784093945.208839:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093945.208844:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093945.208869:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013756160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 152us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093945.208878:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 532 00000100:00100000:2.0:1784093945.208934:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013755776 00000100:00100000:2.0:1784093945.208938:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013755776 00000100:00100000:2.0:1784093945.208980:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 741 00000100:00100000:2.0:1784093945.208987:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013755776:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093945.209023:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013755776:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093945.209033:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 741 00000100:00100000:1.0:1784093945.209125:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013756032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 312us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093945.209132:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 533 00010000:00010000:0.0:1784093945.321566:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093945.833653:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784093945.833675:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024277504:0@lo:400:kworker.0 00000100:00100000:1.0:1784093945.833710:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024277632:0@lo:400:kworker.0 00000100:00100000:0.0:1784093945.833749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093945.833758:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024277888:0@lo:400:kworker.0 00000100:00100000:1.0:1784093945.833780:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024277504 00000100:00100000:1.0:1784093945.833788:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024277504 00000100:00100000:3.0:1784093945.833796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093945.833816:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024277376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093945.833826:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093945.833835:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024278016:0@lo:400:kworker.0 00000100:00100000:1.0:1784093945.833836:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024277888 00000100:00100000:1.0:1784093945.833843:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024277888 00000100:00100000:0.0:1784093945.833852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093945.833876:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093945.833901:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024277376 00000100:00100000:1.0:1784093945.833904:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1784093945.833906:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024277376 00000100:00100000:1.0:1784093945.833918:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024277504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093945.833923:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1784093945.833935:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024277888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093945.833942:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1784093945.833950:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024277376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784093945.833975:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093945.833991:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024277504:12345-0@lo:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093945.833992:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024277888:12345-0@lo:400:kworker.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093945.834003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1784093945.834019:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024277376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093945.834026:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1784093945.834054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093945.834065:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024277504:0@lo:400:kworker.0 00000100:00100000:0.0:1784093945.834078:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:0.0:1784093945.834083:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907226111500, transno 4294967341 00000100:00100000:1.0:1784093945.834089:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784093945.834097:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1784093945.834102:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024277248:0@lo:400:kworker.0 00000100:00100000:0.0:1784093945.834102:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024277376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093945.834115:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024277632 00000100:00100000:3.0:1784093945.834120:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024277632 00000100:00100000:1.0:1784093945.834141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093945.834162:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024277760:0@lo:400:kworker.0 00000100:00100000:3.0:1784093945.834205:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1784093945.834212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093945.834217:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024277632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093945.834242:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278016 00000100:00100000:2.0:1784093945.834248:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278016 00000100:00100000:3.0:1784093945.834266:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024277632:12345-0@lo:400:kworker.0 Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093945.834273:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1784093945.834283:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024277760 00000100:00100000:2.0:1784093945.834287:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024277760 00000100:00100000:3.0:1784093945.834308:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1784093945.834318:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024278016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093945.834334:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1784093945.834346:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024277760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093945.834358:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024278016:12345-0@lo:400:kworker.0 Request processed in 42us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093945.834363:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1784093945.834397:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024277760:12345-0@lo:400:kworker.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093945.834404:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024278016:0@lo:400:kworker.0 00000100:00100000:2.0:1784093945.834409:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1784093945.834412:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024277248 00000100:00100000:1.0:1784093945.834418:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024277248 00000100:00100000:3.0:1784093945.834442:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024277888:0@lo:400:kworker.0 00000100:00080000:2.0:1784093945.834454:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093945.834461:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093945.834480:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1784093945.834502:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024277248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093945.834535:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024277760:0@lo:400:kworker.0 00000100:00100000:1.0:1784093945.834546:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024277248:12345-0@lo:400:kworker.0 Request processed in 56us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093945.834551:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024277632:0@lo:400:kworker.0 00000100:00100000:1.0:1784093945.834557:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1784093945.834572:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024277248:0@lo:400:kworker.0 00010000:00010000:0.0:1784093946.345552:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093947.369594:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093947.881634:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024278144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093947.881723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093947.881766:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278144 00000100:00100000:0.0:1784093947.881777:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278144 00000100:00080000:2.0:1784093947.881823:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093947.881850:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1784093947.881861:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024278144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093947.881903:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784093947.881955:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024278144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093947.881960:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1784093947.882004:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024278144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784093948.393599:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093948.915747:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00010000:00010000:0.0:1784093949.417660:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093950.328513:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093950.328559:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093950.328584:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093950.328612:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756288 00000100:00100000:0.0:1784093950.328622:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756288 00000100:00100000:2.0:1784093950.328631:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093950.328644:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756544 00000100:00100000:3.0:1784093950.328650:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756544 00000100:00100000:2.0:1784093950.328662:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756672 00000100:00100000:2.0:1784093950.328667:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756672 00000100:00100000:0.0:1784093950.328686:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 743 00000100:00100000:1.0:1784093950.328688:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756416 00000100:00100000:1.0:1784093950.328697:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756416 00000100:00100000:0.0:1784093950.328701:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013756288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093950.328707:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:2.0:1784093950.328716:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 537 00000100:00100000:3.0:1784093950.328722:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013756544:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093950.328731:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013756672:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093950.328738:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 742 00000100:00100000:1.0:1784093950.328750:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013756416:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093950.328786:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013756288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093950.328788:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013756544:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093950.328788:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013756672:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 58us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093950.328791:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013756416:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 42us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093950.328804:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 743 00000100:00100000:3.0:1784093950.328810:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:1.0:1784093950.328811:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 742 00000100:00100000:2.0:1784093950.328830:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 537 00000100:00080000:2.0:1784093950.328856:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093950.328860:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093950.328863:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784093950.441554:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093950.953589:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024278272:0@lo:400:kworker.0 00000100:00100000:0.0:1784093950.953589:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024278528:0@lo:400:kworker.0 00000100:00100000:2.0:1784093950.953606:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024278400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093950.953607:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024278656:0@lo:400:kworker.0 00000100:00100000:0.0:1784093950.953685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093950.953687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093950.953691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093950.953716:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278528 00000100:00100000:3.0:1784093950.953724:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278528 00000100:00100000:2.0:1784093950.953747:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024278784:0@lo:400:kworker.0 00000100:00100000:1.0:1784093950.953757:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024278912:0@lo:400:kworker.0 00000100:00100000:0.0:1784093950.953758:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024279040:0@lo:400:kworker.0 00000100:00100000:3.0:1784093950.953768:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1784093950.953774:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093950.953779:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024278528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093950.953804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093950.953811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093950.953812:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278784 00000100:00100000:2.0:1784093950.953816:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278784 00000100:00100000:3.0:1784093950.953832:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024278528:12345-0@lo:400:kworker.0 Request processed in 56us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093950.953839:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1784093950.953853:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278272 00000100:00100000:3.0:1784093950.953858:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278912 00000100:00100000:1.0:1784093950.953858:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278272 00000100:00100000:2.0:1784093950.953860:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279040 00000100:00100000:3.0:1784093950.953863:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278912 00000100:00100000:2.0:1784093950.953864:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279040 00000100:00100000:0.0:1784093950.953867:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024278528:0@lo:400:kworker.0 00000100:00100000:1.0:1784093950.953907:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1784093950.953909:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1784093950.953910:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1784093950.953921:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024278272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093950.953926:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024278784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093950.953927:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024278912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093950.953947:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278400 00000100:00100000:0.0:1784093950.953953:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278400 00000100:00100000:1.0:1784093950.953979:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024278272:12345-0@lo:400:kworker.0 Request processed in 61us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093950.953984:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024278912:12345-0@lo:400:kworker.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093950.953988:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1784093950.953993:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024278784:12345-0@lo:400:kworker.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093950.953995:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1784093950.953998:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1784093950.954006:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1784093950.954011:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024278400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093950.954024:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1784093950.954033:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024278912:0@lo:400:kworker.0 00000100:00100000:2.0:1784093950.954034:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024279040:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784093950.954043:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093950.954046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093950.954051:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024278272:0@lo:400:kworker.0 00000100:00100000:2.0:1784093950.954082:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024279040:12345-0@lo:400:kworker.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093950.954089:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1784093950.954094:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024278656 00000100:00100000:3.0:1784093950.954100:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024278656 00000100:00100000:0.0:1784093950.954102:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024278400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093950.954113:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:2.0:1784093950.954115:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093950.954124:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024279040:0@lo:400:kworker.0 00000100:00080000:2.0:1784093950.954134:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093950.954138:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00080000:2.0:1784093950.954141:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093950.954148:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024278656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093950.954174:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024278400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093950.954183:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:2.0:1784093950.954187:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9071026bea00, transno 4294967343 00000100:00100000:3.0:1784093950.954196:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024278656:12345-0@lo:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093950.954203:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024278784:0@lo:400:kworker.0 00000100:00100000:3.0:1784093950.954204:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1784093950.954239:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024278656:0@lo:400:kworker.0 00010000:00010000:0.0:1784093951.465546:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093952.489572:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093953.001648:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024279168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093953.001714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093953.001758:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279168 00000100:00100000:0.0:1784093953.001767:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279168 00000100:00080000:2.0:1784093953.001794:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093953.001827:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1784093953.001839:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024279168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093953.001874:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093953.001927:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024279168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093953.001935:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1784093953.001960:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024279168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093953.513542:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093954.537561:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093955.448290:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093955.448351:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756928 00000100:00100000:0.0:1784093955.448358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093955.448361:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756928 00000100:00100000:0.0:1784093955.448395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093955.448446:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013756800 00000100:00080000:2.0:1784093955.448449:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093955.448452:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013756800 00000100:00100000:3.0:1784093955.448460:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 746 00000100:00100000:0.0:1784093955.448465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093955.448477:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013756928:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093955.448487:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757184 00000100:00100000:2.0:1784093955.448492:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757184 00000100:00100000:1.0:1784093955.448495:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 745 00000100:00100000:1.0:1784093955.448506:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013756800:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093955.448515:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757056 00000100:00100000:0.0:1784093955.448521:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757056 00000100:00100000:2.0:1784093955.448534:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00100000:2.0:1784093955.448546:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013757184:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093955.448561:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013756928:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093955.448562:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013756800:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093955.448567:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 541 00000100:00100000:3.0:1784093955.448578:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 746 00000100:00100000:2.0:1784093955.448584:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013757184:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093955.448586:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 745 00000100:00100000:0.0:1784093955.448588:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013757056:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093955.448598:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00080000:2.0:1784093955.448621:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093955.448625:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093955.448635:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013757056:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093955.448648:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 541 00010000:00010000:0.0:1784093955.561573:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093956.073998:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024279424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093956.074002:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024279296:0@lo:400:kworker.0 00000100:00100000:2.0:1784093956.074014:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024279680:0@lo:400:kworker.0 00000100:00100000:3.0:1784093956.074080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093956.074088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093956.074088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093956.074138:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279296 00000100:00100000:0.0:1784093956.074147:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279296 00000100:00100000:3.0:1784093956.074153:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024279808:0@lo:400:kworker.0 00000100:00100000:1.0:1784093956.074153:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024279936:0@lo:400:kworker.0 00000100:00100000:2.0:1784093956.074158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279680 00000100:00100000:2.0:1784093956.074164:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279680 00000100:00100000:0.0:1784093956.074205:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1784093956.074211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093956.074211:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1784093956.074226:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024279680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093956.074226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093956.074235:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024279296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093956.074256:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279936 00000100:00100000:3.0:1784093956.074261:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279936 00000100:00100000:1.0:1784093956.074261:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784093956.074272:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024279552:0@lo:400:kworker.0 00000100:00100000:2.0:1784093956.074288:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024279680:12345-0@lo:400:kworker.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093956.074294:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1784093956.074319:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1784093956.074322:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024279296:12345-0@lo:400:kworker.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093956.074325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093956.074332:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024279936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093956.074338:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:2.0:1784093956.074348:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279552 00000100:00100000:2.0:1784093956.074354:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279552 00000100:00100000:1.0:1784093956.074357:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024280064:0@lo:400:kworker.0 00000100:00100000:3.0:1784093956.074376:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024279936:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093956.074384:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1784093956.074391:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1784093956.074398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093956.074400:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279424 00000100:00100000:2.0:1784093956.074405:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024279552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093956.074407:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279424 00000100:00080000:3.0:1784093956.074444:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093956.074450:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093956.074468:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784093956.074474:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024279936:0@lo:400:kworker.0 00000100:00100000:0.0:1784093956.074482:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024279424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093956.074483:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024279680:0@lo:400:kworker.0 00000100:00100000:2.0:1784093956.074483:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024279552:12345-0@lo:400:kworker.0 Request processed in 78us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093956.074498:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1784093956.074503:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024279552:0@lo:400:kworker.0 00002000:00000024:0.0:1784093956.074516:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093956.074528:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024279808 00000100:00100000:2.0:1784093956.074534:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024279808 00000100:00100000:1.0:1784093956.074541:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280064 00000100:00100000:1.0:1784093956.074547:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280064 00000100:00100000:3.0:1784093956.074567:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024279296:0@lo:400:kworker.0 00000100:00100000:0.0:1784093956.074577:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024279424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093956.074583:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1784093956.074588:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784093956.074592:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1784093956.074597:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024279808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093956.074608:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024280064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093956.074615:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093956.074639:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024279424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093956.074654:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024279808:12345-0@lo:400:kworker.0 Request processed in 60us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093956.074663:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1784093956.074663:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024280064:12345-0@lo:400:kworker.0 Request processed in 58us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093956.074672:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024280064:0@lo:400:kworker.0 00000100:00100000:1.0:1784093956.074678:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1784093956.074679:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024279808:0@lo:400:kworker.0 00010000:00010000:1.0:1784093956.585625:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093957.609609:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093958.121649:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093958.121684:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024280192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093958.121776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093958.121821:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280192 00000100:00100000:0.0:1784093958.121831:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280192 00000100:00080000:3.0:1784093958.121886:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093958.121909:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784093958.121922:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024280192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093958.121966:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093958.122023:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024280192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093958.122031:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1784093958.122063:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024280192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093958.633622:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093959.657675:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093960.568545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093960.568594:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093960.568620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093960.568629:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757312 00000100:00100000:1.0:1784093960.568640:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757312 00000100:00100000:2.0:1784093960.568661:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093960.568698:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757440 00000100:00100000:0.0:1784093960.568700:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757568 00000100:00100000:0.0:1784093960.568708:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757568 00000100:00100000:1.0:1784093960.568709:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 747 00000100:00100000:3.0:1784093960.568713:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757440 00000100:00100000:1.0:1784093960.568723:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013757312:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093960.568734:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757696 00000100:00100000:2.0:1784093960.568741:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757696 00000100:00100000:0.0:1784093960.568791:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:0.0:1784093960.568804:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013757568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093960.568809:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00100000:3.0:1784093960.568819:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 750 00000100:00100000:2.0:1784093960.568826:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013757696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093960.568831:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013757312:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093960.568844:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013757440:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093960.568855:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 747 00000100:00100000:0.0:1784093960.568857:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013757568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093960.568870:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:2.0:1784093960.568881:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013757696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093960.568888:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00080000:0.0:1784093960.568906:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093960.568915:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093960.568919:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093960.568946:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013757440:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 108us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093960.568959:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 750 00010000:00010000:1.0:1784093960.681636:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093961.193578:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024280704:0@lo:400:kworker.0 00000100:00100000:3.0:1784093961.193584:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024280576:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.193594:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024280448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093961.193601:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024280320:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.193672:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093961.193673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093961.193678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093961.193707:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280448 00000100:00100000:0.0:1784093961.193714:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280448 00000100:00100000:1.0:1784093961.193740:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024280960:0@lo:400:kworker.0 00000100:00100000:2.0:1784093961.193742:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024280832:0@lo:400:kworker.0 00000100:00100000:3.0:1784093961.193747:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024281088:0@lo:400:kworker.0 00000100:00100000:0.0:1784093961.193773:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1784093961.193786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093961.193786:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024280448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093961.193790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093961.193802:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280576 00000100:00100000:3.0:1784093961.193806:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280576 00002000:00000024:0.0:1784093961.193828:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784093961.193837:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280320 00000100:00100000:2.0:1784093961.193843:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280320 00000100:00100000:1.0:1784093961.193849:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280960 00000100:00100000:3.0:1784093961.193854:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1784093961.193855:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280960 00000100:00100000:3.0:1784093961.193869:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024280576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093961.193884:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024280448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093961.193885:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1784093961.193892:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1784093961.193895:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784093961.193898:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024280320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.193905:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024280960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093961.193912:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024280576:12345-0@lo:400:kworker.0 Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093961.193920:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:0.0:1784093961.193924:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784093961.193930:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093961.193944:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024280320:12345-0@lo:400:kworker.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093961.193946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093961.193952:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024280960:12345-0@lo:400:kworker.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093961.193956:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1784093961.193965:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280704 00000100:00100000:1.0:1784093961.193966:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1784093961.193971:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280704 00000100:00100000:1.0:1784093961.194009:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024280832 00000100:00100000:2.0:1784093961.194012:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024280320:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.194014:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024280832 00000100:00100000:0.0:1784093961.194017:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024280448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093961.194018:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1784093961.194030:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024280704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093961.194040:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024280960:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.194052:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1784093961.194061:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024280832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093961.194064:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093961.194067:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093961.194078:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024280704:12345-0@lo:400:kworker.0 Request processed in 50us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093961.194085:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1784093961.194088:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024280704:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.194103:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024280832:12345-0@lo:400:kworker.0 Request processed in 45us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093961.194111:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1784093961.194119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093961.194129:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024280832:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.194130:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281088 00000100:00100000:1.0:1784093961.194137:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281088 00000100:00100000:0.0:1784093961.194154:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024280576:0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.194163:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1784093961.194170:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024281088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093961.194306:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024281088:12345-0@lo:400:kworker.0 Request processed in 138us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093961.194313:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1784093961.194335:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024281088:0@lo:400:kworker.0 00000100:00100000:3.0:1784093961.506275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093961.506347:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757824 00000100:00100000:0.0:1784093961.506356:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757824 00000100:00100000:0.0:1784093961.506412:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 732 00000100:00100000:0.0:1784093961.506443:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013757824:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093961.506526:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013757824:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093961.506532:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 732 00000100:00100000:2.0:1784093961.507284:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093961.507335:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013757952 00000100:00100000:1.0:1784093961.507340:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013757952 00000100:00100000:1.0:1784093961.507376:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 369 00000100:00100000:1.0:1784093961.507384:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013757952:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093961.507705:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013757952:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 321us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093961.507713:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 369 00000100:00100000:2.0:1784093961.508313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093961.508348:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758080 00000100:00100000:3.0:1784093961.508353:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758080 00000100:00100000:3.0:1784093961.508388:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:3.0:1784093961.508396:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013758080:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093961.508604:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013758080:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 208us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093961.508610:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:3.0:1784093961.509139:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093961.509179:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758208 00000100:00100000:2.0:1784093961.509184:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758208 00000100:00100000:2.0:1784093961.509230:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 733 00000100:00100000:2.0:1784093961.509239:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013758208:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093961.509513:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013758208:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 271us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093961.509521:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 733 00000100:00100000:2.0:1784093961.510663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093961.510700:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758336 00000100:00100000:3.0:1784093961.510705:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758336 00000100:00100000:3.0:1784093961.510731:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 734 00000100:00100000:3.0:1784093961.510736:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013758336:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784093961.510780:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013758336:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 44us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093961.510785:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 734 00000100:00100000:0.0:1784093961.511355:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093961.511407:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758464 00000100:00100000:1.0:1784093961.511412:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758464 00000100:00100000:1.0:1784093961.511464:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 371 00000100:00100000:1.0:1784093961.511473:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013758464:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093961.511697:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013758464:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 225us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093961.511704:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 371 00000100:00100000:0.0:1784093961.512274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093961.512321:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758592 00000100:00100000:1.0:1784093961.512327:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758592 00000100:00100000:1.0:1784093961.512347:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 372 00000100:00100000:1.0:1784093961.512352:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013758592:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784093961.512529:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48033:x1870757013758592:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 176us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093961.512534:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 372 00000100:00100000:2.0:1784093961.513095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093961.513134:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758720 00000100:00100000:0.0:1784093961.513139:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758720 00000100:00100000:0.0:1784093961.513169:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 735 00000100:00100000:0.0:1784093961.513187:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013758720:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093961.513459:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48033:x1870757013758720:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 283us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093961.513466:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 735 00000100:00100000:0.0:1784093961.523320:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093961.523371:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013758848 00000100:00100000:2.0:1784093961.523380:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013758848 00000100:00100000:2.0:1784093961.523440:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 736 00000100:00100000:2.0:1784093961.523448:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:48034:x1870757013758848:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093961.523464:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093961.523480:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cad8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf596e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.523526:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cad93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.523537:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cad93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.523546:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cad93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093961.523703:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00000004:00200000:2.0:1784093961.523706:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093961.523757:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cad93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.523775:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cad8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf596e expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.523788:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cad93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf596e expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.523794:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784093961.523796:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093961.523799:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784093961.523848:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:48034:x1870757013758848:12345-192.168.204.57@tcp:101:rm.0 Request processed in 402us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093961.523853:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 736 00000100:00100000:3.0:1784093961.524959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093961.524991:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013759104 00000100:00100000:2.0:1784093961.524995:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013759104 00000100:00100000:2.0:1784093961.525022:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 737 00000100:00100000:2.0:1784093961.525032:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48034:x1870757013759104:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093961.525041:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093961.525050:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cad9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5975 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093961.525146:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00010000:2.0:1784093961.525315:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cad9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5975 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.525323:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784093961.525325:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784093961.525328:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cad9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5975 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.525335:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784093961.525359:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:48034:x1870757013759104:12345-192.168.204.57@tcp:101:rm.0 Request processed in 331us (408us total) trans 4294967577 rc 301/301 00000100:00100000:2.0:1784093961.525364:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 737 00000100:00100000:0.0:1784093961.526723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093961.526753:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013759232 00000100:00100000:2.0:1784093961.526757:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013759232 00000100:00100000:2.0:1784093961.526784:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 77 00000100:00100000:2.0:1784093961.526789:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:48034:x1870757013759232:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784093961.528557:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:48034:x1870757013759232:12345-192.168.204.57@tcp:37:rm.0 Request processed in 1766us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093961.528565:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 77 00000100:00100000:3.0:1784093961.529604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093961.529643:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013759488 00000100:00100000:1.0:1784093961.529648:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013759488 00000100:00100000:1.0:1784093961.529674:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 78 00000100:00100000:1.0:1784093961.529680:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:48034:x1870757013759488:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:1.0:1784093961.529922:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:48034:x1870757013759488:12345-192.168.204.57@tcp:35:rm.0 Request processed in 240us (316us total) trans 4294967578 rc 0/0 00000100:00100000:1.0:1784093961.529929:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 78 00000100:00100000:0.0:1784093961.530724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093961.530768:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013759744 00000100:00100000:3.0:1784093961.530774:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013759744 00000100:00100000:3.0:1784093961.530801:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 738 00000100:00100000:3.0:1784093961.530807:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:48034:x1870757013759744:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784093961.530830:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784093961.530846:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cad93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf596e expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530865:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cad38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5959 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530875:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784093961.530889:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214caa52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf58a3 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530908:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:3.0:1784093961.530915:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093961.530934:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530955:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530965:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530978:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530985:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.530990:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531215:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531224:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531231:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093961.531805:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 7680 00010000:00010000:3.0:1784093961.531815:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531820:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531824:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531828:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093961.531831:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531835:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531840:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093961.531841:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093961.531844:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531848:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cadb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531858:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531862:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531865:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531868:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093961.531871:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531878:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531885:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093961.531887:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093961.531890:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093961.531896:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cada8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093961.531907:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000001be3a07a reply state 00000000e8344c57 transno 4294967579 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093961.531915:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093961.531955:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:48034:x1870757013759744:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1146us (1231us total) trans 4294967579 rc 0/0 00000100:00100000:3.0:1784093961.531962:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 738 00010000:00010000:2.0:1784093961.532508:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.532513:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.532520:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.532523:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093961.532525:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.532528:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.532536:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fceb00) 00010000:00010000:2.0:1784093961.532539:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093961.532541:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093961.532546:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cadaf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093961.705505:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784093962.351074:0:81222:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf65cae00 20000000:00000080:0.0:1784093962.351087:0:81222:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072375d6c00 uarg=0000000000000000 00010000:00010000:0.0:1784093962.351554:0:81222:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784093962.351565:0:81222:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784093962.351573:0:81222:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784093962.351587:0:81222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.351599:0:81222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214caa3d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.351605:0:81222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.351633:0:81222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214caa3d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.351642:0:81222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214caa3d expref: 18 pid: 5771 timeout: 1273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093962.351653:0:81222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81222:1870757024281216:0@lo:104: 00000100:00100000:0.0:1784093962.351698:0:81222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093962.351737:0:81222:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b79c840 going to sleep for 11 seconds 00000100:00100000:2.0:1784093962.351742:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281216 00000100:00100000:2.0:1784093962.351750:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281216 00000100:00100000:2.0:1784093962.351796:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784093962.351806:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:81222:x1870757024281216:12345-0@lo:104: 00010000:00010000:2.0:1784093962.351819:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093962.351882:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784093962.351890:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:81222:x1870757024281216:12345-0@lo:104: Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093962.351897:0:81222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81222:1870757024281216:0@lo:104: 00000100:00100000:2.0:1784093962.351898:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00010000:3.0:1784093962.351905:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093962.351912:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.351920:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:0.0:1784093962.351921:0:81222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093962.351924:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.351940:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784093962.351950:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784093962.351953:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784093962.351979:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.351982:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784093962.351999:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.352004:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214caa3d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caa44 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093962.352010:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1784093962.352016:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093962.352018:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093962.352020:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093962.352025:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024281344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784093962.352055:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093962.352085:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281344 00000100:00100000:0.0:1784093962.352089:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281344 00010000:00010000:0.0:1784093962.352103:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214caa3d expref: 19 pid: 5771 timeout: 1273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093962.352120:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784093962.352125:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024281344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093962.352132:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093962.352135:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214caa3d expref: 19 pid: 5771 timeout: 1273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352143:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214caa3d expref: 19 pid: 5771 timeout: 1273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352153:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214caa44 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214caa3d expref: 19 pid: 5771 timeout: 1273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352161:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352167:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352175:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352193:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352201:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352208:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352213:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093962.352217:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352224:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352239:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.352245:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093962.352263:0:81222:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093962.352272:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024281344:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (216us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093962.352273:0:81222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093962.352282:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00010000:00010000:2.0:1784093962.352287:0:81222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214cadbd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093962.352318:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024281344:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784093962.629729:0:81270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0c0e1c50 20000000:00000080:3.0:1784093962.629746:0:81270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723d736800 uarg=0000000000000000 00010000:00010000:3.0:1784093962.629966:0:81270:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784093962.629977:0:81270:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784093962.629988:0:81270:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784093962.630012:0:81270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630030:0:81270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630043:0:81270:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630051:0:81270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630058:0:81270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630063:0:81270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630068:0:81270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093962.630072:0:81270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630079:0:81270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630090:0:81270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630095:0:81270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093962.630100:0:81270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214cadc4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093962.729516:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093963.241560:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024281472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093963.241642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093963.241676:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281472 00000100:00100000:3.0:1784093963.241685:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281472 00000100:00080000:1.0:1784093963.241733:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093963.241752:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1784093963.241763:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024281472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093963.241801:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093963.241850:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024281472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093963.241856:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1784093963.241906:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024281472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093963.595985:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093963.596050:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013759872 00000100:00100000:2.0:1784093963.596066:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013759872 00000100:00080000:1.0:1784093963.596127:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093963.596146:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 739 00000100:00100000:2.0:1784093963.596167:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:48146:x1870757013759872:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093963.596195:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093963.596217:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cadcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf597c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.596289:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cadd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.596303:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cadd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.596314:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cadd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093963.596376:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093963.596379:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093963.596400:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cadd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.596439:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cadcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf597c expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.596458:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cadd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf597c expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.596465:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093963.596468:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093963.596471:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784093963.596540:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:48146:x1870757013759872:12345-192.168.204.57@tcp:101:rm.0 Request processed in 387us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093963.596546:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 739 00000100:00100000:0.0:1784093963.597389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093963.597472:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013760000 00000100:00100000:2.0:1784093963.597477:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013760000 00000100:00100000:2.0:1784093963.597509:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 740 00000100:00100000:2.0:1784093963.597515:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:48146:x1870757013760000:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784093963.597523:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093963.597531:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cadd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5983 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597556:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597563:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597568:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597578:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597582:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597586:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597623:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597627:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597631:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597635:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093963.597638:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597643:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597655:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093963.597657:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093963.597660:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597663:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cade0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597673:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597677:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597680:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597683:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093963.597685:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597688:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597691:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781400) 00010000:00010000:2.0:1784093963.597692:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093963.597694:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597697:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cade7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597717:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cadd9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5983 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597726:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784093963.597728:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093963.597733:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cadd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5983 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.597742:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784093963.597772:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:48146:x1870757013760000:12345-192.168.204.57@tcp:101:rm.0 Request processed in 257us (384us total) trans 0 rc 301/301 00000100:00100000:2.0:1784093963.597777:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 740 00000100:00100000:0.0:1784093963.615383:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093963.615458:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013760256 00000100:00100000:3.0:1784093963.615472:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013760256 00000100:00100000:3.0:1784093963.615533:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 741 00000100:00100000:3.0:1784093963.615545:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:48150:x1870757013760256:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:3.0:1784093963.615613:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093963.615646:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cadd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf597c expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.615670:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781d00) 00010000:00010000:3.0:1784093963.615682:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093963.615784:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.615801:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.615812:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.615826:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.615834:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.615840:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093963.616658:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 512 00010000:00010000:3.0:1784093963.616670:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.616678:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.616686:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.616693:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093963.616699:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.616708:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.616717:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093963.616720:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093963.616724:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.616731:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cadee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093963.616744:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ecdd8f6a reply state 00000000ed279fe0 transno 4294967580 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093963.616753:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093963.616852:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:48150:x1870757013760256:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1308us (1476us total) trans 4294967580 rc 0/0 00000100:00100000:3.0:1784093963.616865:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 741 00010000:00010000:1.0:1784093963.617511:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.617521:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.617527:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.617531:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093963.617534:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.617543:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.617555:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fce500) 00010000:00010000:1.0:1784093963.617557:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093963.617560:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.617563:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cadf5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093963.633469:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093963.633547:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013760384 00000100:00100000:2.0:1784093963.633560:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013760384 00000100:00100000:2.0:1784093963.633635:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 742 00000100:00100000:2.0:1784093963.633657:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:48154:x1870757013760384:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093963.633690:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093963.633721:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cadfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf598a expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.633796:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cae03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.633813:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cae03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.633827:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cae03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093963.633900:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784093963.633904:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093963.633933:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cae03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.633959:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cadfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf598a expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.633982:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cae03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf598a expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.633991:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093963.633994:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093963.633998:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784093963.634066:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:48154:x1870757013760384:12345-192.168.204.57@tcp:101:chown.0 Request processed in 420us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093963.634073:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 742 00000100:00100000:0.0:1784093963.635065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093963.635105:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013760512 00000100:00100000:2.0:1784093963.635111:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013760512 00000100:00100000:2.0:1784093963.635140:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 743 00000100:00100000:2.0:1784093963.635149:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:48154:x1870757013760512:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784093963.635168:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093963.635178:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cae0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5991 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635212:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635222:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635231:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635245:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635252:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635258:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635340:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cae1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635348:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cae1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635354:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cae1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093963.635382:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 512 00000004:00200000:2.0:1784093963.635385:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093963.635399:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cae1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635410:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635418:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635445:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635452:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093963.635456:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635465:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635475:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784093963.635479:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093963.635482:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635489:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cae11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635499:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635505:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635519:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635524:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093963.635527:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635533:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635538:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781600) 00010000:00010000:2.0:1784093963.635541:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093963.635543:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635553:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cae18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635578:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cae0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5991 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635589:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cae1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5991 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.635596:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784093963.635598:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093963.635600:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093963.635632:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48154:x1870757013760512:12345-192.168.204.57@tcp:101:chown.0 Request processed in 484us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093963.635638:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 743 00000100:00100000:0.0:1784093963.636601:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093963.636654:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013760768 00000100:00100000:3.0:1784093963.636661:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013760768 00000100:00100000:3.0:1784093963.636696:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 744 00000100:00100000:3.0:1784093963.636705:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:48154:x1870757013760768:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:3.0:1784093963.636738:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093963.636764:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cae1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5991 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.636778:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781f00) 00010000:00010000:3.0:1784093963.636785:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093963.636800:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.636810:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093963.636818:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784093963.645315:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967578 is committed 00000004:00010000:3.0:1784093963.645324:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000002b08a3d7 reply state 000000002d001ecf transno 4294967581 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784093963.645332:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967581 is committed 00000100:00100000:3.0:1784093963.645340:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784093963.645443:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00080000:3.0:1784093963.645547:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093963.645568:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48154:x1870757013760768:12345-192.168.204.57@tcp:36:chown.0 Request processed in 8859us (8962us total) trans 4294967581 rc 0/0 00000100:00100000:3.0:1784093963.645578:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 744 00010000:00010000:2.0:1784093963.645583:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.645595:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.645604:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.645611:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093963.645617:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.645626:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.645644:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce900) 00010000:00010000:2.0:1784093963.645648:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093963.645653:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093963.645659:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cae26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.753577:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784093963.919232:0:81467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd45404d80 20000000:00000080:1.0:1784093963.919252:0:81467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d50c00 uarg=0000000000000000 00010000:00010000:1.0:1784093963.919777:0:81467:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784093963.919818:0:81467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781400) 00010000:00010000:1.0:1784093963.919823:0:81467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093963.919838:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cae03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf598a expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919862:0:81467:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784093963.919875:0:81467:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784093963.919891:0:81467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919904:0:81467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919914:0:81467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919920:0:81467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919925:0:81467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919930:0:81467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919934:0:81467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093963.919937:0:81467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919943:0:81467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919949:0:81467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919954:0:81467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093963.919958:0:81467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214cae2d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093964.073466:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093964.073476:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093964.073481:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784093964.073548:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.073561:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.073576:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093964.073608:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024281600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093964.073681:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093964.073718:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281600 00000100:00100000:3.0:1784093964.073726:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281600 00000100:00100000:2.0:1784093964.073736:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe0780 going to sleep for 11 seconds 00000100:00100000:3.0:1784093964.073777:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1784093964.073786:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024281600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784093964.073801:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093964.073817:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cae34 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.073846:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cae34 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.073858:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cae34 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.073869:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093964.073910:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024281600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093964.073916:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1784093964.073950:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024281600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093964.073965:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.073972:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093964.074003:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093964.074009:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.074017:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784093964.211508:0:81515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff90ba9950 20000000:00000080:2.0:1784093964.211524:0:81515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237550c00 uarg=0000000000000000 00010000:00010000:2.0:1784093964.211741:0:81515:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784093964.211754:0:81515:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784093964.211767:0:81515:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784093964.211785:0:81515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.211802:0:81515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cae34 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.211809:0:81515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.211848:0:81515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cae34 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.211861:0:81515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cae34 expref: 18 pid: 5770 timeout: 1275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093964.211874:0:81515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81515:1870757024281728:0@lo:104: 00000100:00100000:2.0:1784093964.211948:0:81515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093964.211981:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281728 00000100:00100000:1.0:1784093964.211989:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281728 00000100:00100000:2.0:1784093964.212017:0:81515:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe0780 going to sleep for 11 seconds 00000100:00100000:1.0:1784093964.212044:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784093964.212055:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:81515:x1870757024281728:12345-0@lo:104: 00010000:00010000:1.0:1784093964.212070:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093964.212135:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784093964.212152:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:81515:x1870757024281728:12345-0@lo:104: Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093964.212162:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1784093964.212168:0:81515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81515:1870757024281728:0@lo:104: 00010000:00010000:0.0:1784093964.212168:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093964.212177:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093964.212186:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784093964.212190:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.212192:0:81515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093964.212202:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784093964.212209:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784093964.212215:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784093964.212251:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093964.212259:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784093964.212281:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093964.212286:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cae34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cae3b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093964.212298:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024281856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784093964.212300:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093964.212303:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093964.212305:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093964.212324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093964.212364:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281856 00000100:00100000:3.0:1784093964.212370:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281856 00010000:00010000:3.0:1784093964.212394:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cae34 expref: 19 pid: 5770 timeout: 1275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093964.212419:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1784093964.212442:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024281856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784093964.212452:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093964.212457:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cae34 expref: 19 pid: 5770 timeout: 1275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212472:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cae34 expref: 19 pid: 5770 timeout: 1275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212482:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68800/0x9ce98053214cae3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cae34 expref: 19 pid: 5770 timeout: 1275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212492:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212498:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212508:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212512:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212517:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212521:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212524:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093964.212527:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212532:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212546:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093964.212552:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093964.212562:0:81515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.212569:0:81515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093964.212574:0:81515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214cae42 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093964.212581:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024281856:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093964.212588:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1784093964.212607:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024281856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784093964.777537:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093965.171056:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.171105:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013760896 00000100:00100000:1.0:1784093965.171116:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013760896 00000100:00080000:0.0:1784093965.171178:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093965.171202:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 12 00000100:00100000:1.0:1784093965.171212:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013760896:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093965.171227:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093965.171230:0:7457:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cae03) 00010000:00010000:1.0:1784093965.171233:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784093965.171297:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013760896:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 86us (249us total) trans 0 rc 116/116 00000100:00100000:1.0:1784093965.171306:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 12 00000100:00100000:0.0:1784093965.481114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.481166:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013761024 00000100:00100000:1.0:1784093965.481177:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013761024 00000100:00100000:1.0:1784093965.481240:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 745 00000100:00100000:1.0:1784093965.481251:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48259:x1870757013761024:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093965.481278:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.481301:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cae49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5998 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.481374:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cae50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.481391:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cae50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.481405:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cae50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093965.481640:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784093965.481644:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093965.481739:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cae50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.481762:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cae49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5998 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.481776:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cae50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5998 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.481783:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093965.481785:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093965.481789:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13400, rc 0) 00000100:00100000:1.0:1784093965.481845:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:48259:x1870757013761024:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 597us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093965.481850:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 745 00000100:00100000:0.0:1784093965.482882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.482924:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013761152 00000100:00100000:3.0:1784093965.482930:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013761152 00000100:00100000:3.0:1784093965.482961:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 746 00000100:00100000:3.0:1784093965.482970:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:48259:x1870757013761152:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093965.482979:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093965.482989:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf599f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483022:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483033:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483041:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483055:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483062:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483075:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483358:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483367:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483375:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093965.483484:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1784093965.483488:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093965.483547:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483560:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483568:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483575:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483582:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.483594:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483602:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483613:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:3.0:1784093965.483615:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.483620:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483627:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cae5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483638:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483645:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483651:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483657:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.483660:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483666:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483673:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fcef00) 00010000:00010000:3.0:1784093965.483675:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.483678:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483683:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cae65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483711:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf599f expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483721:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf599f expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.483733:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093965.483736:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093965.483738:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784093965.483770:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48259:x1870757013761152:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 801us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093965.483778:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 746 00000100:00100000:2.0:1784093965.484614:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.484647:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013761408 00000100:00100000:3.0:1784093965.484652:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013761408 00000100:00100000:3.0:1784093965.484681:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 747 00000100:00100000:3.0:1784093965.484689:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48259:x1870757013761408:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093965.484723:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093965.484737:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf599f expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.484748:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784093965.484754:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093965.484766:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.484775:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.484783:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093965.493709:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967582 is committed 00000004:00010000:0.0:1784093965.493717:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000eb6977b1 reply state 000000006963dd40 transno 4294967582 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.493731:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093965.493823:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00080000:0.0:1784093965.493927:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093965.493951:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48259:x1870757013761408:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 9257us (9332us total) trans 4294967582 rc 0/0 00000100:00100000:0.0:1784093965.493962:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 747 00010000:00010000:1.0:1784093965.493964:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.493973:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.493979:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.493984:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.493988:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.493993:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.494007:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce800) 00010000:00010000:1.0:1784093965.494010:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093965.494013:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.494017:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cae73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.511546:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.511603:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013761536 00000100:00100000:1.0:1784093965.511615:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013761536 00000100:00100000:1.0:1784093965.511675:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 748 00000100:00100000:1.0:1784093965.511686:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:48263:x1870757013761536:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093965.511713:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.511740:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cae7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59a6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.511804:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.511822:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.511831:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.511842:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.511846:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.511851:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512311:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cae8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512317:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cae8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512322:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cae8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093965.512418:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:1.0:1784093965.512457:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093965.512566:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cae8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512580:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512588:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512593:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512598:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.512602:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512607:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512619:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784093965.512621:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.512625:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512629:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cae81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512638:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512643:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512649:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512654:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.512659:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512665:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512674:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907219c12300) 00010000:00010000:1.0:1784093965.512678:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.512681:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512687:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cae88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512721:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cae7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59a6 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512735:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cae8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59a6 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.512740:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784093965.512742:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784093965.512744:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784093965.512804:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:48263:x1870757013761536:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1121us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093965.512810:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 748 00000100:00100000:1.0:1784093965.513826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.513865:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013761792 00000100:00100000:3.0:1784093965.513873:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013761792 00000100:00100000:3.0:1784093965.513915:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 749 00000100:00100000:3.0:1784093965.513926:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48263:x1870757013761792:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093965.513938:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093965.513951:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59ad expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.514240:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.514253:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.514263:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.514279:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.514288:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.514297:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093965.515414:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:3.0:1784093965.515745:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caeab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515754:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515760:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caeab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515789:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515794:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515799:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515802:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.515805:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515810:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515816:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:3.0:1784093965.515818:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.515822:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515826:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cae9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093965.515837:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d0c7ded7 reply state 000000001f0a54a8 transno 4294967583 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093965.515844:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784093965.515865:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cae96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ad expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515878:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caeab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ad expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.515886:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784093965.515889:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093965.515892:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784093965.515952:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:48263:x1870757013761792:12345-192.168.204.57@tcp:101:touch.0 Request processed in 2028us (2125us total) trans 4294967583 rc 0/0 00000100:00100000:3.0:1784093965.515959:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 749 00010000:00010000:2.0:1784093965.516619:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.516631:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.516639:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.516645:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093965.516648:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.516652:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.516662:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907204fcec00) 00010000:00010000:2.0:1784093965.516664:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093965.516666:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.516671:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214caea4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093965.517310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093965.517348:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013762048 00000100:00100000:0.0:1784093965.517356:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013762048 00000100:00100000:0.0:1784093965.517399:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 750 00000100:00100000:0.0:1784093965.517408:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:48263:x1870757013762048:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:0.0:1784093965.517482:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093965.517497:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caeab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ad expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.517506:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907204fcef00) 00010000:00010000:0.0:1784093965.517511:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093965.517538:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.517545:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.517550:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093965.517626:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000042c51285 reply state 0000000003c13a5f transno 4294967584 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.517640:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093965.517690:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:48263:x1870757013762048:12345-192.168.204.57@tcp:36:touch.0 Request processed in 282us (381us total) trans 4294967584 rc 0/0 00000100:00100000:0.0:1784093965.517697:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 750 00010000:00010000:1.0:1784093965.518233:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.518247:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.518255:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.518261:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.518265:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.518272:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.518282:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:1.0:1784093965.518285:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.518287:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.518293:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214caeb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093965.518413:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093965.518557:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013762176 00000100:00100000:0.0:1784093965.518563:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013762176 00000100:00100000:0.0:1784093965.518594:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 751 00000100:00100000:0.0:1784093965.518602:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:48263:x1870757013762176:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784093965.518613:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093965.518626:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214caec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59b4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.518656:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214caec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59b4 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.518667:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214caec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59b4 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.518683:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784093965.518686:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784093965.518688:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784093965.518719:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:48263:x1870757013762176:12345-192.168.204.57@tcp:101:touch.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093965.518725:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 751 00000100:00100000:0.0:1784093965.519584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.519613:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013762304 00000100:00100000:3.0:1784093965.519617:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013762304 00000100:00080000:0.0:1784093965.519654:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093965.519658:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 373 00000100:00100000:3.0:1784093965.519665:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013762304:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:3.0:1784093965.519880:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013762304:12345-192.168.204.57@tcp:2:touch.0 Request processed in 214us (295us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1784093965.519886:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 373 00000100:00100000:2.0:1784093965.520702:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.520772:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013762560 00000100:00100000:1.0:1784093965.520778:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013762560 00000100:00100000:1.0:1784093965.520815:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 79 00000100:00100000:1.0:1784093965.520822:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:48263:x1870757013762560:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:1.0:1784093965.521008:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:48263:x1870757013762560:12345-192.168.204.57@tcp:35:touch.0 Request processed in 184us (305us total) trans 4294967585 rc 0/0 00000100:00100000:1.0:1784093965.521023:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 79 00000100:00100000:1.0:1784093965.538277:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.538321:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013762688 00000100:00100000:3.0:1784093965.538333:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013762688 00000100:00100000:3.0:1784093965.538399:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 752 00000100:00100000:3.0:1784093965.538412:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48267:x1870757013762688:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784093965.538467:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093965.538498:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caec7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59bb expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538571:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538594:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538608:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538624:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538632:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538644:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538748:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538756:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538764:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093965.538805:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 0 00000004:00200000:3.0:1784093965.538810:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093965.538830:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538843:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538852:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538859:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538866:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538872:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.538877:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538886:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538899:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:3.0:1784093965.538902:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.538907:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538914:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caece lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538930:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538936:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538943:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538948:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.538951:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538956:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538962:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907204fce700) 00010000:00010000:3.0:1784093965.538965:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.538967:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.538973:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.539009:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59bb expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.539022:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59bb expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.539035:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:3.0:1784093965.539037:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093965.539040:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784093965.539101:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:48267:x1870757013762688:12345-192.168.204.57@tcp:101:rm.0 Request processed in 692us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093965.539109:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 752 00000100:00100000:2.0:1784093965.540944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.540986:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013762816 00000100:00100000:1.0:1784093965.540992:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013762816 00000100:00100000:1.0:1784093965.541033:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 374 00000100:00100000:1.0:1784093965.541043:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013762816:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093965.541057:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.541073:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59c2 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093965.541095:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x6a571d0d, atime: 0x6a571d0d, ctime: 0x6a571d0d, blocks: 0x1 00010000:00010000:1.0:1784093965.541108:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1126s v=(0 0) 00010000:00010000:1.0:1784093965.541112:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093965.541131:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 7 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.541147:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 7 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.541157:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784093965.541190:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013762816:12345-192.168.204.57@tcp:101:rm.0 Request processed in 150us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093965.541195:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 374 00000100:00100000:2.0:1784093965.542341:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093965.542393:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763072 00000100:00100000:0.0:1784093965.542400:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763072 00000100:00100000:0.0:1784093965.542459:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 753 00000100:00100000:0.0:1784093965.542473:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:48267:x1870757013763072:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784093965.542512:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093965.542535:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caedc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59bb expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542555:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214caec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59b4 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542567:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784093965.542575:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093965.542600:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542609:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542616:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542625:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542630:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542634:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542733:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542742:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.542750:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093965.543361:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:0.0:1784093965.543373:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1126620950422ns, next at 1127620947997ns, rc = 0 00010000:00010000:0.0:1784093965.543446:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543456:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543464:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543470:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543474:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543477:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543493:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093965.543509:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543514:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543518:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543522:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.543523:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093965.543525:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543532:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543533:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543545:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093965.543548:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093965.543551:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543552:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093965.543556:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214caef8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543565:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543570:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543579:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543580:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543596:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543601:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.543604:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784093965.543604:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543612:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.543617:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:0.0:1784093965.543618:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093965.543620:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543622:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784093965.543625:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214caeea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543628:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093965.543631:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005b4bd6f4 reply state 000000009a01249c transno 4294967586 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.543644:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093965.543645:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214caeff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.543664:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093965.543667:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093965.543670:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093965.543695:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:48267:x1870757013763072:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1228us (1356us total) trans 4294967586 rc 0/0 00000100:00100000:0.0:1784093965.543700:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 753 00010000:00010000:2.0:1784093965.544346:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.544356:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.544363:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.544368:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093965.544372:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.544378:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.544388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907202e6b400) 00010000:00010000:2.0:1784093965.544390:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093965.544394:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.544400:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214caef1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.688309:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093965.688441:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.688484:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763200 00000100:00100000:1.0:1784093965.688484:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763328 00000100:00100000:1.0:1784093965.688495:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763328 00000100:00100000:3.0:1784093965.688500:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763200 00000100:00100000:3.0:1784093965.688569:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 750 00000100:00100000:1.0:1784093965.688569:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:1.0:1784093965.688588:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013763328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093965.688638:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013763200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784093965.688653:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093965.688775:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013763328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 192us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093965.688777:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013763200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093965.688793:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 750 00000100:00100000:1.0:1784093965.688793:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 548 10000000:01000000:2.0:1784093965.801479:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784093965.801486:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784093965.801490:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784093965.801519:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784093965.801528:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.801540:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.801551:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.801576:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024281984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784093965.801632:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093965.801684:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024281984 00000100:00100000:2.0:1784093965.801685:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8be40 going to sleep for 11 seconds 00000100:00100000:0.0:1784093965.801691:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024281984 00000100:00100000:0.0:1784093965.801734:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1784093965.801741:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024281984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784093965.801755:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093965.801767:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214caf06 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.801785:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214caf06 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.801796:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214caf06 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.801803:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784093965.801836:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024281984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093965.801841:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1784093965.801870:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024281984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784093965.801883:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.801890:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784093965.801902:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784093965.801906:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.801911:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.853990:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.854035:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763456 00000100:00100000:1.0:1784093965.854045:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763456 00000100:00100000:1.0:1784093965.854106:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 754 00000100:00100000:1.0:1784093965.854132:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:48282:x1870757013763456:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784093965.854157:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.854176:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caf14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59c9 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.854236:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caf1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.854251:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.854263:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093965.854328:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:1.0:1784093965.854331:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093965.854350:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caf1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.854369:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caf14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c9 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.854380:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caf1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c9 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.854387:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784093965.854389:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784093965.854391:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093965.854498:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:48282:x1870757013763456:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 383us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093965.854505:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 754 00000100:00100000:1.0:1784093965.855686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093965.855726:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763712 00000100:00100000:2.0:1784093965.855732:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763712 00000100:00100000:2.0:1784093965.855774:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 755 00000100:00100000:2.0:1784093965.855784:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:48282:x1870757013763712:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784093965.855814:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784093965.855831:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214caf1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c9 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.855848:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cae8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59a6 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.855857:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:2.0:1784093965.855866:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093965.855884:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.855893:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093965.855900:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093965.865401:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967586 is committed 00000004:00080000:1.0:1784093965.865412:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 60 committed 00000004:00010000:2.0:1784093965.865414:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000eb4e508f reply state 000000009424b940 transno 4294967587 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.865456:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784093965.865461:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967587 is committed 00000100:00100000:3.0:1784093965.865549:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024282112:0@lo:6:osp-syn-1-0.0 00000004:00200000:2.0:1784093965.865589:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:3.0:1784093965.865616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784093965.865683:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784093965.865687:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024282112 00000100:00100000:3.0:1784093965.865694:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024282112 00000100:00100000:2.0:1784093965.865704:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48282:x1870757013763712:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 9920us (10016us total) trans 4294967587 rc 0/0 00010000:00010000:1.0:1784093965.865706:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.865718:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.865719:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 755 00010000:00010000:1.0:1784093965.865731:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.865738:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.865743:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093965.865749:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00010000:00010000:1.0:1784093965.865755:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093965.865763:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024282112:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784093965.865773:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781700) 00010000:00010000:1.0:1784093965.865778:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093965.865782:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784093965.865787:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00010000:00010000:1.0:1784093965.865789:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214caf22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.865808:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.865826:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 6 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.865840:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093965.865901:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093965.865908:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.865938:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 6 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.865953:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 6 pid: 8031 timeout: 1226 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093965.865966:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024282240:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784093965.866013:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e35cd80 going to sleep for 11 seconds 00000100:00080000:3.0:1784093965.866028:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093965.867001:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024282240:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784093965.867017:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.867204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093965.867243:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763840 00000100:00100000:0.0:1784093965.867247:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763840 00010000:00010000:0.0:1784093965.867266:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 7 pid: 8031 timeout: 1226 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.867304:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 286 00000100:00100000:0.0:1784093965.867313:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013763840:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784093965.867323:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093965.867330:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 7 pid: 8031 timeout: 1226 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.867343:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 7 pid: 8031 timeout: 1226 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.867362:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214caee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59c2 expref: 7 pid: 8031 timeout: 1226 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.867373:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093965.867376:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093965.867379:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.867385:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093965.867404:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093965.867449:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.867457:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.867465:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013763840:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 152us (261us total) trans 0 rc 0/0 00010000:00010000:3.0:1784093965.867475:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093965.867480:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 286 00010000:00010000:3.0:1784093965.867487:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.867505:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784093965.867922:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024282112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2163us (2306us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1784093965.867929:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00010000:3.0:1784093965.867953:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1784093965.867957:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237586d80/2, rc 0, transno 4294967343 00010000:00010000:3.0:1784093965.867959:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.867966:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024282112:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784093965.867974:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093965.867979:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.867988:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.868000:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.868008:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214caf29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.868025:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093965.868027:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093965.868030:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093965.884521:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.884579:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013763968 00000100:00100000:3.0:1784093965.884591:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013763968 00000100:00100000:3.0:1784093965.884651:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 756 00000100:00100000:3.0:1784093965.884663:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:48286:x1870757013763968:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093965.884690:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093965.884713:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caf30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59d0 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.884778:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.884793:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.884806:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.884824:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.884832:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.884840:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885317:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caf45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885327:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caf45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885336:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caf45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093965.885856:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1784093965.885861:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093965.885958:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caf45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885971:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885977:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885984:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.885990:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.885994:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886002:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886012:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:3.0:1784093965.886016:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.886020:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886026:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214caf37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886035:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886042:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886048:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886053:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.886056:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886061:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886069:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fce400) 00010000:00010000:3.0:1784093965.886072:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.886075:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886081:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214caf3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886126:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caf30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59d0 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886147:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caf45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59d0 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.886154:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093965.886157:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093965.886159:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784093965.886212:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48286:x1870757013763968:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1552us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093965.886220:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 756 00000100:00100000:2.0:1784093965.887470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.887493:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013764224 00000100:00100000:1.0:1784093965.887499:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013764224 00000100:00100000:1.0:1784093965.887528:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:1.0:1784093965.887534:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:48286:x1870757013764224:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784093965.887543:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.887551:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59d7 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.887725:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.887733:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.887739:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.887747:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.887754:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.887761:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093965.888827:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:1.0:1784093965.889060:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214caf61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889067:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214caf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889071:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214caf61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889094:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889105:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889111:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889128:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.889132:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889139:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889148:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093965.889150:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.889153:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889160:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093965.889171:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c6d705cf reply state 00000000348bfbbe transno 4294967588 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093965.889177:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093965.889196:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59d7 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889204:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214caf61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59d7 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.889212:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784093965.889214:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093965.889215:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784093965.889264:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:48286:x1870757013764224:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1728us (1795us total) trans 4294967588 rc 0/0 00000100:00100000:1.0:1784093965.889271:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 757 00010000:00010000:1.0:1784093965.890148:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.890158:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.890163:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.890169:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.890172:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.890188:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.890199:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907219c12900) 00010000:00010000:1.0:1784093965.890202:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.890206:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.890212:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.891051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.891087:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013764480 00000100:00100000:3.0:1784093965.891094:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013764480 00000100:00100000:3.0:1784093965.891205:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 758 00000100:00100000:3.0:1784093965.891227:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:48286:x1870757013764480:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:3.0:1784093965.891263:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093965.891277:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214caf61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59d7 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.891296:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907219c12000) 00010000:00010000:3.0:1784093965.891306:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093965.891341:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.891351:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.891361:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093965.891526:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000009614bc96 reply state 00000000054a0cbe transno 4294967589 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093965.891532:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093965.891584:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:48286:x1870757013764480:12345-192.168.204.57@tcp:36:touch.0 Request processed in 370us (532us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1784093965.891593:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 758 00010000:00010000:3.0:1784093965.892158:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892168:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892175:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892182:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.892186:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892194:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892211:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784093965.892214:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.892218:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892227:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214caf6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093965.892228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.892274:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013764608 00000100:00100000:3.0:1784093965.892278:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013764608 00000100:00100000:3.0:1784093965.892310:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 759 00000100:00100000:3.0:1784093965.892320:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:48286:x1870757013764608:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784093965.892375:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093965.892386:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caf76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59de expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892413:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caf76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59de expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892444:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caf76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59de expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.892463:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093965.892466:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784093965.892469:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784093965.892498:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:48286:x1870757013764608:12345-192.168.204.57@tcp:101:touch.0 Request processed in 182us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093965.892503:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 759 00000100:00100000:3.0:1784093965.893276:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.893312:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013764736 00000100:00100000:1.0:1784093965.893317:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013764736 00000100:00100000:1.0:1784093965.893345:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 376 00000100:00100000:1.0:1784093965.893353:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013764736:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:1.0:1784093965.893602:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013764736:12345-192.168.204.57@tcp:2:touch.0 Request processed in 250us (325us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784093965.893607:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 376 00000100:00100000:2.0:1784093965.897182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.897227:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013764992 00000100:00100000:1.0:1784093965.897234:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013764992 00000100:00100000:1.0:1784093965.897262:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 80 00000100:00100000:1.0:1784093965.897267:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:48286:x1870757013764992:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:1.0:1784093965.897464:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:48286:x1870757013764992:12345-192.168.204.57@tcp:35:touch.0 Request processed in 196us (283us total) trans 4294967590 rc 0/0 00000100:00100000:1.0:1784093965.897469:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 80 00000100:00100000:2.0:1784093965.917500:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.917534:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013765120 00000100:00100000:1.0:1784093965.917543:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013765120 00000100:00100000:1.0:1784093965.917582:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 760 00000100:00100000:1.0:1784093965.917588:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:48290:x1870757013765120:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093965.917609:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.917629:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59e5 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917684:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917703:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917714:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917728:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917734:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917745:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917824:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917832:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917839:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093965.917870:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3f:0x0]: returning size 0 00000004:00200000:1.0:1784093965.917873:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093965.917889:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917897:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917909:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917916:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917922:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917929:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.917933:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917941:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917952:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093965.917955:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.917960:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917966:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214caf84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917976:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917982:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917986:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917990:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.917992:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.917995:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.918000:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907219c12900) 00010000:00010000:1.0:1784093965.918001:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.918003:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.918006:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214caf8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.918027:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214caf7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59e5 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.918035:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59e5 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.918039:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907204fce400) 00010000:00010000:1.0:1784093965.918041:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093965.918042:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784093965.918085:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:48290:x1870757013765120:12345-192.168.204.57@tcp:101:rm.0 Request processed in 497us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093965.918090:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 760 00000100:00100000:3.0:1784093965.919509:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093965.919553:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013765248 00000100:00100000:1.0:1784093965.919558:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013765248 00000100:00100000:1.0:1784093965.919590:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 377 00000100:00100000:1.0:1784093965.919597:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013765248:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784093965.919607:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093965.919620:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59ec expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093965.919640:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x6a571d0e, atime: 0x6a571d0e, ctime: 0x6a571d0e, blocks: 0x1 00010000:00010000:1.0:1784093965.919653:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1126s v=(0 0) 00010000:00010000:1.0:1784093965.919657:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093965.919665:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.919685:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.919696:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784093965.919726:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013765248:12345-192.168.204.57@tcp:101:rm.0 Request processed in 129us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093965.919732:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 377 00000100:00100000:2.0:1784093965.921000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093965.921034:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013765504 00000100:00100000:3.0:1784093965.921038:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013765504 00000100:00100000:3.0:1784093965.921063:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:3.0:1784093965.921068:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:48290:x1870757013765504:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784093965.921094:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093965.921105:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214caf92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59e5 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921132:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214caf76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59de expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921142:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784093965.921149:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093965.921161:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921171:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921178:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921189:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921194:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921207:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921260:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921266:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921270:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784093965.921669:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9728 00000004:00080000:3.0:1784093965.921676:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1126999253919ns, next at 1127999252470ns, rc = 0 00010000:00010000:3.0:1784093965.921713:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921719:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921724:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921729:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921732:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921736:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921749:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093965.921760:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921764:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921766:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093965.921768:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921773:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921774:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.921779:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921783:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093965.921786:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921788:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921796:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093965.921801:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093965.921805:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921810:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921812:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921828:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784093965.921831:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921831:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093965.921836:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921838:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921844:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cafb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921846:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921853:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093965.921855:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921859:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.921859:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093965.921862:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093965.921864:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093965.921872:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093965.921875:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093965.921877:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093965.921883:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093965.921893:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f5ef3b4d reply state 00000000d79ccc94 transno 4294967591 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093965.921900:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784093965.921946:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:48290:x1870757013765504:12345-192.168.204.57@tcp:36:rm.0 Request processed in 876us (945us total) trans 4294967591 rc 0/0 00000100:00100000:3.0:1784093965.921953:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 761 00010000:00010000:1.0:1784093965.922534:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.922544:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.922551:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.922557:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093965.922561:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.922567:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.922577:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907204fcee00) 00010000:00010000:1.0:1784093965.922580:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093965.922583:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093965.922596:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cafa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093966.233143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093966.233222:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013765632 00000100:00100000:3.0:1784093966.233231:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013765632 00000100:00100000:3.0:1784093966.233290:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 762 00000100:00100000:3.0:1784093966.233301:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:48304:x1870757013765632:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093966.233325:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093966.233344:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59f3 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.233403:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.233417:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.233468:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093966.233533:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1784093966.233538:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093966.233567:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.233591:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59f3 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.233611:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59f3 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.233621:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784093966.233624:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093966.233629:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784093966.233686:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:48304:x1870757013765632:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 386us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.233695:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 762 00000100:00100000:0.0:1784093966.234681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.234732:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013765888 00000100:00100000:1.0:1784093966.234738:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013765888 00000100:00100000:1.0:1784093966.234773:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 763 00000100:00100000:1.0:1784093966.234782:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:48304:x1870757013765888:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093966.234810:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093966.234835:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cafc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59f3 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.234853:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214caf45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59d0 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.234863:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce300) 00010000:00010000:1.0:1784093966.234872:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093966.234889:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.234898:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.234906:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093966.235122:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c7cf43eb reply state 000000000e097a2e transno 4294967592 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093966.235132:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784093966.235143:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:1.0:1784093966.235193:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:48304:x1870757013765888:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 412us (512us total) trans 4294967592 rc 0/0 00000100:00100000:1.0:1784093966.235207:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 763 00010000:00010000:0.0:1784093966.235815:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.235823:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.235828:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.235832:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093966.235835:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.235839:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.235846:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12900) 00010000:00010000:0.0:1784093966.235848:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784093966.235851:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.235855:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cafca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093966.277580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093966.277627:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766016 00000100:00100000:3.0:1784093966.277635:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766016 00000100:00100000:3.0:1784093966.277678:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 764 00000100:00100000:3.0:1784093966.277686:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766016:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093966.277765:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766016:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.277773:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 764 00000100:00100000:3.0:1784093966.278311:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093966.278399:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766144 00000100:00100000:0.0:1784093966.278403:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766144 00000100:00100000:0.0:1784093966.278453:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 378 00000100:00100000:0.0:1784093966.278460:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48316:x1870757013766144:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093966.278760:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48316:x1870757013766144:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 299us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093966.278767:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 378 00000100:00100000:0.0:1784093966.279312:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.279362:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766272 00000100:00100000:1.0:1784093966.279367:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766272 00000100:00100000:1.0:1784093966.279390:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 379 00000100:00100000:1.0:1784093966.279396:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:48316:x1870757013766272:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093966.279616:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:48316:x1870757013766272:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 218us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093966.279623:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 379 00000100:00100000:2.0:1784093966.280203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093966.280251:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766400 00000100:00100000:3.0:1784093966.280257:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766400 00000100:00100000:3.0:1784093966.280289:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:3.0:1784093966.280296:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766400:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093966.280536:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766400:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 240us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.280541:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:3.0:1784093966.281389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.281440:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766528 00000100:00100000:1.0:1784093966.281445:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766528 00000100:00100000:1.0:1784093966.281467:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 766 00000100:00100000:1.0:1784093966.281474:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766528:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093966.281507:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766528:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093966.281511:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 766 00000100:00100000:0.0:1784093966.282003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.282041:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766656 00000100:00100000:1.0:1784093966.282046:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766656 00000100:00100000:1.0:1784093966.282071:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 380 00000100:00100000:1.0:1784093966.282075:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48316:x1870757013766656:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093966.282239:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48316:x1870757013766656:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 162us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093966.282250:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 380 00000100:00100000:2.0:1784093966.282828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093966.282866:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766784 00000100:00100000:0.0:1784093966.282869:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766784 00000100:00100000:0.0:1784093966.282890:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 381 00000100:00100000:0.0:1784093966.282898:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:48316:x1870757013766784:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784093966.283089:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:48316:x1870757013766784:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 191us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093966.283096:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 381 00000100:00100000:3.0:1784093966.283634:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093966.283662:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013766912 00000100:00100000:2.0:1784093966.283667:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013766912 00000100:00100000:2.0:1784093966.283692:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 767 00000100:00100000:2.0:1784093966.283699:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766912:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093966.283878:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48316:x1870757013766912:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 178us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093966.283887:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 767 00000100:00100000:2.0:1784093966.305519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093966.305582:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767040 00000100:00100000:3.0:1784093966.305592:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767040 00000100:00100000:3.0:1784093966.305645:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 768 00000100:00100000:3.0:1784093966.305657:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:48320:x1870757013767040:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784093966.305678:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093966.305698:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf59fa expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.305755:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.305769:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.305780:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.305794:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.305804:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.305810:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306094:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cafe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306103:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cafe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306124:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cafe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093966.306155:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1784093966.306159:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093966.306181:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cafe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306192:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306199:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306206:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306212:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093966.306216:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306224:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306235:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:3.0:1784093966.306238:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093966.306242:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306248:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cafd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306260:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306265:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306271:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306275:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093966.306278:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306284:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306290:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907204fce400) 00010000:00010000:3.0:1784093966.306293:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093966.306295:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306304:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cafdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306328:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cafd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59fa expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306340:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cafe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59fa expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.306346:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093966.306349:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784093966.306351:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784093966.306403:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:48320:x1870757013767040:12345-192.168.204.57@tcp:101:dd.0 Request processed in 749us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.306411:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 768 00000100:00100000:0.0:1784093966.307642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.307700:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767296 00000100:00100000:1.0:1784093966.307706:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767296 00000100:00100000:1.0:1784093966.307737:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 769 00000100:00100000:1.0:1784093966.307744:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:48320:x1870757013767296:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093966.307754:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093966.307763:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cafed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a01 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.307829:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.307840:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.307847:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.307859:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.307866:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.307872:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784093966.308218:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:1.0:1784093966.308355:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308365:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308372:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308397:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308404:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308409:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308414:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093966.308416:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308448:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308458:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784093966.308461:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093966.308464:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308470:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214caff4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784093966.308480:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000796cccef reply state 0000000070a9e7a4 transno 4294967593 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093966.308488:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784093966.308520:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cafed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a01 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308531:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a01 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.308538:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093966.308540:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093966.308542:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784093966.308576:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+15:48320:x1870757013767296:12345-192.168.204.57@tcp:101:dd.0 Request processed in 833us (934us total) trans 4294967593 rc 0/0 00000100:00100000:1.0:1784093966.308582:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 769 00010000:00010000:1.0:1784093966.309143:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.309151:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.309157:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.309162:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093966.309165:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.309171:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.309183:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907219c12500) 00010000:00010000:1.0:1784093966.309186:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093966.309189:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.309194:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214caffb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093966.312001:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.312049:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767424 00000100:00100000:1.0:1784093966.312056:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767424 00000100:00100000:1.0:1784093966.312090:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 382 00000100:00100000:1.0:1784093966.312097:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:48320:x1870757013767424:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784093966.312119:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093966.312132:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a08 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784093966.312150:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784093966.312165:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=1127s v=(0 0) 00010000:00010000:1.0:1784093966.312168:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093966.312175:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 7 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.312186:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 7 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.312196:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784093966.312237:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:48320:x1870757013767424:12345-192.168.204.57@tcp:101:dd.0 Request processed in 139us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093966.312244:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 382 00000100:00100000:1.0:1784093966.313598:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024282624:0@lo:400:kworker.0 00000100:00100000:3.0:1784093966.313604:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093966.313615:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024282752:0@lo:400:kworker.0 00000100:00100000:0.0:1784093966.313649:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024282880:0@lo:400:kworker.0 00000100:00100000:3.0:1784093966.313658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093966.313659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093966.313685:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024282368 00000100:00100000:2.0:1784093966.313690:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024282368 00000100:00100000:0.0:1784093966.313704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093966.313722:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024282496:0@lo:400:kworker.0 00000100:00100000:1.0:1784093966.313725:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024283136:0@lo:400:kworker.0 00000100:00100000:2.0:1784093966.313729:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1784093966.313738:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024282368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784093966.313764:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093966.313767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093966.313768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093966.313772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093966.313820:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024283008:0@lo:400:kworker.0 00000100:00100000:2.0:1784093966.313820:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024282368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093966.313832:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1784093966.313835:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024282624 00000100:00100000:1.0:1784093966.313836:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024282880 00000100:00100000:0.0:1784093966.313841:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024282624 00000100:00100000:1.0:1784093966.313843:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024282880 00000100:00100000:3.0:1784093966.313848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093966.313864:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024282752 00000100:00100000:2.0:1784093966.313868:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024282752 00000100:00100000:0.0:1784093966.313880:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024283008 00000100:00100000:0.0:1784093966.313885:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024283008 00000100:00100000:1.0:1784093966.313888:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024283136 00000100:00100000:2.0:1784093966.313891:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1784093966.313892:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024283136 00000100:00100000:2.0:1784093966.313900:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024282624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093966.313902:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093966.313914:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1784093966.313926:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1784093966.313927:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024282752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093966.313937:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024282880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093966.313942:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024282624:12345-0@lo:400:kworker.0 Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093966.313948:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1784093966.313959:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024282496 00000100:00100000:3.0:1784093966.313965:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024282496 00000100:00100000:2.0:1784093966.313969:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1784093966.313976:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024282752:12345-0@lo:400:kworker.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093966.313980:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024283008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093966.313986:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1784093966.313998:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024282880:12345-0@lo:400:kworker.0 Request processed in 63us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093966.314006:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1784093966.314020:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1784093966.314026:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1784093966.314029:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024283008:12345-0@lo:400:kworker.0 Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093966.314031:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237587100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024282752:0@lo:400:kworker.0 00000100:00100000:3.0:1784093966.314034:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093966.314037:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024283136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093966.314045:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00080000:0.0:1784093966.314077:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093966.314078:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024283136:12345-0@lo:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00080000:0.0:1784093966.314083:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093966.314088:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1784093966.314092:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024282496:12345-0@lo:400:kworker.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.314102:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1784093966.314118:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024283008:0@lo:400:kworker.0 00000100:00100000:2.0:1784093966.314132:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024282496:0@lo:400:kworker.0 00000100:00100000:1.0:1784093966.314143:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024282880:0@lo:400:kworker.0 00000100:00100000:0.0:1784093966.314156:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024283136:0@lo:400:kworker.0 00000100:00100000:0.0:1784093966.314172:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024282624:0@lo:400:kworker.0 00000100:00100000:2.0:1784093966.321805:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093966.321901:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767552 00000100:00100000:3.0:1784093966.321910:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767552 00002000:00100000:3.0:1784093966.321956:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff907101286680 x1870757013767552/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:287/0 lens 488/0 e 0 to 0 dl 1784093977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784093966.321964:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907101286680 with x1870757013767552 ext(0->1048575) 00002000:00010000:3.0:1784093966.321968:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907101286680 00000100:00100000:3.0:1784093966.321992:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 18 00000100:00100000:3.0:1784093966.321999:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013767552:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:3.0:1784093966.328181:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:2352:x1870757013767552:12345-192.168.204.57@tcp:4:dd.0 Request processed in 6174us (6375us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1784093966.328193:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 18 00002000:00100000:3.0:1784093966.328205:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff907101286680 x1870757013767552/t4294967344(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:287/0 lens 488/448 e 0 to 0 dl 1784093977 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784093966.328216:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907101286680 with x1870757013767552 ext(0->1048575) 00002000:00010000:3.0:1784093966.328223:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907101286680 00000100:00100000:0.0:1784093966.329571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093966.329626:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767680 00000100:00100000:2.0:1784093966.329634:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767680 00000100:00100000:2.0:1784093966.329678:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 770 00000100:00100000:2.0:1784093966.329689:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+14:48320:x1870757013767680:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:1.0:1784093966.339019:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967593 is committed 00000004:00080000:1.0:1784093966.339043:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 62 committed 00000100:00100000:3.0:1784093966.339124:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:48320:x1870757013767680:12345-192.168.204.57@tcp:44:dd.0 Request processed in 9433us (9551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.339132:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 770 00000100:00100000:3.0:1784093966.339187:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024283264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784093966.339247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093966.339274:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024283264 00000100:00100000:1.0:1784093966.339282:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024283264 00000100:00100000:1.0:1784093966.339337:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1784093966.339349:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024283264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784093966.339375:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00010000:00010000:1.0:1784093966.339398:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.339443:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.339453:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784093966.339458:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784093966.339464:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.339491:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.339504:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 6 pid: 6572 timeout: 1227 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093966.339516:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024283392:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784093966.339560:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f54c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784093966.340511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.340524:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024283392:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784093966.340545:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093966.340581:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767808 00000100:00100000:2.0:1784093966.340587:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767808 00000100:00100000:2.0:1784093966.340625:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 384 00000100:00100000:2.0:1784093966.340634:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013767808:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:0.0:1784093966.340682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093966.340760:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013767936 00000100:00100000:3.0:1784093966.340764:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013767936 00010000:00010000:3.0:1784093966.340781:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 7 pid: 6572 timeout: 1227 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093966.340801:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 287 00000100:00100000:3.0:1784093966.340807:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013767936:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784093966.340814:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784093966.340818:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 7 pid: 6572 timeout: 1227 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.340828:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 7 pid: 6572 timeout: 1227 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.340843:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000470a6f46/0x9ce98053214caf99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59ec expref: 7 pid: 6572 timeout: 1227 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.340853:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093966.340855:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784093966.340859:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.340864:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093966.340878:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093966.340894:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093966.340900:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013767936:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093966.340911:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 287 00010000:00010000:1.0:1784093966.340913:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.340925:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.340934:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093966.340955:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093966.340982:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093966.340989:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.340997:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093966.341000:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.341009:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.341019:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.341026:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cb017 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093966.341040:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093966.341041:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093966.341043:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093966.341536:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024283264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2189us (2288us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1784093966.341545:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000004:00080000:3.0:1784093966.342349:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907210e7b800/2, rc 0, transno 4294967345 00000100:00100000:3.0:1784093966.342357:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024283264:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1784093966.349128:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000001:00080000:0.0:1784093966.349145:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000100:00100000:2.0:1784093966.349183:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013767808:12345-192.168.204.57@tcp:16:dd.0 Request processed in 8547us (8669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093966.349191:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 384 00000100:00100000:0.0:1784093966.350911:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093966.350955:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768192 00000100:00100000:1.0:1784093966.350962:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768192 00000100:00100000:1.0:1784093966.350998:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 81 00000100:00100000:1.0:1784093966.351004:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:48320:x1870757013768192:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:1.0:1784093966.351307:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:48320:x1870757013768192:12345-192.168.204.57@tcp:35:dd.0 Request processed in 302us (399us total) trans 4294967594 rc 0/0 00000100:00100000:1.0:1784093966.351312:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 81 00000001:00080000:1.0:1784093966.755042:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967594 is committed 00010000:00010000:1.0:1784093966.825547:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784093967.142241:0:81906:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1128219817520ns, next at 1127999252470ns, rc = 0 00000004:00080000:3.0:1784093967.142339:0:81906:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1128219916748ns, next at 1127620947997ns, rc = 0 00000004:00080000:1.0:1784093967.143166:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 63 committed 00000004:00080000:1.0:1784093967.143643:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 61 committed 00000001:00080000:2.0:1784093967.582601:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000001:00080000:2.0:1784093967.582619:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000100:00100000:0.0:1784093967.615574:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093967.615649:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768320 00000100:00100000:3.0:1784093967.615660:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768320 00000100:00080000:0.0:1784093967.615708:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093967.615735:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 771 00000100:00100000:3.0:1784093967.615748:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013768320:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093967.615841:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013768320:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093967.615850:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 771 00000100:00100000:3.0:1784093967.616556:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093967.616596:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768448 00000100:00100000:1.0:1784093967.616603:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768448 00000100:00080000:0.0:1784093967.616651:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784093967.616661:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 385 00000100:00100000:1.0:1784093967.616672:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48512:x1870757013768448:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093967.617020:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48512:x1870757013768448:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 351us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093967.617025:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 385 00000100:00100000:0.0:1784093967.617641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093967.617682:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768576 00000100:00100000:3.0:1784093967.617686:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768576 00000100:00080000:0.0:1784093967.617726:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784093967.617731:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 386 00000100:00100000:3.0:1784093967.617744:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:48512:x1870757013768576:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093967.617949:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:48512:x1870757013768576:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 207us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093967.617955:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 386 00000100:00100000:2.0:1784093967.618576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093967.618612:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768704 00000100:00100000:1.0:1784093967.618618:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768704 00000100:00100000:1.0:1784093967.618645:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 772 00000100:00100000:1.0:1784093967.618652:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013768704:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784093967.618886:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013768704:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 233us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093967.618894:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 772 00000100:00100000:2.0:1784093967.619843:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093967.619896:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768832 00000100:00100000:3.0:1784093967.619903:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768832 00000100:00100000:3.0:1784093967.619939:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:3.0:1784093967.619949:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013768832:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093967.620005:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013768832:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093967.620014:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:2.0:1784093967.620621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093967.620670:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013768960 00000100:00100000:3.0:1784093967.620677:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013768960 00000100:00100000:3.0:1784093967.620715:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 387 00000100:00100000:3.0:1784093967.620725:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:48512:x1870757013768960:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093967.621079:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:48512:x1870757013768960:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 354us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093967.621106:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 387 00000100:00100000:0.0:1784093967.621624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093967.621656:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769088 00000100:00100000:1.0:1784093967.621662:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769088 00000100:00100000:1.0:1784093967.621700:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 388 00000100:00100000:1.0:1784093967.621708:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:48512:x1870757013769088:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784093967.621966:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:48512:x1870757013769088:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 257us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093967.621975:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 388 00000100:00100000:3.0:1784093967.622608:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093967.622702:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769216 00000100:00100000:0.0:1784093967.622707:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769216 00000100:00100000:0.0:1784093967.622753:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 774 00000100:00100000:0.0:1784093967.622773:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013769216:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784093967.623140:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48512:x1870757013769216:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 372us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093967.623151:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 774 00000100:00100000:0.0:1784093967.642316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093967.642359:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769472 00000100:00100000:1.0:1784093967.642369:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769472 00000100:00100000:1.0:1784093967.642455:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 775 00000100:00100000:1.0:1784093967.642470:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:48516:x1870757013769472:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784093967.642522:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093967.642552:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a01 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.642570:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784093967.642579:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093967.642600:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.642615:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.642625:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.642640:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.642647:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.642652:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.643026:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.643035:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.643043:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784093967.644216:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:1.0:1784093967.644226:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1128721803620ns, next at 1129721801297ns, rc = 0 00010000:00010000:1.0:1784093967.644324:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644332:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644338:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644342:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644346:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644350:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644369:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784093967.644383:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644387:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644391:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644397:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093967.644400:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784093967.644402:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.644414:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644415:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644461:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff907219c12700) 00010000:00010000:1.0:1784093967.644470:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784093967.644479:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784093967.644480:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.644489:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644490:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb02c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644519:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.644521:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644540:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644546:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644550:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093967.644551:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff907219c12700) 00010000:00010000:1.0:1784093967.644554:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.644556:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784093967.644565:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644566:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.644598:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb033 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644601:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784093967.644615:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093967.644619:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093967.644624:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb01e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.644631:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093967.644636:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093967.644639:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1784093967.644640:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008defc16a reply state 000000003bd78b0e transno 4294967595 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093967.644648:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784093967.644709:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:48516:x1870757013769472:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2244us (2406us total) trans 4294967595 rc 0/0 00000100:00100000:1.0:1784093967.644718:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 775 00010000:00010000:3.0:1784093967.645400:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.645412:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.645445:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.645454:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093967.645459:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.645467:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.645483:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907219c12300) 00010000:00010000:3.0:1784093967.645487:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093967.645491:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.645498:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb025 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093967.850525:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784093968.352111:0:82052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1129429686219ns, next at 1127999252470ns, rc = 0 00000004:00080000:1.0:1784093968.352202:0:82052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1129429779754ns, next at 1129721801297ns, rc = 0 00000004:00080000:1.0:1784093968.360026:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 64 committed 00000001:00080000:1.0:1784093968.360051:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967595 is committed 00000004:00080000:1.0:1784093968.360058:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 62 committed 00000100:00100000:1.0:1784093968.360221:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024283520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784093968.360276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093968.360319:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024283520 00000100:00100000:2.0:1784093968.360329:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024283520 00000100:00080000:0.0:1784093968.360363:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093968.360387:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1784093968.360398:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024283520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784093968.360445:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00010000:00010000:2.0:1784093968.360468:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093968.360488:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093968.360502:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784093968.360506:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093968.360512:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093968.360537:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093968.360551:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 5 pid: 8031 timeout: 1229 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093968.360562:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024283648:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093968.360623:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e32b3c0 going to sleep for 11 seconds 00000004:00080000:0.0:1784093968.360807:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 63 committed 00000100:00100000:0.0:1784093968.361529:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784093968.361543:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024283776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784093968.361581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093968.361600:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024283776 00000100:00100000:3.0:1784093968.361605:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024283776 00000100:00080000:0.0:1784093968.361634:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093968.361661:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024283648:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093968.361679:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093968.361690:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1784093968.361700:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024283776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093968.361789:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093968.361815:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093968.361857:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769600 00000100:00100000:1.0:1784093968.361861:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769600 00000100:00100000:2.0:1784093968.361871:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:2.0:1784093968.361880:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907210e7b800, transno 4294967345 00000100:00100000:3.0:1784093968.361883:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024283776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (300us total) trans 0 rc 0/0 00010000:00010000:1.0:1784093968.361888:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 6 pid: 8031 timeout: 1229 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093968.361896:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1784093968.361898:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024283776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093968.361934:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 288 00000100:00100000:1.0:1784093968.361943:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013769600:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784093968.361955:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784093968.361961:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 6 pid: 8031 timeout: 1229 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093968.361975:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 6 pid: 8031 timeout: 1229 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093968.361997:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a08 expref: 6 pid: 8031 timeout: 1229 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093968.362010:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093968.362013:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784093968.362019:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093968.362029:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093968.362055:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784093968.362078:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093968.362086:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093968.362093:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093968.362103:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013769600:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 158us (285us total) trans 0 rc 0/0 00010000:00010000:2.0:1784093968.362106:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093968.362118:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 288 00010000:00010000:2.0:1784093968.362125:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093968.362136:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093968.362143:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093968.362151:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093968.362154:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093968.362161:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093968.362171:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093968.362180:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335d6a64/0x9ce98053214cb03a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093968.362193:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093968.362194:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093968.362195:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093968.362576:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024283520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2181us (2299us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1784093968.362582:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1784093968.362606:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:1.0:1784093968.362611:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237586d80, transno 4294967343 00000100:00100000:1.0:1784093968.362624:0:3304:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90723d705180 x1870757024283520/t4294967345(4294967345) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784093984 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1784093968.362634:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d705180/2, rc 0, transno 4294967345 00000100:00100000:1.0:1784093968.362645:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024283520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784093968.873591:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093969.897637:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093970.808365:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093970.808412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093970.808447:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769856 00000100:00100000:3.0:1784093970.808457:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769856 00000100:00100000:0.0:1784093970.808477:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769728 00000100:00100000:2.0:1784093970.808481:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093970.808483:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769728 00000100:00080000:1.0:1784093970.808515:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093970.808517:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093970.808536:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 753 00000100:00100000:3.0:1784093970.808538:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:0.0:1784093970.808547:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013769728:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093970.808554:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013769856:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093970.808561:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013769984 00000100:00100000:1.0:1784093970.808564:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770112 00000100:00100000:2.0:1784093970.808567:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013769984 00000100:00100000:1.0:1784093970.808571:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770112 00000100:00100000:0.0:1784093970.808617:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013769728:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093970.808620:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 551 00000100:00100000:3.0:1784093970.808622:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013769856:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093970.808634:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013769984:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093970.808639:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00100000:0.0:1784093970.808639:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 753 00000100:00100000:3.0:1784093970.808640:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:1.0:1784093970.808665:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013770112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093970.808677:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013769984:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093970.808686:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 551 00000100:00100000:1.0:1784093970.808709:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013770112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093970.808719:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00080000:1.0:1784093970.808753:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784093970.808757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784093970.921547:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093971.433571:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784093971.433592:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024283904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093971.433657:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093971.433709:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024283904 00000100:00100000:1.0:1784093971.433716:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024283904 00000100:00100000:1.0:1784093971.433773:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1784093971.433783:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024283904:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784093971.433792:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1784093971.433822:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52625408 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784093971.433884:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024283904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093971.433893:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1784093971.433926:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024283904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093971.434510:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024284032:0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.434549:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024284160:0@lo:400:kworker.0 00000100:00100000:3.0:1784093971.434556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093971.434593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093971.434600:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024284544:0@lo:400:kworker.0 00000100:00100000:3.0:1784093971.434633:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093971.434652:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284160 00000100:00100000:1.0:1784093971.434658:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284160 00000100:00100000:3.0:1784093971.434678:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284032 00000100:00100000:3.0:1784093971.434684:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284032 00000100:00100000:1.0:1784093971.434695:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284544 00000100:00100000:1.0:1784093971.434700:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284544 00000100:00100000:3.0:1784093971.434722:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1784093971.434732:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024284032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.434742:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1784093971.434750:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024284160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093971.434778:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024284032:12345-0@lo:400:kworker.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093971.434785:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1784093971.434805:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024284160:12345-0@lo:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093971.434814:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1784093971.434822:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1784093971.434832:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024284544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.434858:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024284416:0@lo:400:kworker.0 00000100:00100000:3.0:1784093971.434865:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024284544:12345-0@lo:400:kworker.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093971.434871:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1784093971.434900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093971.434906:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024284544:0@lo:400:kworker.0 00000100:00100000:3.0:1784093971.434922:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024284032:0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.434936:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784093971.434947:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024284288:0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.434978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093971.435019:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284288 00000100:00100000:3.0:1784093971.435024:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284288 00000100:00100000:1.0:1784093971.435033:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284416 00000100:00100000:1.0:1784093971.435038:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284416 00000100:00100000:3.0:1784093971.435059:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1784093971.435069:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024284288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.435087:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1784093971.435099:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024284416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093971.435112:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024284288:12345-0@lo:400:kworker.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093971.435119:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1784093971.435151:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024284416:12345-0@lo:400:kworker.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093971.435160:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00080000:1.0:1784093971.435198:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093971.435203:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093971.435230:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024284160:0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.435264:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024284288:0@lo:400:kworker.0 00000100:00100000:1.0:1784093971.435277:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024284416:0@lo:400:kworker.0 00010000:00010000:0.0:1784093971.945543:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093972.969577:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784093972.978365:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000100:00100000:2.0:1784093973.481626:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093973.481649:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024284672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093973.481719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093973.481758:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284672 00000100:00100000:0.0:1784093973.481768:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284672 00000100:00080000:1.0:1784093973.481816:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093973.481835:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1784093973.481848:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024284672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093973.481881:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093973.481933:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024284672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093973.481940:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1784093973.481966:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024284672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093973.993541:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093975.017640:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093975.928278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093975.928327:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093975.928350:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770368 00000100:00100000:1.0:1784093975.928361:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770368 00000100:00100000:3.0:1784093975.928367:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093975.928458:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770624 00000100:00100000:3.0:1784093975.928459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093975.928465:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770624 00000100:00100000:1.0:1784093975.928470:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:1.0:1784093975.928483:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013770368:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093975.928498:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770496 00000100:00100000:3.0:1784093975.928503:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770496 00000100:00100000:2.0:1784093975.928511:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 554 00000100:00100000:2.0:1784093975.928521:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013770624:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093975.928554:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013770368:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093975.928559:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 555 00000100:00100000:2.0:1784093975.928563:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013770624:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093975.928568:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:3.0:1784093975.928576:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013770496:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093975.928581:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 554 00000100:00080000:2.0:1784093975.928606:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093975.928611:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093975.928614:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093975.928619:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013770496:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093975.928627:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 555 00000100:00100000:0.0:1784093975.928721:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770240 00000100:00100000:0.0:1784093975.928726:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770240 00000100:00100000:0.0:1784093975.928759:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 755 00000100:00100000:0.0:1784093975.928766:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013770240:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093975.928804:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013770240:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093975.928810:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 755 00010000:00010000:0.0:1784093976.041547:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093976.553529:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024284928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093976.553529:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024284800:0@lo:400:kworker.0 00000100:00100000:1.0:1784093976.553581:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024285184:0@lo:400:kworker.0 00000100:00100000:0.0:1784093976.553607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093976.553611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093976.553623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093976.553672:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784093976.553677:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024285440:0@lo:400:kworker.0 00000100:00100000:0.0:1784093976.553677:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024285312:0@lo:400:kworker.0 00000100:00100000:1.0:1784093976.553680:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024285056:0@lo:400:kworker.0 00000100:00100000:1.0:1784093976.553726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093976.553738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093976.553739:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284928 00000100:00100000:3.0:1784093976.553745:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284928 00000100:00100000:1.0:1784093976.553756:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024285568:0@lo:400:kworker.0 00000100:00100000:0.0:1784093976.553785:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024284800 00000100:00100000:0.0:1784093976.553791:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024284800 00000100:00100000:1.0:1784093976.553792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093976.553813:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784093976.553825:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024284928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093976.553834:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1784093976.553838:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285312 00000100:00100000:1.0:1784093976.553844:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285312 00000100:00100000:0.0:1784093976.553845:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024284800:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784093976.553856:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52625408 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784093976.553894:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285568 00000100:00100000:1.0:1784093976.553898:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285568 00000100:00100000:0.0:1784093976.553901:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024284800:12345-0@lo:400:kworker.0 Request processed in 57us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093976.553909:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024284928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093976.553923:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1784093976.553931:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1784093976.553938:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1784093976.553946:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024285312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093976.553956:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285184 00000100:00100000:3.0:1784093976.553960:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285184 00000100:00100000:0.0:1784093976.553969:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1784093976.553980:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093976.553985:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024285312:12345-0@lo:400:kworker.0 Request processed in 39us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093976.553992:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1784093976.553999:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285056 00000100:00100000:3.0:1784093976.554003:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285056 00000100:00100000:0.0:1784093976.554030:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024285568:12345-0@lo:400:kworker.0 Request processed in 53us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093976.554033:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1784093976.554042:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:3.0:1784093976.554047:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024285184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093976.554048:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024285312:0@lo:400:kworker.0 00000100:00100000:1.0:1784093976.554062:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024284800:0@lo:400:kworker.0 00000100:00100000:0.0:1784093976.554080:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:0.0:1784093976.554086:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d705180, transno 4294967345 00000100:00100000:3.0:1784093976.554095:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024285184:12345-0@lo:400:kworker.0 Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093976.554101:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024285568:0@lo:400:kworker.0 00000100:00100000:3.0:1784093976.554102:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00080000:1.0:1784093976.554108:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784093976.554116:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784093976.554121:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093976.554123:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024285184:0@lo:400:kworker.0 00000100:00100000:3.0:1784093976.554125:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1784093976.554137:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024285056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093976.554184:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024285056:12345-0@lo:400:kworker.0 Request processed in 49us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093976.554190:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1784093976.554213:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024285056:0@lo:400:kworker.0 00000100:00100000:3.0:1784093976.554216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093976.554254:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285440 00000100:00100000:3.0:1784093976.554255:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024284928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093976.554260:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285440 00000100:00080000:3.0:1784093976.554289:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784093976.554303:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1784093976.554314:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024285440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093976.554361:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024285440:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093976.554369:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1784093976.554378:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024285440:0@lo:400:kworker.0 00010000:00010000:0.0:1784093977.065536:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093978.089579:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093978.601620:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784093978.601656:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024285696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093978.601722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093978.601767:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285696 00000100:00100000:3.0:1784093978.601775:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285696 00000100:00080000:1.0:1784093978.601805:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093978.601835:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1784093978.601845:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024285696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093978.601886:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093978.601944:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024285696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093978.601953:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1784093978.601975:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024285696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093979.113576:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093980.137566:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093981.048269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093981.048318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093981.048348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093981.048376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093981.048379:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770880 00000100:00100000:1.0:1784093981.048390:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770880 00000100:00100000:2.0:1784093981.048415:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771008 00000100:00100000:2.0:1784093981.048449:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771008 00000100:00100000:0.0:1784093981.048455:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013770752 00000100:00100000:0.0:1784093981.048460:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013770752 00000100:00100000:2.0:1784093981.048501:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771136 00000100:00100000:1.0:1784093981.048501:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:0.0:1784093981.048501:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:2.0:1784093981.048508:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771136 00000100:00100000:0.0:1784093981.048514:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013770752:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093981.048520:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013770880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093981.048541:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 558 00000100:00100000:2.0:1784093981.048550:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013771008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093981.048621:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013770880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093981.048628:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013771008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093981.048628:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013770752:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093981.048638:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:0.0:1784093981.048649:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:2.0:1784093981.048650:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 558 00000100:00100000:1.0:1784093981.048670:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 559 00000100:00100000:1.0:1784093981.048680:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013771136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093981.048711:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013771136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (333us total) trans 0 rc 0/0 00000100:00080000:3.0:1784093981.048718:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784093981.048719:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 559 00000100:00080000:3.0:1784093981.048725:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093981.048729:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784093981.161580:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093981.673608:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024285824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093981.673613:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024286208:0@lo:400:kworker.0 00000100:00100000:2.0:1784093981.673613:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024286080:0@lo:400:kworker.0 00000100:00100000:1.0:1784093981.673640:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024286336:0@lo:400:kworker.0 00000100:00100000:3.0:1784093981.673687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093981.673691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093981.673692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093981.673737:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286208 00000100:00100000:2.0:1784093981.673745:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286208 00000100:00100000:0.0:1784093981.673750:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024285952:0@lo:400:kworker.0 00000100:00100000:3.0:1784093981.673767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093981.673767:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285824 00000100:00100000:1.0:1784093981.673772:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285824 00000100:00100000:0.0:1784093981.673799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093981.673806:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024286592:0@lo:400:kworker.0 00000100:00100000:2.0:1784093981.673807:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286080 00000100:00100000:2.0:1784093981.673810:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286080 00000100:00100000:1.0:1784093981.673812:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1784093981.673846:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024285824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093981.673854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093981.673859:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024286464:0@lo:400:kworker.0 00000100:00100000:2.0:1784093981.673860:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1784093981.673872:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024286208:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1784093981.673884:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52625408 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093981.673890:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1784093981.673897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093981.673901:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024286080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093981.673936:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024286208:12345-0@lo:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093981.673938:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286464 00000100:00100000:0.0:1784093981.673944:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286464 00000100:00100000:2.0:1784093981.673947:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1784093981.673953:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024285824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093981.673954:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024286080:12345-0@lo:400:kworker.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093981.673973:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1784093981.673974:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1784093981.673975:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286336 00000100:00100000:2.0:1784093981.673981:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286336 00000100:00100000:0.0:1784093981.673989:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:0.0:1784093981.674000:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024286464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093981.674012:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286592 00000100:00100000:2.0:1784093981.674016:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286592 00000100:00100000:3.0:1784093981.674020:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024286080:0@lo:400:kworker.0 00000100:00100000:1.0:1784093981.674034:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024285952 00000100:00100000:1.0:1784093981.674039:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024285952 00000100:00100000:2.0:1784093981.674046:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1784093981.674046:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024286464:12345-0@lo:400:kworker.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093981.674058:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00080000:3.0:1784093981.674059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093981.674060:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024286336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784093981.674065:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784093981.674069:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093981.674074:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1784093981.674086:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024285952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093981.674091:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784093981.674102:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024286592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093981.674104:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024286464:0@lo:400:kworker.0 00000100:00100000:2.0:1784093981.674106:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024286336:12345-0@lo:400:kworker.0 Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093981.674118:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1784093981.674135:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024285952:12345-0@lo:400:kworker.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093981.674140:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024285824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093981.674146:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1784093981.674152:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024286592:12345-0@lo:400:kworker.0 Request processed in 51us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093981.674158:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024286208:0@lo:400:kworker.0 00000100:00100000:3.0:1784093981.674160:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1784093981.674162:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024285952:0@lo:400:kworker.0 00000100:00100000:3.0:1784093981.674197:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024286592:0@lo:400:kworker.0 00000100:00100000:1.0:1784093981.674205:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024286336:0@lo:400:kworker.0 00010000:00010000:1.0:1784093982.185574:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093983.209550:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093983.721610:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024286720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093983.721681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093983.721718:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286720 00000100:00100000:3.0:1784093983.721725:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286720 00000100:00080000:1.0:1784093983.721757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093983.721788:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1784093983.721798:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024286720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093983.721832:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093983.721880:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024286720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093983.721888:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1784093983.721926:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024286720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784093984.233561:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093985.257566:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093986.168290:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093986.168345:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093986.168372:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093986.168403:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771264 00000100:00100000:1.0:1784093986.168408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093986.168414:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771264 00000100:00100000:0.0:1784093986.168455:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771648 00000100:00100000:0.0:1784093986.168461:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771648 00000100:00100000:1.0:1784093986.168471:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771520 00000100:00100000:1.0:1784093986.168476:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771520 00000100:00100000:2.0:1784093986.168501:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 759 00000100:00100000:2.0:1784093986.168511:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013771264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093986.168522:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 562 00000100:00100000:0.0:1784093986.168534:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013771648:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093986.168547:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771392 00000100:00100000:3.0:1784093986.168553:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771392 00000100:00100000:2.0:1784093986.168580:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013771264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093986.168580:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013771648:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.168594:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 769 00000100:00100000:2.0:1784093986.168602:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 759 00000100:00100000:0.0:1784093986.168602:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 562 00000100:00100000:3.0:1784093986.168610:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013771392:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093986.168630:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:0.0:1784093986.168640:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013771520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093986.168650:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013771392:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.168660:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 769 00000100:00100000:0.0:1784093986.168670:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013771520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093986.168678:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00080000:2.0:1784093986.168800:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093986.168806:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784093986.168809:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784093986.281664:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093986.793601:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024287232:0@lo:400:kworker.0 00000100:00100000:2.0:1784093986.793601:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024287104:0@lo:400:kworker.0 00000100:00100000:1.0:1784093986.793602:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024286976:0@lo:400:kworker.0 00000100:00100000:0.0:1784093986.793658:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024286848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093986.793676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093986.793677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093986.793712:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286976 00000100:00100000:0.0:1784093986.793716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093986.793732:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286976 00000100:00100000:1.0:1784093986.793747:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024287360:0@lo:400:kworker.0 00000100:00100000:3.0:1784093986.793757:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093986.793764:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024287488:0@lo:400:kworker.0 00000100:00100000:1.0:1784093986.793778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093986.793788:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024287616:0@lo:400:kworker.0 00000100:00100000:2.0:1784093986.793794:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1784093986.793801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093986.793808:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024286976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093986.793817:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024286848 00000100:00100000:1.0:1784093986.793823:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024286848 00000100:00100000:3.0:1784093986.793827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093986.793850:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024287360 00000100:00100000:0.0:1784093986.793856:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024287360 00000100:00100000:3.0:1784093986.793870:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024287616 00000100:00100000:2.0:1784093986.793874:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024286976:12345-0@lo:400:kworker.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.793875:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024287616 00000100:00100000:1.0:1784093986.793881:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1784093986.793886:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1784093986.793891:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024286848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093986.793905:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1784093986.793912:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00002000:00000024:1.0:1784093986.793917:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52625408 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093986.793918:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024287360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093986.793923:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093986.793928:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024287232 00000100:00100000:2.0:1784093986.793933:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024287232 00000100:00100000:1.0:1784093986.793966:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024286848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093986.793973:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1784093986.793979:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024287104 00000100:00100000:2.0:1784093986.793983:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024287104 00000100:00100000:0.0:1784093986.793984:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024287360:12345-0@lo:400:kworker.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.793989:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024287616:12345-0@lo:400:kworker.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093986.793997:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024287488 00000100:00100000:0.0:1784093986.794001:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1784093986.794003:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024287488 00000100:00100000:2.0:1784093986.794008:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1784093986.794009:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1784093986.794022:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024287232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093986.794032:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1784093986.794040:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1784093986.794043:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024287104:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093986.794047:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784093986.794052:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024287488:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784093986.794054:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093986.794059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093986.794062:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024287232:12345-0@lo:400:kworker.0 Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093986.794068:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1784093986.794089:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024287104:12345-0@lo:400:kworker.0 Request processed in 49us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093986.794097:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1784093986.794098:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024287360:0@lo:400:kworker.0 00000100:00100000:3.0:1784093986.794101:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024287488:12345-0@lo:400:kworker.0 Request processed in 51us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.794111:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1784093986.794118:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024287616:0@lo:400:kworker.0 00000100:00100000:0.0:1784093986.794125:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024286976:0@lo:400:kworker.0 00000100:00100000:2.0:1784093986.794135:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024287104:0@lo:400:kworker.0 00000100:00100000:1.0:1784093986.794156:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024286848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093986.794158:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024287232:0@lo:400:kworker.0 00000100:00100000:1.0:1784093986.794175:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024287488:0@lo:400:kworker.0 00000100:00100000:0.0:1784093986.842924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093986.842984:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771776 00000100:00100000:2.0:1784093986.842994:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771776 00000100:00100000:2.0:1784093986.843044:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 776 00000100:00100000:2.0:1784093986.843052:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013771776:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093986.843129:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013771776:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093986.843137:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 776 00000100:00100000:2.0:1784093986.844059:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093986.844102:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013771904 00000100:00100000:3.0:1784093986.844108:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013771904 00000100:00100000:3.0:1784093986.844142:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 390 00000100:00100000:3.0:1784093986.844149:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013771904:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093986.844473:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013771904:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 323us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.844480:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 390 00000100:00100000:1.0:1784093986.845118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093986.845153:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772032 00000100:00100000:3.0:1784093986.845157:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772032 00000100:00100000:3.0:1784093986.845181:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 391 00000100:00100000:3.0:1784093986.845198:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013772032:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093986.845390:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013772032:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 194us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.845395:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 391 00000100:00100000:0.0:1784093986.846022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093986.846063:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772160 00000100:00100000:2.0:1784093986.846068:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772160 00000100:00100000:2.0:1784093986.846099:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 777 00000100:00100000:2.0:1784093986.846107:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013772160:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093986.846372:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013772160:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 266us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093986.846380:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 777 00000100:00100000:2.0:1784093986.847479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093986.847517:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772288 00000100:00100000:3.0:1784093986.847524:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772288 00000100:00100000:3.0:1784093986.847556:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 778 00000100:00100000:3.0:1784093986.847563:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013772288:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784093986.847616:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013772288:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.847623:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 778 00000100:00100000:1.0:1784093986.848261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093986.848317:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772416 00000100:00100000:2.0:1784093986.848322:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772416 00000100:00100000:2.0:1784093986.848354:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 392 00000100:00100000:2.0:1784093986.848361:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013772416:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784093986.848628:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013772416:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 266us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093986.848635:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 392 00000100:00100000:0.0:1784093986.849413:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093986.849454:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772544 00000100:00100000:3.0:1784093986.849460:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772544 00000100:00100000:3.0:1784093986.849492:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 393 00000100:00100000:3.0:1784093986.849500:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013772544:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784093986.849728:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:48894:x1870757013772544:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 218us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093986.849735:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 393 00000100:00100000:3.0:1784093986.850334:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093986.850376:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772672 00000100:00100000:2.0:1784093986.850380:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772672 00000100:00100000:2.0:1784093986.850403:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 779 00000100:00100000:2.0:1784093986.850408:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013772672:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784093986.850603:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48894:x1870757013772672:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 193us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093986.850610:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 779 00010000:00010000:2.0:1784093987.306518:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093987.368630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093987.368673:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013772800 00000100:00100000:3.0:1784093987.368684:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013772800 00000100:00100000:3.0:1784093987.368754:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 780 00000100:00100000:3.0:1784093987.368766:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:48908:x1870757013772800:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784093987.368795:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093987.368817:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a0f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.368881:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.368895:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.368913:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784093987.369128:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1784093987.369134:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784093987.369217:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.369247:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a0f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.369263:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a0f expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.369271:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093987.369274:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784093987.369278:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784093987.369341:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:48908:x1870757013772800:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 577us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093987.369349:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 780 00000100:00100000:1.0:1784093987.370578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093987.370611:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013773056 00000100:00100000:3.0:1784093987.370618:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013773056 00000100:00100000:3.0:1784093987.370652:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 781 00000100:00100000:3.0:1784093987.370660:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:48908:x1870757013773056:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784093987.370689:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784093987.370706:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a0f expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.370734:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cafe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf59fa expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.370743:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784093987.370752:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093987.370768:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.370778:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.370785:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093987.380975:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967596 is committed 00000004:00010000:0.0:1784093987.380984:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b5a2bafa reply state 000000001db8f5a1 transno 4294967596 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.380999:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093987.381100:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00080000:0.0:1784093987.381182:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093987.381198:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48908:x1870757013773056:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 10537us (10619us total) trans 4294967596 rc 0/0 00000100:00100000:0.0:1784093987.381206:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 781 00010000:00010000:2.0:1784093987.381233:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.381243:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.381252:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.381257:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093987.381261:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.381266:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.381279:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784093987.381282:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784093987.381285:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.381289:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb04f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093987.399513:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093987.399549:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013773184 00000100:00100000:2.0:1784093987.399562:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013773184 00000100:00100000:2.0:1784093987.399623:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 782 00000100:00100000:2.0:1784093987.399637:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:48912:x1870757013773184:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093987.399661:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093987.399681:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a16 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.399753:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.399767:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.399780:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.399795:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.399802:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.399809:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400279:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb06b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400287:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400295:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093987.400399:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1784093987.400403:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093987.400574:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb06b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400594:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400601:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400608:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400613:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093987.400618:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400626:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400639:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784093987.400642:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093987.400647:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400653:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb05d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400665:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400671:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400676:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400682:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093987.400685:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400691:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400701:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781c00) 00010000:00010000:2.0:1784093987.400704:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093987.400720:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400727:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb064 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400763:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a16 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400783:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb06b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a16 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.400792:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093987.400797:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093987.400800:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41400, rc 0) 00000100:00100000:2.0:1784093987.400865:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48912:x1870757013773184:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1232us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093987.400873:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 782 00000100:00100000:2.0:1784093987.402127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093987.402168:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013773440 00000100:00100000:3.0:1784093987.402178:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013773440 00000100:00100000:3.0:1784093987.402238:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 783 00000100:00100000:3.0:1784093987.402251:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:48912:x1870757013773440:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784093987.402266:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784093987.402284:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb072 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a1d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.402607:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.402618:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.402627:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.402643:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.402650:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.402657:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784093987.403573:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:3.0:1784093987.403786:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403797:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403807:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403837:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403844:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403850:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403857:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784093987.403861:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403868:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403876:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781900) 00010000:00010000:3.0:1784093987.403879:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784093987.403882:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403892:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb079 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784093987.403904:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000689ff71c reply state 000000001edbed65 transno 4294967597 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093987.403913:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784093987.403937:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb072 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a1d expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403946:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a1d expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.403950:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784093987.403952:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784093987.403953:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784093987.403997:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:48912:x1870757013773440:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1752us (1877us total) trans 4294967597 rc 0/0 00000100:00100000:3.0:1784093987.404002:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 783 00010000:00010000:1.0:1784093987.404587:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.404596:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.404602:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.404608:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093987.404611:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.404617:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.404627:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907204fce500) 00010000:00010000:1.0:1784093987.404629:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093987.404631:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.404635:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb080 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093987.405667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093987.405750:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013773696 00000100:00100000:0.0:1784093987.405764:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013773696 00000100:00100000:0.0:1784093987.405830:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 784 00000100:00100000:0.0:1784093987.405846:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:48912:x1870757013773696:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:0.0:1784093987.405906:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093987.405936:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a1d expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.405954:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907204fce600) 00010000:00010000:0.0:1784093987.405966:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093987.406014:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.406034:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.406044:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093987.406181:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c46fd230 reply state 00000000a4940883 transno 4294967598 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.406190:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093987.406288:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:48912:x1870757013773696:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 446us (620us total) trans 4294967598 rc 0/0 00000100:00100000:0.0:1784093987.406297:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 784 00010000:00010000:1.0:1784093987.406918:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.406930:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.406936:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.406943:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093987.406946:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.406953:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.406966:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:1.0:1784093987.406969:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093987.406972:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.406978:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb095 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093987.407108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093987.407153:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013773824 00000100:00100000:0.0:1784093987.407161:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013773824 00000100:00100000:0.0:1784093987.407219:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 785 00000100:00100000:0.0:1784093987.407232:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:48912:x1870757013773824:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784093987.407251:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093987.407269:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb09c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a24 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.407312:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a24 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.407327:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb09c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a24 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.407345:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093987.407348:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784093987.407350:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784093987.407391:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:48912:x1870757013773824:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 163us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093987.407398:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 785 00000100:00100000:3.0:1784093987.408479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093987.408552:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013773952 00000100:00100000:0.0:1784093987.408560:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013773952 00000100:00100000:0.0:1784093987.408621:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 394 00000100:00100000:0.0:1784093987.408634:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013773952:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:0.0:1784093987.409164:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013773952:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 533us (693us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1784093987.409173:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 394 00000100:00100000:3.0:1784093987.410038:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093987.410102:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013774208 00000100:00100000:0.0:1784093987.410111:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013774208 00000100:00100000:0.0:1784093987.410161:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 82 00000100:00100000:0.0:1784093987.410173:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:48912:x1870757013774208:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:0.0:1784093987.410476:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48912:x1870757013774208:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 306us (440us total) trans 4294967599 rc 0/0 00000100:00100000:0.0:1784093987.410485:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 82 00000100:00100000:3.0:1784093987.426660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093987.426701:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013774336 00000100:00100000:1.0:1784093987.426721:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013774336 00000100:00100000:1.0:1784093987.426783:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 786 00000100:00100000:1.0:1784093987.426794:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48916:x1870757013774336:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784093987.426815:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784093987.426835:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb0a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a2b expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.426905:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.426920:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.426931:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.426946:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.426952:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.426959:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427047:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427053:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427058:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784093987.427083:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x41:0x0]: returning size 0 00000004:00200000:1.0:1784093987.427086:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784093987.427105:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427121:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427129:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427136:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427141:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427145:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093987.427148:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427153:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427161:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784093987.427163:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093987.427166:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427170:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427178:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427184:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427190:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427195:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093987.427197:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427210:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427218:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907219c12c00) 00010000:00010000:1.0:1784093987.427220:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093987.427223:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427229:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb0b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427257:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb0a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a2b expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427270:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a2b expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.427284:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907202e6b200) 00010000:00010000:1.0:1784093987.427287:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784093987.427289:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784093987.427354:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:48916:x1870757013774336:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 563us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093987.427363:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 786 00000100:00100000:3.0:1784093987.428558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093987.428630:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013774464 00000100:00100000:2.0:1784093987.428636:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013774464 00000100:00100000:2.0:1784093987.428664:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 395 00000100:00100000:2.0:1784093987.428669:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013774464:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784093987.428715:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093987.428730:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a32 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093987.428748:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x6a571d23, atime: 0x6a571d23, ctime: 0x6a571d23, blocks: 0x1 00010000:00010000:2.0:1784093987.428759:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1148s v=(0 0) 00010000:00010000:2.0:1784093987.428763:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093987.428770:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.428780:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.428788:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784093987.428814:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013774464:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 145us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093987.428818:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 395 00000100:00100000:3.0:1784093987.430221:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093987.430270:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013774720 00000100:00100000:0.0:1784093987.430275:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013774720 00000100:00100000:0.0:1784093987.430310:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 787 00000100:00100000:0.0:1784093987.430318:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:48916:x1870757013774720:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784093987.430351:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093987.430369:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb0b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a2b expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430386:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb09c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a24 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430396:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784093987.430403:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093987.430416:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430444:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430453:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430464:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430471:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430478:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430551:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430558:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.430565:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093987.431050:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 64 off9792 00000004:00080000:0.0:1784093987.431060:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1148508637316ns, next at 1149508635308ns, rc = 0 00010000:00010000:0.0:1784093987.431109:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431118:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431125:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431132:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431138:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431144:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431176:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093987.431191:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431197:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093987.431198:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431206:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431208:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431225:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093987.431225:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093987.431232:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431233:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431251:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431252:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431267:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907202e6b000) 00010000:00010000:1.0:1784093987.431276:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093987.431279:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 1/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431280:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784093987.431287:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784093987.431288:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb0db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431291:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431297:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093987.431300:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093987.431300:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb0d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.431303:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093987.431319:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431326:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431336:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431341:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093987.431344:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431350:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431356:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781900) 00010000:00010000:0.0:1784093987.431359:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093987.431361:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.431368:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb0c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093987.431376:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e01dc607 reply state 0000000079f6e6cd transno 4294967600 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.431384:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093987.431452:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:48916:x1870757013774720:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1133us (1230us total) trans 4294967600 rc 0/0 00000100:00100000:0.0:1784093987.431460:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 787 00010000:00010000:1.0:1784093987.432028:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.432039:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.432046:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.432056:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093987.432059:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.432065:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.432075:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907202e6b300) 00010000:00010000:1.0:1784093987.432078:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784093987.432081:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.432087:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb0cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093987.754281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093987.754337:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013774848 00000100:00100000:2.0:1784093987.754347:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013774848 00000100:00100000:2.0:1784093987.754416:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 788 00000100:00100000:2.0:1784093987.754441:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:48931:x1870757013774848:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093987.754464:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093987.754484:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb0e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a39 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.754543:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb0e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.754558:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.754571:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093987.754636:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1784093987.754641:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093987.754669:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.754694:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb0e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a39 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.754728:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a39 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.754737:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784093987.754740:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093987.754743:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784093987.754806:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:48931:x1870757013774848:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 366us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093987.754814:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 788 00000100:00100000:3.0:1784093987.755974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093987.756036:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013775104 00000100:00100000:1.0:1784093987.756043:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013775104 00000100:00100000:1.0:1784093987.756078:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 789 00000100:00100000:1.0:1784093987.756088:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:48931:x1870757013775104:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784093987.756117:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784093987.756134:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb0e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a39 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.756152:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb06b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a16 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.756163:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784093987.756183:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784093987.756202:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.756212:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.756220:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784093987.768732:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967600 is committed 00000004:00080000:1.0:1784093987.768744:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 65 committed 00000004:00010000:0.0:1784093987.768750:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000aab02374 reply state 00000000c4820dc1 transno 4294967601 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.768765:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784093987.768772:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967601 is committed 00000100:00100000:3.0:1784093987.768873:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024287744:0@lo:6:osp-syn-0-0.0 00000004:00200000:0.0:1784093987.768905:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:3.0:1784093987.768941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093987.768983:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024287744 00000100:00100000:2.0:1784093987.768990:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024287744 00010000:00080000:0.0:1784093987.769001:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784093987.769020:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48931:x1870757013775104:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 12933us (13045us total) trans 4294967601 rc 0/0 00010000:00010000:1.0:1784093987.769028:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.769029:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 789 00000100:00100000:2.0:1784093987.769037:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00010000:00010000:1.0:1784093987.769041:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.769048:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093987.769050:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024287744:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1784093987.769054:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093987.769060:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.769066:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.769078:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907219c12c00) 00002000:00080000:2.0:1784093987.769079:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00010000:00010000:1.0:1784093987.769081:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093987.769086:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093987.769099:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb0f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.769102:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.769122:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.769131:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093987.769136:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093987.769140:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.769168:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.769183:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 6 pid: 6574 timeout: 1248 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784093987.769196:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024287872:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784093987.769248:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff907206b0b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784093987.770957:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024287872:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093987.770975:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784093987.771210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093987.771252:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013775232 00000100:00100000:0.0:1784093987.771258:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013775232 00010000:00010000:0.0:1784093987.771286:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 7 pid: 6574 timeout: 1248 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.771317:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 289 00000100:00100000:0.0:1784093987.771326:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013775232:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784093987.771338:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093987.771345:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 7 pid: 6574 timeout: 1248 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.771357:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 7 pid: 6574 timeout: 1248 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.771376:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cb0bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a32 expref: 7 pid: 6574 timeout: 1248 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.771390:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093987.771395:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784093987.771400:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.771409:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093987.771465:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784093987.771488:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.771496:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.771506:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.771515:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.771519:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013775232:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 186us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093987.771528:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 289 00010000:00010000:3.0:1784093987.771534:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784093987.772041:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024287744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2994us (3099us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1784093987.772050:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:3.0:1784093987.772073:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1784093987.772074:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9072379ddf80/2, rc 0, transno 4294967347 00010000:00010000:3.0:1784093987.772081:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093987.772083:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024287744:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784093987.772094:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093987.772099:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.772114:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.772127:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.772135:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb0f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093987.772152:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093987.772154:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093987.772156:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093987.788588:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093987.788620:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013775360 00000100:00100000:2.0:1784093987.788630:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013775360 00000100:00100000:2.0:1784093987.788678:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 790 00000100:00100000:2.0:1784093987.788688:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:48935:x1870757013775360:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784093987.788723:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093987.788743:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a40 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.788802:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.788816:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.788828:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.788841:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.788848:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.788855:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789265:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb113 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789274:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789282:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093987.789363:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1784093987.789367:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093987.789497:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789510:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789517:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789523:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789529:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093987.789533:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789541:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789553:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784093987.789556:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093987.789561:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789567:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789577:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789588:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789594:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789599:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093987.789602:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789607:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789615:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781e00) 00010000:00010000:2.0:1784093987.789617:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093987.789619:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789625:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb10c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789655:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a40 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789667:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a40 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093987.789675:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093987.789677:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093987.789680:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784093987.789749:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48935:x1870757013775360:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1062us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093987.789756:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 790 00000100:00100000:1.0:1784093988.114632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093988.114680:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013775488 00000100:00100000:2.0:1784093988.114705:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013775488 00000100:00080000:3.0:1784093988.114754:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784093988.114784:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 791 00000100:00100000:2.0:1784093988.114797:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48949:x1870757013775488:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784093988.114818:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093988.114839:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb11a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a47 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.114914:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.114930:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.114945:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093988.115160:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1784093988.115165:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093988.115274:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.115303:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb11a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a47 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.115328:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a47 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.115338:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784093988.115341:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784093988.115345:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784093988.115410:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:48949:x1870757013775488:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 615us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.115419:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 791 00000100:00100000:1.0:1784093988.116963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.117011:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013775744 00000100:00100000:0.0:1784093988.117018:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013775744 00000100:00100000:0.0:1784093988.117062:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 792 00000100:00100000:0.0:1784093988.117072:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48949:x1870757013775744:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784093988.117107:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784093988.117124:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a47 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.117138:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb113 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a40 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.117145:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781000) 00010000:00010000:0.0:1784093988.117151:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093988.117166:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.117173:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.117179:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093988.117593:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000002b7b1695 reply state 000000003d197001 transno 4294967602 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093988.117601:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784093988.117666:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000100:00100000:0.0:1784093988.117740:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48949:x1870757013775744:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 669us (776us total) trans 4294967602 rc 0/0 00000100:00100000:0.0:1784093988.117748:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 792 00010000:00010000:1.0:1784093988.118449:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093988.118460:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093988.118468:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093988.118475:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784093988.118480:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093988.118488:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093988.118496:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907202e6b000) 00010000:00010000:1.0:1784093988.118498:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784093988.118500:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093988.118504:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb128 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093988.167769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093988.167826:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013775872 00000100:00100000:2.0:1784093988.167837:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013775872 00000100:00100000:2.0:1784093988.167896:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 793 00000100:00100000:2.0:1784093988.167906:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013775872:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093988.167998:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013775872:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.168004:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 793 00000100:00100000:2.0:1784093988.168670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.168741:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776000 00000100:00100000:0.0:1784093988.168747:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776000 00000100:00080000:3.0:1784093988.168788:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093988.168795:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 397 00000100:00100000:0.0:1784093988.168806:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:48961:x1870757013776000:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093988.169149:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:48961:x1870757013776000:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 344us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093988.169157:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 397 00000100:00100000:1.0:1784093988.169741:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093988.169785:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776128 00000100:00100000:2.0:1784093988.169790:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776128 00000100:00100000:2.0:1784093988.169824:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 398 00000100:00080000:3.0:1784093988.169825:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093988.169830:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48961:x1870757013776128:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784093988.170051:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48961:x1870757013776128:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 221us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.170056:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 398 00000100:00100000:1.0:1784093988.170633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093988.170674:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776256 00000100:00100000:2.0:1784093988.170679:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776256 00000100:00100000:2.0:1784093988.170721:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 794 00000100:00100000:2.0:1784093988.170728:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013776256:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093988.170988:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013776256:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 259us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.170996:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 794 00000100:00100000:3.0:1784093988.172317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.172375:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776384 00000100:00100000:0.0:1784093988.172381:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776384 00000100:00100000:0.0:1784093988.172417:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 795 00000100:00100000:0.0:1784093988.172457:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013776384:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093988.172524:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013776384:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093988.172536:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 795 00000100:00100000:1.0:1784093988.173085:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093988.173118:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776512 00000100:00100000:3.0:1784093988.173125:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776512 00000100:00100000:3.0:1784093988.173159:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 399 00000100:00100000:3.0:1784093988.173168:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:48961:x1870757013776512:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093988.173457:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:48961:x1870757013776512:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 289us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093988.173465:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 399 00000100:00100000:1.0:1784093988.174117:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.174163:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776640 00000100:00100000:0.0:1784093988.174169:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776640 00000100:00100000:0.0:1784093988.174202:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 400 00000100:00100000:0.0:1784093988.174211:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:48961:x1870757013776640:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093988.174514:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:48961:x1870757013776640:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 301us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093988.174524:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 400 00000100:00100000:2.0:1784093988.175180:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.175230:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776768 00000100:00100000:0.0:1784093988.175235:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776768 00000100:00100000:0.0:1784093988.175266:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 796 00000100:00100000:0.0:1784093988.175275:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013776768:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093988.175618:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:48961:x1870757013776768:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 344us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093988.175626:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 796 00000100:00100000:1.0:1784093988.196381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093988.196456:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013776896 00000100:00100000:2.0:1784093988.196466:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013776896 00000100:00100000:2.0:1784093988.196532:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 797 00000100:00100000:2.0:1784093988.196543:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:48965:x1870757013776896:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784093988.196564:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093988.196583:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb12f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a4e expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.196640:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.196654:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.196666:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.196681:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.196688:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.196710:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197126:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197136:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197143:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784093988.197215:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:2.0:1784093988.197219:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784093988.197289:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197302:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197308:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197316:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197322:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093988.197327:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197334:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197346:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784093988.197350:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093988.197355:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197361:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197374:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197380:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197386:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197392:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093988.197394:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197401:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197407:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff90721a781700) 00010000:00010000:2.0:1784093988.197410:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093988.197412:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197419:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb13d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197493:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb12f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a4e expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197516:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a4e expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.197523:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784093988.197526:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784093988.197528:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784093988.197592:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:48965:x1870757013776896:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1050us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.197600:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 797 00000100:00100000:1.0:1784093988.198917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.198978:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013777152 00000100:00100000:0.0:1784093988.198986:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013777152 00000100:00100000:0.0:1784093988.199028:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 798 00000100:00100000:0.0:1784093988.199038:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:48965:x1870757013777152:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784093988.199051:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784093988.199065:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb14b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a55 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.199299:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.199314:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.199323:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.199334:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.199342:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.199348:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784093988.200493:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:0.0:1784093988.200742:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200754:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200763:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200797:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200804:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200811:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200818:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093988.200823:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200830:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200840:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093988.200843:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093988.200847:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200854:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb152 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093988.200865:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b50a2061 reply state 000000004f59a5eb transno 4294967603 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093988.200874:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784093988.200898:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb14b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a55 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200907:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a55 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093988.200912:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784093988.200913:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784093988.200915:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784093988.200966:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:48965:x1870757013777152:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1930us (2053us total) trans 4294967603 rc 0/0 00000100:00100000:0.0:1784093988.200972:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 798 00010000:00010000:2.0:1784093988.201794:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.201805:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.201812:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.201818:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093988.201822:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.201829:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.201839:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907202e6b200) 00010000:00010000:2.0:1784093988.201842:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093988.201845:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.201852:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093988.203673:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093988.203720:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013777280 00000100:00100000:2.0:1784093988.203737:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013777280 00000100:00100000:2.0:1784093988.203785:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 401 00000100:00100000:2.0:1784093988.203794:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:48965:x1870757013777280:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784093988.203810:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784093988.203835:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a5c expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784093988.203859:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784093988.203876:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=1149s v=(0 0) 00010000:00010000:2.0:1784093988.203880:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784093988.203887:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.203899:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093988.203906:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784093988.203945:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:48965:x1870757013777280:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 152us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.203952:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 401 00000100:00100000:3.0:1784093988.212771:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093988.212839:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013777408 00000100:00100000:1.0:1784093988.212849:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013777408 00002000:00100000:1.0:1784093988.212910:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff907230a5f800 x1870757013777408/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:309/0 lens 488/0 e 0 to 0 dl 1784093999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784093988.212921:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230a5f800 with x1870757013777408 ext(0->1048575) 00002000:00010000:1.0:1784093988.212927:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230a5f800 00000100:00100000:1.0:1784093988.212964:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 19 00000100:00100000:1.0:1784093988.212974:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013777408:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:2.0:1784093988.219389:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013777408:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 6407us (6626us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1784093988.219406:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 19 00002000:00100000:2.0:1784093988.219418:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff907230a5f800 x1870757013777408/t4294967346(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:309/0 lens 488/448 e 0 to 0 dl 1784093999 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1784093988.219448:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230a5f800 with x1870757013777408 ext(0->1048575) 00002000:00010000:2.0:1784093988.219454:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230a5f800 00000100:00100000:1.0:1784093988.220659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.220712:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013777536 00000100:00100000:0.0:1784093988.220720:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013777536 00000100:00100000:0.0:1784093988.220769:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 799 00000100:00100000:0.0:1784093988.220780:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:48965:x1870757013777536:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:1.0:1784093988.231021:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967603 is committed 00000100:00100000:2.0:1784093988.231128:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:48965:x1870757013777536:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 10344us (10462us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093988.231140:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 799 00000100:00100000:2.0:1784093988.232400:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093988.232451:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013777664 00000100:00100000:0.0:1784093988.232460:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013777664 00000100:00100000:0.0:1784093988.232510:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 402 00000100:00100000:0.0:1784093988.232519:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013777664:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:1.0:1784093988.242478:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000100:00100000:3.0:1784093988.242535:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013777664:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 10013us (10134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093988.242548:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 402 00000100:00100000:1.0:1784093988.243936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093988.243990:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013777920 00000100:00100000:3.0:1784093988.244000:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013777920 00000100:00100000:3.0:1784093988.244040:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 83 00000100:00100000:3.0:1784093988.244047:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:48965:x1870757013777920:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:3.0:1784093988.244395:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:48965:x1870757013777920:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 348us (461us total) trans 4294967604 rc 0/0 00000100:00100000:3.0:1784093988.244400:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 83 00010000:00010000:3.0:1784093988.329720:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784093988.339129:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000001:00080000:1.0:1784093988.339142:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000001:00080000:1.0:1784093988.686622:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967604 is committed 00000100:00100000:2.0:1784093988.841725:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024288000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784093988.841845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093988.841905:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288000 00000100:00100000:3.0:1784093988.841918:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288000 00000100:00080000:0.0:1784093988.841984:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784093988.842017:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1784093988.842030:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024288000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784093988.842066:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093988.842161:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024288000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093988.842170:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1784093988.842204:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1784093988.842211:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9072379ddf80, transno 4294967347 00000100:00100000:2.0:1784093988.842235:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024288000:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1784093989.101045:0:82651:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1150178620186ns, next at 1149508635308ns, rc = 0 00000004:00080000:3.0:1784093989.101122:0:82651:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1150178700053ns, next at 1129721801297ns, rc = 0 00000004:00080000:1.0:1784093989.110916:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 66 committed 00000004:00080000:1.0:1784093989.111666:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 64 committed 00010000:00010000:2.0:1784093989.354528:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093989.605948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093989.606000:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778048 00000100:00100000:2.0:1784093989.606011:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778048 00000100:00100000:2.0:1784093989.606072:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 800 00000100:00100000:2.0:1784093989.606084:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778048:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784093989.606175:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778048:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093989.606182:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 800 00000100:00100000:2.0:1784093989.607073:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093989.607123:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778176 00000100:00100000:3.0:1784093989.607130:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778176 00000100:00100000:3.0:1784093989.607177:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 403 00000100:00100000:3.0:1784093989.607190:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:49157:x1870757013778176:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093989.607624:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:49157:x1870757013778176:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 437us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093989.607643:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 403 00000100:00100000:2.0:1784093989.608341:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093989.608402:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778304 00000100:00100000:0.0:1784093989.608415:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778304 00000100:00100000:0.0:1784093989.608506:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 404 00000100:00100000:0.0:1784093989.608522:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:49157:x1870757013778304:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784093989.608965:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:49157:x1870757013778304:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 448us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093989.608974:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 404 00000100:00100000:1.0:1784093989.610017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093989.610072:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778432 00000100:00100000:0.0:1784093989.610081:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778432 00000100:00100000:0.0:1784093989.610132:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 801 00000100:00100000:0.0:1784093989.610142:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778432:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093989.610572:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778432:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 431us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093989.610582:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 801 00000100:00100000:2.0:1784093989.612713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093989.612802:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778560 00000100:00100000:0.0:1784093989.612816:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778560 00000100:00100000:0.0:1784093989.612863:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 802 00000100:00100000:0.0:1784093989.612873:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778560:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093989.612974:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778560:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093989.612982:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 802 00000100:00100000:2.0:1784093989.613700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093989.613752:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778688 00000100:00100000:3.0:1784093989.613762:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778688 00000100:00100000:3.0:1784093989.613817:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 405 00000100:00100000:3.0:1784093989.613824:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:49157:x1870757013778688:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093989.614204:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:49157:x1870757013778688:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 372us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093989.614212:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 405 00000100:00100000:2.0:1784093989.614935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093989.614960:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778816 00000100:00100000:3.0:1784093989.614965:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778816 00000100:00100000:3.0:1784093989.614995:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 406 00000100:00100000:3.0:1784093989.615000:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:49157:x1870757013778816:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784093989.615295:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:49157:x1870757013778816:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 291us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093989.615303:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 406 00000100:00100000:2.0:1784093989.616161:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093989.616204:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013778944 00000100:00100000:0.0:1784093989.616211:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013778944 00000100:00100000:0.0:1784093989.616252:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 803 00000100:00100000:0.0:1784093989.616261:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778944:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784093989.616699:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:49157:x1870757013778944:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 438us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093989.616708:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 803 00000100:00100000:2.0:1784093989.642268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093989.642338:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779200 00000100:00100000:0.0:1784093989.642348:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779200 00000100:00100000:0.0:1784093989.642396:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00100000:0.0:1784093989.642405:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:49161:x1870757013779200:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784093989.642468:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784093989.642494:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a55 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642508:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784093989.642516:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784093989.642534:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642553:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642565:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642576:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642582:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642587:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642941:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642949:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.642954:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784093989.643910:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off9792 00000004:00080000:0.0:1784093989.643921:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1150721498268ns, next at 1151721495852ns, rc = 0 00010000:00010000:0.0:1784093989.644012:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644022:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644031:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644043:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644049:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644055:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644074:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784093989.644090:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644094:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644101:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784093989.644101:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644111:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644112:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093989.644118:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644123:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784093989.644129:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644130:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644150:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644150:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784093989.644157:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784093989.644162:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644165:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784093989.644170:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784093989.644174:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644181:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb183 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644182:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb18a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644200:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644201:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784093989.644204:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093989.644209:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784093989.644211:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093989.644213:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644217:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784093989.644219:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644223:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644228:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784093989.644229:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784093989.644231:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093989.644234:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb175 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784093989.644240:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000733e0eab reply state 0000000089ca37b2 transno 4294967605 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093989.644245:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784093989.644309:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:49161:x1870757013779200:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1904us (2049us total) trans 4294967605 rc 0/0 00000100:00100000:0.0:1784093989.644314:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 804 00010000:00010000:2.0:1784093989.645132:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093989.645142:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093989.645149:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093989.645155:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784093989.645159:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093989.645165:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093989.645175:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff907202e6bd00) 00010000:00010000:2.0:1784093989.645178:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784093989.645182:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093989.645187:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb17c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.377563:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784093990.387625:0:82795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1151465200452ns, next at 1149508635308ns, rc = 0 00000004:00080000:1.0:1784093990.387746:0:82795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1151465323667ns, next at 1151721495852ns, rc = 0 00000001:00080000:1.0:1784093990.396679:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967605 is committed 00000004:00080000:1.0:1784093990.396693:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 65 committed 00000004:00080000:1.0:1784093990.396718:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 67 committed 00000100:00100000:3.0:1784093990.396909:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784093990.396930:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024288128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784093990.396996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093990.397047:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288128 00000100:00100000:0.0:1784093990.397056:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288128 00000100:00080000:1.0:1784093990.397108:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784093990.397133:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1784093990.397144:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024288128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784093990.397171:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00010000:00010000:0.0:1784093990.397196:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.397220:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 5 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.397229:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784093990.397234:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784093990.397239:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.397267:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 5 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.397282:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 5 pid: 6574 timeout: 1251 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784093990.397296:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024288256:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784093990.397364:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093af540 going to sleep for 11 seconds 00000004:00080000:2.0:1784093990.397969:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 66 committed 00000100:00100000:0.0:1784093990.398438:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024288256:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784093990.398468:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784093990.398830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093990.398883:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779328 00000100:00100000:2.0:1784093990.398889:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779328 00010000:00010000:2.0:1784093990.398923:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 6 pid: 6574 timeout: 1251 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784093990.398932:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784093990.398948:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 290 00000100:00100000:2.0:1784093990.398954:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013779328:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784093990.398962:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784093990.398966:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 6 pid: 6574 timeout: 1251 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093990.398976:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 6 pid: 6574 timeout: 1251 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093990.398991:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb16e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a5c expref: 6 pid: 6574 timeout: 1251 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093990.399001:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093990.399003:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784093990.399007:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093990.399014:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784093990.399031:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784093990.399059:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013779328:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093990.399068:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 290 00010000:00010000:0.0:1784093990.399070:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.399082:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.399092:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.399100:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784093990.399119:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784093990.399138:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784093990.399146:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093990.399155:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784093990.399159:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093990.399216:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093990.399234:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093990.399242:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e83757b/0x9ce98053214cb191 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784093990.399262:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093990.399264:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093990.399266:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784093990.399718:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024288128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2577us (2722us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1784093990.399726:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000004:00080000:3.0:1784093990.399745:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9072379de680/2, rc 0, transno 4294967347 00000100:00100000:3.0:1784093990.399752:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024288128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784093991.288481:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093991.288531:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093991.288539:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779584 00000100:00100000:0.0:1784093991.288550:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779584 00000100:00100000:2.0:1784093991.288563:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093991.288588:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779456 00000100:00100000:3.0:1784093991.288593:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779456 00000100:00100000:2.0:1784093991.288602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093991.288624:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:3.0:1784093991.288632:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:1.0:1784093991.288646:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779712 00000100:00100000:2.0:1784093991.288648:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779840 00000100:00100000:0.0:1784093991.288650:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013779584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093991.288652:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779712 00000100:00100000:2.0:1784093991.288656:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779840 00000100:00100000:3.0:1784093991.288659:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013779456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784093991.288700:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 566 00000100:00100000:2.0:1784093991.288712:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013779840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784093991.288718:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 567 00000100:00100000:3.0:1784093991.288724:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013779456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093991.288724:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013779584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093991.288735:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013779712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093991.288742:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:3.0:1784093991.288745:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:2.0:1784093991.288753:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013779840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093991.288762:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 566 00000100:00100000:1.0:1784093991.288781:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013779712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093991.288789:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 567 00000100:00080000:0.0:1784093991.288798:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093991.288805:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784093991.401583:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093991.913560:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784093991.913579:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024288384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784093991.913633:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024288512:0@lo:400:kworker.0 00000100:00100000:1.0:1784093991.913652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093991.913705:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024288896:0@lo:400:kworker.0 00000100:00100000:3.0:1784093991.913731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093991.913749:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024288768:0@lo:400:kworker.0 00000100:00100000:0.0:1784093991.913756:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093991.913771:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024289024:0@lo:400:kworker.0 00000100:00100000:1.0:1784093991.913793:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093991.913806:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288384 00000100:00100000:0.0:1784093991.913814:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288384 00000100:00100000:3.0:1784093991.913818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093991.913842:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784093991.913849:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024288640:0@lo:400:kworker.0 00000100:00100000:0.0:1784093991.913865:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1784093991.913879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093991.913879:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024288384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093991.913902:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288768 00000100:00100000:1.0:1784093991.913906:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288768 00002000:00000024:0.0:1784093991.913917:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784093991.913943:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289024 00000100:00100000:1.0:1784093991.913946:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289024 00000100:00100000:1.0:1784093991.913967:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288640 00000100:00100000:1.0:1784093991.913969:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288640 00000100:00100000:0.0:1784093991.913971:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024288384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093991.913983:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1784093991.913984:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1784093991.913994:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024288768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784093991.913998:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288512 00000100:00100000:3.0:1784093991.914004:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288512 00000100:00100000:0.0:1784093991.914011:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024288896 00000100:00100000:0.0:1784093991.914015:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024288896 00000100:00100000:1.0:1784093991.914029:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024288768:12345-0@lo:400:kworker.0 Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093991.914035:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1784093991.914046:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1784093991.914050:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1784093991.914053:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1784093991.914058:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024288512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093991.914060:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024288896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093991.914064:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024289024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093991.914155:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1784093991.914168:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024288640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093991.914208:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024289024:12345-0@lo:400:kworker.0 Request processed in 147us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093991.914215:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1784093991.914222:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024288512:12345-0@lo:400:kworker.0 Request processed in 166us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093991.914231:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1784093991.914241:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024288640:12345-0@lo:400:kworker.0 Request processed in 73us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093991.914247:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1784093991.914266:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024289152:0@lo:400:kworker.0 00000100:00100000:3.0:1784093991.914298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093991.914311:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024288640:0@lo:400:kworker.0 00000100:00100000:2.0:1784093991.914327:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024289024:0@lo:400:kworker.0 00000100:00100000:2.0:1784093991.914340:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024288512:0@lo:400:kworker.0 00000100:00100000:1.0:1784093991.914341:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289152 00000100:00100000:1.0:1784093991.914347:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289152 00000100:00080000:3.0:1784093991.914358:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784093991.914365:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784093991.914381:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1784093991.914390:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024289152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093991.914410:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024288896:0@lo:400:kworker.0 00000100:00100000:3.0:1784093991.914442:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024288768:0@lo:400:kworker.0 00000100:00100000:1.0:1784093991.914458:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024289152:12345-0@lo:400:kworker.0 Request processed in 68us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093991.914465:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1784093991.914470:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024288384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784093991.914484:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024289152:0@lo:400:kworker.0 00000100:00100000:0.0:1784093991.914544:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024288896:12345-0@lo:400:kworker.0 Request processed in 487us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093991.914550:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00010000:00010000:1.0:1784093992.425655:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784093993.449544:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093993.961652:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024289280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784093993.961707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093993.961764:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289280 00000100:00100000:0.0:1784093993.961773:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289280 00000100:00080000:3.0:1784093993.961813:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093993.961836:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1784093993.961848:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024289280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093993.961895:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093993.961947:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024289280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093993.961954:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1784093993.962001:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024289280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784093994.473625:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784093994.994090:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00010000:00010000:2.0:1784093995.497548:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784093996.408357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784093996.408400:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784093996.408461:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013779968 00000100:00100000:3.0:1784093996.408464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784093996.408467:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780096 00000100:00100000:2.0:1784093996.408472:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013779968 00000100:00100000:1.0:1784093996.408474:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780096 00000100:00100000:3.0:1784093996.408504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784093996.408515:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780224 00000100:00100000:0.0:1784093996.408521:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780224 00000100:00100000:3.0:1784093996.408532:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780352 00000100:00100000:2.0:1784093996.408549:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 763 00000100:00100000:3.0:1784093996.408550:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780352 00000100:00100000:1.0:1784093996.408558:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 777 00000100:00100000:2.0:1784093996.408567:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013779968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093996.408575:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 570 00000100:00100000:1.0:1784093996.408576:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013780096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093996.408586:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013780224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784093996.408603:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 571 00000100:00100000:3.0:1784093996.408614:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013780352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784093996.408649:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013780224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093996.408651:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013779968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 83us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784093996.408651:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013780096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093996.408658:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013780352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093996.408660:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 570 00000100:00100000:2.0:1784093996.408676:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 763 00000100:00100000:3.0:1784093996.408677:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 571 00000100:00100000:1.0:1784093996.408677:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 777 00000100:00080000:0.0:1784093996.408697:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784093996.408702:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784093996.408705:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784093996.521599:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784093997.033590:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784093997.033609:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024289792:0@lo:400:kworker.0 00000100:00100000:1.0:1784093997.033620:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024289536:0@lo:400:kworker.0 00000100:00100000:0.0:1784093997.033638:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024289664:0@lo:400:kworker.0 00000100:00100000:1.0:1784093997.033685:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093997.033687:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024289920:0@lo:400:kworker.0 00000100:00100000:2.0:1784093997.033689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093997.033717:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289536 00000100:00100000:3.0:1784093997.033724:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289536 00000100:00100000:0.0:1784093997.033737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784093997.033746:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024289408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784093997.033753:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024290048:0@lo:400:kworker.0 00000100:00100000:3.0:1784093997.033779:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1784093997.033781:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289920 00000100:00100000:0.0:1784093997.033786:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289920 00000100:00100000:3.0:1784093997.033792:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024289536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093997.033804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093997.033805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093997.033837:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784093997.033838:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1784093997.033846:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024290176:0@lo:400:kworker.0 00000100:00100000:0.0:1784093997.033852:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784093997.033859:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289792 00000100:00100000:3.0:1784093997.033865:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024289536:12345-0@lo:400:kworker.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784093997.033866:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289792 00000100:00100000:1.0:1784093997.033875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784093997.033880:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1784093997.033908:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290048 00000100:00100000:2.0:1784093997.033912:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290048 00000100:00100000:1.0:1784093997.033913:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024289536:0@lo:400:kworker.0 00000100:00100000:0.0:1784093997.033917:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024289920:12345-0@lo:400:kworker.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093997.033924:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1784093997.033930:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1784093997.033941:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024289792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093997.033942:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290176 00000100:00100000:0.0:1784093997.033949:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290176 00000100:00100000:2.0:1784093997.033950:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1784093997.033961:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093997.033973:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289408 00000100:00100000:1.0:1784093997.033979:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289408 00000100:00100000:3.0:1784093997.033990:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024289792:12345-0@lo:400:kworker.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784093997.033999:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1784093997.034004:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1784093997.034013:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024290048:12345-0@lo:400:kworker.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093997.034018:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784093997.034024:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1784093997.034027:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1784093997.034036:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024289408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093997.034063:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024290176:12345-0@lo:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00002000:00000024:1.0:1784093997.034065:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784093997.034066:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024289792:0@lo:400:kworker.0 00000100:00100000:2.0:1784093997.034073:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1784093997.034078:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9072379de680, transno 4294967347 00000100:00100000:0.0:1784093997.034078:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1784093997.034094:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024290176:0@lo:400:kworker.0 00000100:00100000:2.0:1784093997.034110:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024290048:0@lo:400:kworker.0 00000100:00100000:1.0:1784093997.034127:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024289408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093997.034127:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024289920:0@lo:400:kworker.0 00000100:00100000:1.0:1784093997.034140:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:2.0:1784093997.034147:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784093997.034152:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784093997.034155:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784093997.034169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784093997.034183:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024289408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784093997.034194:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024289664 00000100:00100000:0.0:1784093997.034198:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024289664 00000100:00100000:0.0:1784093997.034229:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1784093997.034235:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784093997.034271:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024289664:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093997.034275:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1784093997.034307:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024289664:0@lo:400:kworker.0 00010000:00010000:0.0:1784093997.545499:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784093998.569563:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784093999.081635:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024290304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784093999.081701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784093999.081752:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290304 00000100:00100000:0.0:1784093999.081760:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290304 00000100:00080000:2.0:1784093999.081793:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784093999.081814:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1784093999.081830:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024290304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784093999.081864:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784093999.081913:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024290304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784093999.081922:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1784093999.081959:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024290304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784093999.593598:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094000.617764:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094001.528596:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094001.528662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094001.528686:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780480 00000100:00100000:0.0:1784094001.528697:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780480 00000100:00100000:1.0:1784094001.528735:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780736 00000100:00100000:1.0:1784094001.528741:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780736 00000100:00100000:0.0:1784094001.528752:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:0.0:1784094001.528765:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013780480:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094001.528802:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094001.528804:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 574 00000100:00100000:1.0:1784094001.528827:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013780736:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094001.528844:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013780480:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094001.528860:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:1.0:1784094001.528868:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013780736:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094001.528877:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 574 00000100:00100000:2.0:1784094001.528949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094001.529002:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780608 00000100:00100000:2.0:1784094001.529008:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094001.529008:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780608 00000100:00080000:2.0:1784094001.529058:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094001.529067:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780864 00000100:00100000:1.0:1784094001.529073:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780864 00000100:00100000:0.0:1784094001.529080:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 781 00000100:00100000:0.0:1784094001.529093:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013780608:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094001.529106:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094001.529124:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 575 00000100:00100000:0.0:1784094001.529138:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013780608:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094001.529140:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013780864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094001.529155:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 781 00000100:00100000:1.0:1784094001.529208:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013780864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094001.529214:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 575 00010000:00010000:0.0:1784094001.641591:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094002.153573:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094002.153591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024290688:0@lo:400:kworker.0 00000100:00100000:1.0:1784094002.153598:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024290816:0@lo:400:kworker.0 00000100:00100000:0.0:1784094002.153606:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024290560:0@lo:400:kworker.0 00000100:00100000:2.0:1784094002.153669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094002.153672:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024291072:0@lo:400:kworker.0 00000100:00100000:0.0:1784094002.153673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094002.153716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094002.153720:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290688 00000100:00100000:0.0:1784094002.153722:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024290944:0@lo:400:kworker.0 00000100:00100000:2.0:1784094002.153725:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024290432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094002.153729:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290688 00000100:00100000:1.0:1784094002.153746:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094002.153754:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024291200:0@lo:400:kworker.0 00000100:00100000:0.0:1784094002.153764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094002.153768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094002.153791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094002.153795:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291072 00000100:00100000:3.0:1784094002.153801:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291072 00000100:00100000:0.0:1784094002.153820:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290944 00000100:00100000:0.0:1784094002.153824:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290944 00000100:00100000:2.0:1784094002.153825:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290560 00000100:00100000:2.0:1784094002.153830:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290560 00000100:00100000:1.0:1784094002.153839:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1784094002.153849:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1784094002.153854:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024290688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094002.153862:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094002.153869:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1784094002.153870:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291200 00000100:00100000:0.0:1784094002.153874:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291200 00000100:00100000:2.0:1784094002.153879:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024290560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094002.153905:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1784094002.153916:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024290944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094002.153926:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024291072:12345-0@lo:400:kworker.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094002.153932:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024290688:12345-0@lo:400:kworker.0 Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094002.153940:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1784094002.153942:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024290560:12345-0@lo:400:kworker.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094002.153952:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1784094002.153958:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1784094002.153964:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024290944:12345-0@lo:400:kworker.0 Request processed in 49us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094002.153973:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00080000:3.0:1784094002.153983:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094002.153983:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290432 00000100:00080000:3.0:1784094002.153989:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094002.153989:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290432 00000100:00080000:3.0:1784094002.153995:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094002.153997:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1784094002.154008:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024291200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094002.154027:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1784094002.154033:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024291072:0@lo:400:kworker.0 00000100:00100000:2.0:1784094002.154038:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024290560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094002.154041:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024290432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094002.154045:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024291200:12345-0@lo:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094002.154056:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1784094002.154063:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024290944:0@lo:400:kworker.0 00000100:00100000:3.0:1784094002.154067:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024291200:0@lo:400:kworker.0 00002000:00000024:1.0:1784094002.154075:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094002.154108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094002.154118:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024290432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094002.154126:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1784094002.154145:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024290688:0@lo:400:kworker.0 00000100:00100000:2.0:1784094002.154151:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024290816 00000100:00100000:2.0:1784094002.154158:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024290816 00000100:00100000:3.0:1784094002.154168:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024290432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094002.154202:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00080000:0.0:1784094002.154207:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094002.154208:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094002.154250:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024290816:12345-0@lo:400:kworker.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094002.154257:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1784094002.154271:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024290816:0@lo:400:kworker.0 00010000:00010000:1.0:1784094002.665574:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094003.689600:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094004.201618:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024291328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094004.201688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094004.201733:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291328 00000100:00100000:0.0:1784094004.201741:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291328 00000100:00080000:3.0:1784094004.201786:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094004.201805:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1784094004.201816:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024291328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094004.201850:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094004.201899:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024291328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094004.201906:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784094004.201953:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024291328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094004.713654:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094005.737627:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094006.648754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094006.648795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094006.648831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094006.648862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094006.648876:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013780992 00000100:00100000:0.0:1784094006.648893:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013780992 00000100:00100000:2.0:1784094006.648896:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781248 00000100:00100000:2.0:1784094006.648906:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781248 00000100:00100000:2.0:1784094006.648977:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781376 00000100:00100000:2.0:1784094006.648980:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781376 00000100:00100000:0.0:1784094006.648986:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 767 00000100:00100000:0.0:1784094006.649002:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013780992:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094006.649011:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 578 00000100:00100000:2.0:1784094006.649025:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013781248:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094006.649111:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013780992:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 111us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094006.649120:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 767 00000100:00100000:1.0:1784094006.649189:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:3.0:1784094006.649190:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781120 00000100:00100000:3.0:1784094006.649211:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781120 00000100:00100000:1.0:1784094006.649211:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013781376:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094006.649233:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094006.649243:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094006.649248:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094006.649270:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 785 00000100:00100000:3.0:1784094006.649288:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013781120:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094006.649411:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013781248:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 384us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094006.649417:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013781376:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 210us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094006.649484:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 578 00000100:00100000:1.0:1784094006.649494:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:3.0:1784094006.649693:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013781120:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 408us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094006.649703:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 785 00010000:00010000:1.0:1784094006.761651:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094007.273624:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094007.273637:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024291712:0@lo:400:kworker.0 00000100:00100000:1.0:1784094007.273641:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024291456:0@lo:400:kworker.0 00000100:00100000:3.0:1784094007.273668:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024291840:0@lo:400:kworker.0 00000100:00100000:0.0:1784094007.273690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094007.273703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094007.273751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094007.273762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094007.273772:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024292096:0@lo:400:kworker.0 00000100:00100000:2.0:1784094007.273775:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024292224:0@lo:400:kworker.0 00000100:00100000:3.0:1784094007.273792:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094007.273802:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024291968:0@lo:400:kworker.0 00000100:00100000:0.0:1784094007.273842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094007.273850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094007.273871:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291712 00000100:00100000:3.0:1784094007.273880:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291712 00000100:00100000:2.0:1784094007.273925:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291840 00000100:00100000:0.0:1784094007.273925:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291584 00000100:00100000:1.0:1784094007.273926:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291456 00000100:00100000:0.0:1784094007.273931:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291584 00000100:00100000:2.0:1784094007.273934:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291840 00000100:00100000:1.0:1784094007.273936:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291456 00000100:00100000:3.0:1784094007.273938:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292096 00000100:00100000:3.0:1784094007.273945:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292096 00000100:00100000:2.0:1784094007.274013:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1784094007.274023:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1784094007.274029:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1784094007.274031:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094007.274033:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1784094007.274042:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094007.274048:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024291584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094007.274056:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024291456:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784094007.274084:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094007.274104:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024291712:12345-0@lo:400:kworker.0 Request processed in 81us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.274111:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024291840:12345-0@lo:400:kworker.0 Request processed in 75us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094007.274115:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1784094007.274125:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1784094007.274159:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024291456:12345-0@lo:400:kworker.0 Request processed in 102us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094007.274160:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1784094007.274160:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024291584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094007.274184:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094007.274195:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:0.0:1784094007.274197:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1784094007.274220:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292224 00000100:00100000:3.0:1784094007.274226:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292224 00000100:00080000:0.0:1784094007.274239:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094007.274242:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024292096:12345-0@lo:400:kworker.0 Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00080000:0.0:1784094007.274245:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094007.274256:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1784094007.274286:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1784094007.274293:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024292096:0@lo:400:kworker.0 00000100:00100000:1.0:1784094007.274303:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024291456:0@lo:400:kworker.0 00000100:00100000:3.0:1784094007.274304:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024292224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094007.274319:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024291712:0@lo:400:kworker.0 00000100:00100000:0.0:1784094007.274328:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710125ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094007.274371:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024292224:12345-0@lo:400:kworker.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.274377:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1784094007.274383:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024292224:0@lo:400:kworker.0 00000100:00100000:1.0:1784094007.274412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094007.274474:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024291968 00000100:00100000:0.0:1784094007.274479:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024291968 00000100:00100000:1.0:1784094007.274495:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024291840:0@lo:400:kworker.0 00000100:00080000:2.0:1784094007.274530:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094007.274542:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1784094007.274551:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024291968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094007.274599:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024291968:12345-0@lo:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094007.274606:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1784094007.274649:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024291968:0@lo:400:kworker.0 00000100:00100000:2.0:1784094007.604006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094007.604070:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781504 00000100:00100000:3.0:1784094007.604080:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781504 00000100:00100000:3.0:1784094007.604147:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 805 00000100:00100000:3.0:1784094007.604158:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013781504:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094007.604257:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013781504:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 101us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.604265:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 805 00000100:00100000:2.0:1784094007.605052:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094007.605151:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781632 00000100:00100000:1.0:1784094007.605165:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781632 00000100:00100000:1.0:1784094007.605239:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 408 00000100:00100000:1.0:1784094007.605251:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013781632:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094007.605748:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013781632:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 498us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094007.605756:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 408 00000100:00100000:0.0:1784094007.606896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094007.606948:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781760 00000100:00100000:3.0:1784094007.606955:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781760 00000100:00100000:3.0:1784094007.606994:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 409 00000100:00100000:3.0:1784094007.607002:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013781760:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094007.607321:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013781760:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 319us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.607343:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 409 00000100:00100000:2.0:1784094007.607971:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094007.608014:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013781888 00000100:00100000:3.0:1784094007.608019:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013781888 00000100:00100000:3.0:1784094007.608054:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 806 00000100:00100000:3.0:1784094007.608061:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013781888:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094007.608345:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013781888:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 283us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.608353:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 806 00000100:00100000:2.0:1784094007.609486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094007.609533:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782016 00000100:00100000:3.0:1784094007.609539:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782016 00000100:00100000:3.0:1784094007.609572:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 807 00000100:00100000:3.0:1784094007.609581:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013782016:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094007.609633:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013782016:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.609640:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 807 00000100:00100000:0.0:1784094007.610309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094007.610360:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782144 00000100:00100000:2.0:1784094007.610365:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782144 00000100:00100000:2.0:1784094007.610396:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 410 00000100:00100000:2.0:1784094007.610404:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013782144:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094007.610649:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013782144:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 246us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094007.610654:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 410 00000100:00100000:2.0:1784094007.611460:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094007.611507:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782272 00000100:00100000:1.0:1784094007.611516:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782272 00000100:00100000:1.0:1784094007.611567:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 411 00000100:00100000:1.0:1784094007.611575:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013782272:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094007.611885:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710125d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:49499:x1870757013782272:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 309us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094007.611892:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 411 00000100:00100000:3.0:1784094007.612548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094007.612591:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782400 00000100:00100000:0.0:1784094007.612598:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782400 00000100:00100000:0.0:1784094007.612637:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 808 00000100:00100000:0.0:1784094007.612648:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013782400:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094007.612958:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:49499:x1870757013782400:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 312us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094007.612971:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 808 00000100:00100000:0.0:1784094007.623884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094007.623965:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782528 00000100:00100000:3.0:1784094007.623976:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782528 00000100:00100000:3.0:1784094007.624033:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 809 00000100:00100000:3.0:1784094007.624042:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:49500:x1870757013782528:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094007.624062:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094007.624082:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a63 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.624142:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb19f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.624156:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.624168:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094007.624380:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00000004:00200000:3.0:1784094007.624385:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094007.624496:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.624522:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a63 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.624537:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb19f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a63 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.624546:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781200) 00010000:00010000:3.0:1784094007.624549:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094007.624552:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094007.624610:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:49500:x1870757013782528:12345-192.168.204.57@tcp:101:rm.0 Request processed in 568us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094007.624617:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 809 00000100:00100000:2.0:1784094007.626189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094007.626241:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782784 00000100:00100000:3.0:1784094007.626252:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782784 00000100:00100000:3.0:1784094007.626300:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 810 00000100:00100000:3.0:1784094007.626308:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:49500:x1870757013782784:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094007.626342:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094007.626361:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb1a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a6a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094007.626618:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00010000:3.0:1784094007.626887:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb1a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a6a expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.626900:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:3.0:1784094007.626902:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784094007.626905:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb1a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a6a expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094007.626924:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094007.626988:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:49500:x1870757013782784:12345-192.168.204.57@tcp:101:rm.0 Request processed in 678us (808us total) trans 4294967606 rc 301/301 00000100:00100000:3.0:1784094007.626995:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 810 00000100:00100000:2.0:1784094007.629253:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094007.629338:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013782912 00000100:00100000:1.0:1784094007.629348:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013782912 00000100:00100000:1.0:1784094007.629404:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 84 00000100:00100000:1.0:1784094007.629415:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:49500:x1870757013782912:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784094007.631828:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:49500:x1870757013782912:12345-192.168.204.57@tcp:37:rm.0 Request processed in 2404us (2571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094007.631841:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 84 00000100:00100000:2.0:1784094007.634080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094007.634147:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013783168 00000100:00100000:0.0:1784094007.634170:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013783168 00000100:00100000:0.0:1784094007.634232:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 85 00000100:00100000:0.0:1784094007.634243:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:49500:x1870757013783168:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:0.0:1784094007.634792:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:49500:x1870757013783168:12345-192.168.204.57@tcp:35:rm.0 Request processed in 545us (715us total) trans 4294967607 rc 0/0 00000100:00100000:0.0:1784094007.634813:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 85 00000100:00100000:2.0:1784094007.636463:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094007.636522:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013783424 00000100:00100000:0.0:1784094007.636532:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013783424 00000100:00100000:0.0:1784094007.636584:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 811 00000100:00100000:0.0:1784094007.636595:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:49500:x1870757013783424:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094007.636664:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784094007.636698:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb19f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a63 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636721:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a4e expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636735:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff90721a781200) 00010000:00010000:0.0:1784094007.636753:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cae50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5998 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636767:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12d00) 00010000:00010000:0.0:1784094007.636775:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094007.636814:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636828:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636840:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636853:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636861:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.636867:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.637246:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.637255:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.637263:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094007.638527:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 7680 00010000:00010000:0.0:1784094007.638552:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638563:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638570:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638576:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094007.638581:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638589:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638602:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784094007.638605:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094007.638610:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638616:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb1c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638638:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638644:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638650:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638655:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094007.638658:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638664:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638672:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094007.638674:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094007.638677:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094007.638683:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb1b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094007.638695:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000164eee2d reply state 0000000003c7ac5d transno 4294967608 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094007.638704:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094007.638786:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:49500:x1870757013783424:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2190us (2327us total) trans 4294967608 rc 0/0 00000100:00100000:0.0:1784094007.638796:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 811 00010000:00010000:2.0:1784094007.639947:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.639959:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.639966:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.639970:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094007.639972:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.639977:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.639988:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff907202e6b100) 00010000:00010000:2.0:1784094007.639990:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094007.639994:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.640004:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb1bb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094007.786598:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094008.207062:0:83158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2cdde080 20000000:00000080:0.0:1784094008.207075:0:83158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720901ac00 uarg=0000000000000000 00010000:00010000:0.0:1784094008.209250:0:83158:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094008.209264:0:83158:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094008.209297:0:83158:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094008.209324:0:83158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.209340:0:83158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214caf06 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.209355:0:83158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.209387:0:83158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214caf06 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.209415:0:83158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214caf06 expref: 18 pid: 5770 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094008.209448:0:83158:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83158:1870757024292352:0@lo:104: 00000100:00100000:0.0:1784094008.209508:0:83158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094008.209555:0:83158:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784094008.209563:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784094008.209577:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292352 00000100:00100000:3.0:1784094008.209584:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292352 00000100:00100000:3.0:1784094008.209625:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784094008.209635:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723103f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:83158:x1870757024292352:12345-0@lo:104: 00010000:00010000:3.0:1784094008.209648:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.209705:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1784094008.209728:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784094008.209730:0:83158:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83158:1870757024292352:0@lo:104: 00010000:00010000:2.0:1784094008.209736:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.209746:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:0.0:1784094008.209748:0:83158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094008.209751:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.209767:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094008.209776:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094008.209782:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1784094008.209805:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723103f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:83158:x1870757024292352:12345-0@lo:104: Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094008.209811:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00010000:2.0:1784094008.209815:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.209822:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094008.209850:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.209858:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41800/0x9ce98053214caf06 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214caf0d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094008.209872:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024292480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094008.209874:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094008.209879:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094008.209882:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094008.209899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094008.209951:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292480 00000100:00100000:3.0:1784094008.209956:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292480 00010000:00010000:3.0:1784094008.209973:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214caf06 expref: 19 pid: 5770 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094008.209997:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784094008.210004:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024292480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094008.210014:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094008.210019:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214caf06 expref: 19 pid: 5770 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210029:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214caf06 expref: 19 pid: 5770 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210041:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214caf0d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214caf06 expref: 19 pid: 5770 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210054:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210062:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210072:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210079:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210087:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210098:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210103:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094008.210107:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210114:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210128:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094008.210137:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094008.210141:0:83158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.210149:0:83158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.210154:0:83158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214cb1c9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094008.210165:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024292480:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094008.210172:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784094008.210199:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024292480:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784094008.502343:0:83206:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5725f100 20000000:00000080:2.0:1784094008.502360:0:83206:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e212400 uarg=0000000000000000 00010000:00010000:2.0:1784094008.502569:0:83206:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094008.502583:0:83206:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094008.502601:0:83206:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094008.502622:0:83206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502635:0:83206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502643:0:83206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502648:0:83206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502652:0:83206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502656:0:83206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502661:0:83206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094008.502664:0:83206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502669:0:83206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502681:0:83206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502686:0:83206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.502690:0:83206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784094008.792642:0:83254:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3ef57070 20000000:00000080:2.0:1784094008.792658:0:83254:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e212800 uarg=0000000000000000 00010000:00010000:2.0:1784094008.792875:0:83254:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094008.792888:0:83254:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094008.792905:0:83254:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094008.792923:0:83254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792937:0:83254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792948:0:83254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792954:0:83254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792962:0:83254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792969:0:83254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792976:0:83254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094008.792980:0:83254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.792988:0:83254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.793000:0:83254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.793008:0:83254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094008.793014:0:83254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214cb1d7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094008.809523:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094009.322564:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094009.322595:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024292608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094009.322661:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094009.322698:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292608 00000100:00100000:0.0:1784094009.322706:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292608 00000100:00080000:2.0:1784094009.322757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094009.322776:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1784094009.322787:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024292608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094009.322822:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094009.322871:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024292608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094009.322876:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1784094009.322909:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024292608:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1784094009.577540:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094009.577547:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094009.577552:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094009.577599:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094009.577611:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094009.577622:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094009.577648:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024292736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094009.577715:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094009.577792:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292736 00000100:00100000:0.0:1784094009.577800:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e32bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784094009.577801:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292736 00000100:00100000:2.0:1784094009.577864:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1784094009.577874:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024292736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094009.577886:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094009.577900:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb1de expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094009.577922:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb1de expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094009.577932:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb1de expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094009.577939:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094009.577974:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024292736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094009.577991:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1784094009.578029:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024292736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094009.578044:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094009.578054:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094009.578072:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094009.578076:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094009.578085:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094009.833522:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094010.075638:0:83449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7c1b3be0 20000000:00000080:2.0:1784094010.075650:0:83449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e212800 uarg=0000000000000000 00010000:00010000:2.0:1784094010.075815:0:83449:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094010.075824:0:83449:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094010.075837:0:83449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094010.075851:0:83449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.075863:0:83449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb1de expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.075872:0:83449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.075906:0:83449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb1de expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.075920:0:83449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb1de expref: 18 pid: 5770 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094010.075932:0:83449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83449:1870757024292864:0@lo:104: 00000100:00100000:2.0:1784094010.075978:0:83449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094010.076020:0:83449:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784094010.076026:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292864 00000100:00100000:0.0:1784094010.076032:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292864 00000100:00100000:0.0:1784094010.076076:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784094010.076086:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:83449:x1870757024292864:12345-0@lo:104: 00010000:00010000:0.0:1784094010.076098:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094010.076168:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094010.076176:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:83449:x1870757024292864:12345-0@lo:104: Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094010.076184:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1784094010.076194:0:83449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83449:1870757024292864:0@lo:104: 00010000:00010000:1.0:1784094010.076204:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094010.076213:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.076214:0:83449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094010.076232:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094010.076237:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094010.076244:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094010.076253:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094010.076257:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094010.076291:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094010.076297:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094010.076324:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094010.076331:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb1de lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb1e5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094010.076337:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024292992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094010.076347:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094010.076350:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094010.076352:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094010.076369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094010.076408:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024292992 00000100:00100000:3.0:1784094010.076412:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024292992 00010000:00010000:3.0:1784094010.076450:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb1de expref: 19 pid: 5770 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094010.076474:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784094010.076482:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024292992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094010.076493:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094010.076497:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb1de expref: 19 pid: 5770 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076507:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb1de expref: 19 pid: 5770 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076518:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40400/0x9ce98053214cb1e5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb1de expref: 19 pid: 5770 timeout: 1321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076531:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076539:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076551:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076555:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076560:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076563:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076566:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094010.076569:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076576:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076588:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094010.076599:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094010.076602:0:83449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.076611:0:83449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094010.076615:0:83449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41a00/0x9ce98053214cb1ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094010.076629:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024292992:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094010.076634:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1784094010.076656:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024292992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094010.857525:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094010.866974:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967608 is committed 00000100:00100000:2.0:1784094011.768494:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094011.768549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094011.768572:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013783552 00000100:00100000:1.0:1784094011.768585:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013783552 00000100:00100000:2.0:1784094011.768586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094011.768631:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013783808 00000100:00100000:3.0:1784094011.768648:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013783808 00000100:00100000:2.0:1784094011.768649:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094011.768669:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 770 00000100:00100000:0.0:1784094011.768670:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013783680 00000100:00100000:0.0:1784094011.768678:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013783680 00000100:00100000:1.0:1784094011.768687:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013783552:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094011.768736:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094011.768747:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094011.768748:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013783936 00000100:00100000:0.0:1784094011.768749:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 789 00000100:00100000:3.0:1784094011.768759:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013783936 00000100:00100000:0.0:1784094011.768767:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013783680:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094011.768794:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 582 00000100:00100000:1.0:1784094011.768801:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013783552:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094011.768812:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013783808:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094011.768817:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 770 00000100:00100000:3.0:1784094011.768840:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:3.0:1784094011.768856:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013783936:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094011.768879:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013783808:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094011.768880:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013783680:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094011.768914:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013783936:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 55us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094011.768916:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 582 00000100:00100000:0.0:1784094011.768921:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 789 00000100:00100000:3.0:1784094011.768939:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00080000:2.0:1784094011.768972:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784094011.881564:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094012.074480:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094012.074488:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094012.074493:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094012.074544:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094012.074555:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094012.074568:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094012.074609:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024293120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094012.074694:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094012.074754:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293120 00000100:00100000:2.0:1784094012.074765:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293120 00000100:00100000:0.0:1784094012.074769:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208d99e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784094012.074834:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1784094012.074857:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024293120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094012.074876:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094012.074893:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb1f3 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094012.074923:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094012.074935:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094012.074944:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094012.074999:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024293120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094012.075007:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1784094012.075048:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024293120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094012.075066:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094012.075076:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094012.075101:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094012.075107:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094012.075115:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094012.393689:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024293376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094012.393692:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024293504:0@lo:400:kworker.0 00000100:00100000:0.0:1784094012.393706:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024293632:0@lo:400:kworker.0 00000100:00100000:1.0:1784094012.393762:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024293248:0@lo:400:kworker.0 00000100:00100000:3.0:1784094012.393784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094012.393804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094012.393806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094012.393844:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293632 00000100:00100000:1.0:1784094012.393854:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293632 00000100:00100000:3.0:1784094012.393888:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024293888:0@lo:400:kworker.0 00000100:00100000:0.0:1784094012.393914:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094012.393947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094012.393949:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293376 00000100:00100000:1.0:1784094012.393955:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1784094012.393957:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024293760:0@lo:400:kworker.0 00000100:00100000:2.0:1784094012.393958:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293376 00000100:00100000:1.0:1784094012.393969:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024293632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094012.394007:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293504 00000100:00100000:3.0:1784094012.394014:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293504 00000100:00100000:0.0:1784094012.394018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094012.394043:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024293632:12345-0@lo:400:kworker.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094012.394050:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1784094012.394056:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1784094012.394081:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024293376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094012.394082:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293248 00000100:00100000:1.0:1784094012.394087:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293888 00000100:00100000:3.0:1784094012.394088:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293248 00000100:00100000:1.0:1784094012.394091:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293888 00000100:00100000:0.0:1784094012.394100:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024293760 00000100:00100000:0.0:1784094012.394107:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024293760 00002000:00000024:2.0:1784094012.394134:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094012.394135:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1784094012.394159:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1784094012.394159:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024293888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094012.394181:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1784094012.394190:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024293504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094012.394199:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024293248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094012.394215:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024293376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094012.394224:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024293888:12345-0@lo:400:kworker.0 Request processed in 73us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094012.394233:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1784094012.394254:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1784094012.394289:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024293248:12345-0@lo:400:kworker.0 Request processed in 94us (377us total) trans 0 rc 0/0 00000100:00080000:1.0:1784094012.394298:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094012.394299:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00080000:1.0:1784094012.394307:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094012.394312:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094012.394314:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024293504:12345-0@lo:400:kworker.0 Request processed in 129us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094012.394330:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1784094012.394340:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1784094012.394367:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024293760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094012.394410:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024293632:0@lo:400:kworker.0 00000100:00100000:0.0:1784094012.394411:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024293248:0@lo:400:kworker.0 00000100:00100000:3.0:1784094012.394464:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024293504:0@lo:400:kworker.0 00000100:00100000:0.0:1784094012.394510:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024293760:0@lo:400:kworker.0 00000100:00100000:2.0:1784094012.394513:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024293760:12345-0@lo:400:kworker.0 Request processed in 153us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094012.394527:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1784094012.394541:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024293888:0@lo:400:kworker.0 00000100:00100000:3.0:1784094012.394563:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024293376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784094012.905564:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784094013.327650:0:83791:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 20: test nodemap mapped_admin fileops ========================================================== 01:40:13 (1784094013) 00000004:00000400:3.0:1784094013.700290:0:83839:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1784094013.705249:0:83839:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:2.0:1784094013.930584:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094014.038469:0:83887:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8b2882a0 20000000:00000080:1.0:1784094014.038491:0:83887:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b31c00 uarg=0000000000000000 10000000:01000000:1.0:1784094014.039110:0:83887:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094014.039131:0:83887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094014.039147:0:83887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094014.039154:0:83887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094014.039201:0:83887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094014.039233:0:83887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 18 pid: 5770 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094014.039250:0:83887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83887:1870757024294016:0@lo:104: 00000100:00100000:1.0:1784094014.039323:0:83887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094014.039385:0:83887:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209106300 going to sleep for 11 seconds 00000100:00100000:3.0:1784094014.039398:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294016 00000100:00100000:3.0:1784094014.039408:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294016 00000100:00100000:3.0:1784094014.039487:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1784094014.039500:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:83887:x1870757024294016:12345-0@lo:104: 00010000:00010000:3.0:1784094014.039525:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.039600:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094014.039608:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:83887:x1870757024294016:12345-0@lo:104: Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094014.039617:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784094014.039624:0:83887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83887:1870757024294016:0@lo:104: 00010000:00010000:0.0:1784094014.039640:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094014.039653:0:83887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.039653:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.039677:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094014.039682:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.039692:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094014.039704:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094014.039710:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094014.039751:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.039758:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094014.039785:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.039792:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214cb1f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb1fa expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094014.039810:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1784094014.039818:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094014.039822:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094014.039827:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024294144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094014.039827:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094014.039866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094014.039910:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294144 00000100:00100000:3.0:1784094014.039915:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294144 00010000:00010000:3.0:1784094014.039935:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 19 pid: 5770 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094014.039964:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1784094014.039970:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024294144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094014.039982:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094014.039995:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 19 pid: 5770 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040006:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 19 pid: 5770 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040018:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214cb1fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb1f3 expref: 19 pid: 5770 timeout: 1325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040033:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040041:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040053:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040060:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040067:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040073:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040083:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094014.040087:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040095:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040109:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.040118:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094014.040136:0:83887:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094014.040147:0:83887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094014.040153:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024294144:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (285us total) trans 0 rc 0/0 00010000:00010000:1.0:1784094014.040160:0:83887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214cb201 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094014.040166:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784094014.040184:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024294144:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784094014.338806:0:83935:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd5008ad0 20000000:00000080:0.0:1784094014.338822:0:83935:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907209019000 uarg=0000000000000000 10000000:01000000:0.0:1784094014.339079:0:83935:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094014.339099:0:83935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339113:0:83935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339122:0:83935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339134:0:83935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339141:0:83935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339148:0:83935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339154:0:83935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094014.339158:0:83935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339167:0:83935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339178:0:83935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339186:0:83935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.339192:0:83935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214cb208 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094014.441605:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024294272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094014.441678:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094014.441720:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294272 00000100:00100000:0.0:1784094014.441727:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294272 00000100:00080000:2.0:1784094014.441769:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094014.441779:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1784094014.441788:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024294272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094014.441816:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094014.441855:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024294272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094014.441860:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1784094014.441910:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024294272:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1784094014.623473:0:83983:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff243520b0 20000000:00000080:3.0:1784094014.623486:0:83983:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d69000 uarg=0000000000000000 10000000:01000000:3.0:1784094014.623649:0:83983:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094014.623664:0:83983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623676:0:83983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623684:0:83983:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623688:0:83983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623692:0:83983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623698:0:83983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623703:0:83983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094014.623706:0:83983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623711:0:83983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623719:0:83983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623723:0:83983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094014.623727:0:83983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214cb20f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784094014.916805:0:84031:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0c4c5d70 20000000:00000080:2.0:1784094014.916822:0:84031:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e210800 uarg=0000000000000000 10000000:01000000:2.0:1784094014.916988:0:84031:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094014.917006:0:84031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917019:0:84031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917030:0:84031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917037:0:84031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917044:0:84031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917051:0:84031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917057:0:84031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094014.917061:0:84031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917069:0:84031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917085:0:84031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917090:0:84031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094014.917094:0:84031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40a00/0x9ce98053214cb216 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094014.953499:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094015.082460:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094015.082464:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094015.082467:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094015.082502:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.082510:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.082519:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094015.082537:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024294400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094015.082589:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094015.082628:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294400 00000100:00100000:0.0:1784094015.082635:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209100780 going to sleep for 11 seconds 00000100:00100000:1.0:1784094015.082636:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294400 00000100:00100000:1.0:1784094015.082685:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1784094015.082697:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024294400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094015.082711:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094015.082727:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb21d expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.082750:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb21d expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.082761:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb21d expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.082770:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784094015.082830:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024294400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094015.082839:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1784094015.082849:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90720bb28a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024294400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094015.082873:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.082887:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094015.082906:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094015.082912:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.082923:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784094015.203076:0:84080:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6fbe7370 20000000:00000080:3.0:1784094015.203089:0:84080:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d6b800 uarg=0000000000000000 10000000:01000000:3.0:1784094015.203248:0:84080:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094015.203264:0:84080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203277:0:84080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb21d expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203283:0:84080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203317:0:84080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb21d expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203327:0:84080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb21d expref: 18 pid: 5772 timeout: 1326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094015.203338:0:84080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84080:1870757024294528:0@lo:104: 00000100:00100000:3.0:1784094015.203385:0:84080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094015.203450:0:84080:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5900 going to sleep for 11 seconds 00000100:00100000:0.0:1784094015.203453:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294528 00000100:00100000:0.0:1784094015.203461:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294528 00000100:00100000:0.0:1784094015.203500:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784094015.203511:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:84080:x1870757024294528:12345-0@lo:104: 00010000:00010000:0.0:1784094015.203525:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.203580:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094015.203585:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:84080:x1870757024294528:12345-0@lo:104: Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094015.203591:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1784094015.203602:0:84080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84080:1870757024294528:0@lo:104: 00010000:00010000:1.0:1784094015.203602:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094015.203609:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.203617:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1c54c20) 00010000:00010000:3.0:1784094015.203619:0:84080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094015.203620:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.203629:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094015.203641:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094015.203647:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094015.203674:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.203679:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094015.203699:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.203704:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cb21d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb224 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094015.203708:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1784094015.203716:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094015.203720:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094015.203722:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024294656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094015.203723:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094015.203752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094015.203784:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294656 00000100:00100000:3.0:1784094015.203788:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294656 00010000:00010000:3.0:1784094015.203802:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb21d expref: 19 pid: 5772 timeout: 1326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094015.203824:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784094015.203831:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b8e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024294656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094015.203841:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094015.203846:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb21d expref: 19 pid: 5772 timeout: 1326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203855:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb21d expref: 19 pid: 5772 timeout: 1326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203867:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214cb224 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb21d expref: 19 pid: 5772 timeout: 1326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203879:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203887:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203899:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203906:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203913:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203920:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203925:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094015.203928:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203933:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203947:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094015.203952:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094015.203970:0:84080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.203978:0:84080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094015.203983:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b8e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024294656:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1784094015.203996:0:84080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb22b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094015.204001:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1784094015.204024:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024294656:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784094015.500586:0:84129:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd793b9af0 20000000:00000080:1.0:1784094015.500597:0:84129:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062c000 uarg=0000000000000000 10000000:01000000:1.0:1784094015.500761:0:84129:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094015.500781:0:84129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500797:0:84129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500806:0:84129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500814:0:84129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500820:0:84129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500828:0:84129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500834:0:84129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094015.500838:0:84129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500847:0:84129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500859:0:84129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500865:0:84129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094015.500869:0:84129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12800/0x9ce98053214cb232 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094015.978523:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094016.434753:0:84278:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd1c79510 20000000:00000080:0.0:1784094016.434769:0:84278:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072379a8000 uarg=0000000000000000 10000000:01000000:0.0:1784094016.435142:0:84278:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094016.435171:0:84278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435185:0:84278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435193:0:84278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435197:0:84278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435201:0:84278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435206:0:84278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435212:0:84278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094016.435216:0:84278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435223:0:84278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435236:0:84278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435244:0:84278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094016.435255:0:84278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76e00/0x9ce98053214cb239 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094016.722881:0:84326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4cae8ee0 20000000:00000080:1.0:1784094016.722898:0:84326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90710237d400 uarg=0000000000000000 10000000:01000000:1.0:1784094016.723101:0:84326:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094016.723120:0:84326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723142:0:84326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723152:0:84326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723171:0:84326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723178:0:84326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723185:0:84326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723192:0:84326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094016.723196:0:84326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723204:0:84326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723215:0:84326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723223:0:84326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094016.723230:0:84326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214cb240 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094016.888462:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094016.888504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094016.888523:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784192 00000100:00100000:0.0:1784094016.888534:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784192 00000100:00100000:3.0:1784094016.888535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094016.888537:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784064 00000100:00100000:2.0:1784094016.888542:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784064 00000100:00100000:3.0:1784094016.888566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094016.888588:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:3.0:1784094016.888594:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784448 00000100:00100000:0.0:1784094016.888595:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 793 00000100:00100000:3.0:1784094016.888599:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784448 00000100:00100000:2.0:1784094016.888600:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013784064:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094016.888610:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013784192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094016.888637:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784320 00000100:00100000:3.0:1784094016.888642:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784320 00000100:00100000:2.0:1784094016.888667:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013784064:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094016.888670:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013784192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094016.888681:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 586 00000100:00100000:2.0:1784094016.888681:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:0.0:1784094016.888685:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 793 00000100:00100000:3.0:1784094016.888694:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013784448:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094016.888712:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094016.888718:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094016.888723:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094016.888725:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013784448:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094016.888732:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 586 00000100:00100000:0.0:1784094016.888748:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:0.0:1784094016.888760:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013784320:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094016.888802:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013784320:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094016.888811:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 587 10000000:01000000:2.0:1784094017.002497:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094017.002505:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094017.002509:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094017.002536:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094017.002560:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094017.002573:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094017.002584:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094017.002613:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024294784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094017.002693:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094017.002729:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294784 00000100:00100000:3.0:1784094017.002736:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294784 00000100:00100000:2.0:1784094017.002761:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1784094017.002795:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1784094017.002805:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024294784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094017.002816:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094017.002831:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb247 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094017.002851:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb247 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094017.002861:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb247 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094017.002874:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094017.002918:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024294784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094017.002925:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1784094017.002950:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024294784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094017.002966:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094017.002976:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094017.002993:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094017.002998:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094017.003007:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094017.513579:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024295168:0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.513588:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094017.513596:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024295040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094017.513610:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024295424:0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.513684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094017.513685:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094017.513740:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295424 00000100:00100000:1.0:1784094017.513747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094017.513751:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295424 00000100:00100000:2.0:1784094017.513765:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024295296:0@lo:400:kworker.0 00000100:00100000:0.0:1784094017.513765:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024294912:0@lo:400:kworker.0 00000100:00100000:1.0:1784094017.513781:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094017.513791:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024295552:0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.513810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094017.513816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094017.513830:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295168 00000100:00100000:3.0:1784094017.513834:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295168 00000100:00100000:1.0:1784094017.513851:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024294912 00000100:00100000:1.0:1784094017.513858:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024294912 00000100:00100000:3.0:1784094017.513863:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1784094017.513878:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024295424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.513885:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295296 00000100:00100000:1.0:1784094017.513890:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:2.0:1784094017.513891:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295296 00000100:00100000:0.0:1784094017.513900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094017.513905:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024295168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.513936:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295552 00000100:00100000:2.0:1784094017.513941:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295552 00000100:00100000:0.0:1784094017.513974:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1784094017.513979:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024295424:12345-0@lo:400:kworker.0 Request processed in 101us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094017.513979:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1784094017.513984:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024295168:12345-0@lo:400:kworker.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094017.513991:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024294912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.513994:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024295296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094017.513997:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1784094017.514010:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1784094017.514036:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1784094017.514044:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.514053:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024295296:12345-0@lo:400:kworker.0 Request processed in 62us (243us total) trans 0 rc 0/0 00000100:00080000:1.0:1784094017.514055:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094017.514062:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094017.514064:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024294912:12345-0@lo:400:kworker.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094017.514066:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00080000:1.0:1784094017.514069:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094017.514078:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1784094017.514083:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024295552:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094017.514089:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1784094017.514097:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295040 00000100:00100000:1.0:1784094017.514103:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295040 00000100:00100000:2.0:1784094017.514135:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024295424:0@lo:400:kworker.0 00000100:00100000:0.0:1784094017.514135:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024294912:0@lo:400:kworker.0 00000100:00100000:3.0:1784094017.514157:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024295552:0@lo:400:kworker.0 00000100:00100000:2.0:1784094017.514166:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024295296:0@lo:400:kworker.0 00000100:00100000:3.0:1784094017.514179:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024295168:0@lo:400:kworker.0 00000100:00100000:0.0:1784094017.514205:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1784094017.514214:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024295040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094017.514246:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094017.514294:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024295040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094017.514302:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1784094017.514329:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024295040:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1784094017.999572:0:84521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe203abb80 20000000:00000080:0.0:1784094017.999585:0:84521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b33c00 uarg=0000000000000000 00010000:00010000:0.0:1784094017.999795:0:84521:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094017.999810:0:84521:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094017.999823:0:84521:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094017.999839:0:84521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094017.999854:0:84521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb247 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094017.999863:0:84521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094017.999899:0:84521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb247 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094017.999918:0:84521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb247 expref: 18 pid: 5772 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094017.999933:0:84521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84521:1870757024295680:0@lo:104: 00000100:00100000:0.0:1784094017.999989:0:84521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094018.000040:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295680 00000100:00100000:0.0:1784094018.000041:0:84521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072012ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1784094018.000050:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295680 00000100:00100000:3.0:1784094018.000098:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1784094018.000109:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:84521:x1870757024295680:12345-0@lo:104: 00010000:00010000:3.0:1784094018.000122:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094018.000198:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094018.000205:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:84521:x1870757024295680:12345-0@lo:104: Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094018.000213:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1784094018.000220:0:84521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84521:1870757024295680:0@lo:104: 00010000:00010000:1.0:1784094018.000222:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094018.000232:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094018.000240:0:84521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000242:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094018.000251:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000261:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094018.000267:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094018.000274:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094018.000299:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000304:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094018.000327:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000341:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cb247 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb24e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094018.000351:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024295808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094018.000362:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094018.000365:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094018.000367:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094018.000385:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094018.000454:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295808 00000100:00100000:1.0:1784094018.000458:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295808 00010000:00010000:1.0:1784094018.000477:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb247 expref: 19 pid: 5772 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094018.000495:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784094018.000500:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024295808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094018.000508:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094018.000512:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb247 expref: 19 pid: 5772 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000519:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb247 expref: 19 pid: 5772 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000527:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214cb24e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb247 expref: 19 pid: 5772 timeout: 1329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000536:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000541:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000560:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000564:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000569:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000572:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000575:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094018.000578:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000582:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000590:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094018.000596:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094018.000605:0:84521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094018.000616:0:84521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094018.000624:0:84521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214cb255 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094018.000632:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024295808:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094018.000642:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1784094018.000671:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024295808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094018.026519:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094019.049498:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094019.329303:0:84716:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfa4fe910 20000000:00000080:2.0:1784094019.329319:0:84716:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907209019000 uarg=0000000000000000 00010000:00010000:2.0:1784094019.329557:0:84716:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094019.329570:0:84716:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094019.329583:0:84716:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094019.329602:0:84716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329616:0:84716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329626:0:84716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329633:0:84716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329640:0:84716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329647:0:84716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329651:0:84716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094019.329655:0:84716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329661:0:84716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329669:0:84716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329673:0:84716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.329677:0:84716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41000/0x9ce98053214cb25c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094019.561584:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024295936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094019.561649:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094019.561696:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024295936 00000100:00100000:0.0:1784094019.561705:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024295936 00000100:00080000:2.0:1784094019.561761:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094019.561774:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1784094019.561787:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024295936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094019.561822:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094019.561876:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024295936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094019.561884:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1784094019.561914:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024295936:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1784094019.626307:0:84764:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde0115a00 20000000:00000080:2.0:1784094019.626323:0:84764:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e213c00 uarg=0000000000000000 00010000:00010000:2.0:1784094019.626576:0:84764:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094019.626590:0:84764:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094019.626602:0:84764:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094019.626619:0:84764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626635:0:84764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626645:0:84764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626652:0:84764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626660:0:84764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626668:0:84764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626674:0:84764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094019.626678:0:84764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626686:0:84764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626698:0:84764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626706:0:84764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094019.626712:0:84764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41400/0x9ce98053214cb263 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094020.009471:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094020.009477:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094020.009481:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094020.009517:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094020.009525:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094020.009536:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094020.009556:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024296064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094020.009606:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094020.009645:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af5840 going to sleep for 11 seconds 00000100:00100000:3.0:1784094020.009652:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296064 00000100:00100000:3.0:1784094020.009660:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296064 00000100:00100000:3.0:1784094020.009701:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1784094020.009709:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024296064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094020.009720:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094020.009730:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb26a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094020.009749:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb26a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094020.009756:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb26a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094020.009762:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094020.009798:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024296064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094020.009804:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1784094020.009824:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024296064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094020.009837:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094020.009844:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094020.009858:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094020.009862:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094020.009869:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094020.073565:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094021.097534:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094021.480843:0:85056:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0c3b6e80 20000000:00000080:2.0:1784094021.480861:0:85056:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e211800 uarg=0000000000000000 00010000:00010000:2.0:1784094021.481329:0:85056:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094021.481341:0:85056:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094021.481352:0:85056:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094021.481371:0:85056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.481392:0:85056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb26a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.481399:0:85056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.481468:0:85056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb26a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.481482:0:85056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb26a expref: 18 pid: 5771 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094021.481497:0:85056:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85056:1870757024296192:0@lo:104: 00000100:00100000:2.0:1784094021.481575:0:85056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094021.481613:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296192 00000100:00100000:0.0:1784094021.481623:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296192 00000100:00100000:2.0:1784094021.481644:0:85056:0:(client.c:2702:ptlrpc_set_wait()) set ffff907206b0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1784094021.481699:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1784094021.481715:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:85056:x1870757024296192:12345-0@lo:104: 00010000:00010000:0.0:1784094021.481730:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.481796:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094021.481804:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:85056:x1870757024296192:12345-0@lo:104: Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094021.481815:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00010000:1.0:1784094021.481821:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784094021.481834:0:85056:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85056:1870757024296192:0@lo:104: 00010000:00010000:1.0:1784094021.481835:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094021.481852:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094021.481855:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094021.481864:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.481869:0:85056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094021.481870:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094021.481893:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094021.481956:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094021.481964:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094021.481998:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094021.482007:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cb26a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb271 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094021.482016:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024296320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094021.482033:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094021.482036:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094021.482038:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094021.482053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094021.482103:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296320 00000100:00100000:3.0:1784094021.482108:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296320 00010000:00010000:3.0:1784094021.482135:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb26a expref: 19 pid: 5771 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094021.482159:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1784094021.482166:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024296320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094021.482177:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094021.482183:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb26a expref: 19 pid: 5771 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482195:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb26a expref: 19 pid: 5771 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482209:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214cb271 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb26a expref: 19 pid: 5771 timeout: 1332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482223:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482231:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482244:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482251:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482263:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482270:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482274:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094021.482277:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482283:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482296:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094021.482304:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094021.482313:0:85056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.482321:0:85056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094021.482328:0:85056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cb278 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094021.482341:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024296320:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094021.482348:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1784094021.482374:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024296320:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784094021.793837:0:85104:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc4dab20a0 20000000:00000080:0.0:1784094021.793856:0:85104:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103f000 uarg=0000000000000000 00010000:00010000:0.0:1784094021.794096:0:85104:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094021.794111:0:85104:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094021.794123:0:85104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094021.794142:0:85104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794159:0:85104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794169:0:85104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794176:0:85104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794189:0:85104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794196:0:85104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794202:0:85104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094021.794207:0:85104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794216:0:85104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794227:0:85104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794235:0:85104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094021.794241:0:85104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214cb27f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094022.008493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094022.008530:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094022.008554:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784576 00000100:00100000:1.0:1784094022.008568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094022.008572:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784576 00000100:00100000:2.0:1784094022.008598:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784704 00000100:00100000:1.0:1784094022.008606:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094022.008610:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784704 00000100:00100000:1.0:1784094022.008642:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784960 00000100:00100000:1.0:1784094022.008647:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784960 00000100:00100000:3.0:1784094022.008658:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 776 00000100:00100000:3.0:1784094022.008676:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013784576:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094022.008704:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 797 00000100:00100000:1.0:1784094022.008709:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013784832 00000100:00100000:1.0:1784094022.008714:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013784832 00000100:00100000:2.0:1784094022.008720:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013784704:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094022.008747:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 590 00000100:00100000:1.0:1784094022.008758:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013784960:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094022.008782:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013784576:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094022.008792:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 776 00000100:00100000:2.0:1784094022.008799:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013784704:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094022.008801:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013784960:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094022.008818:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 797 00000100:00100000:1.0:1784094022.008819:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 590 00000100:00100000:1.0:1784094022.008854:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:1.0:1784094022.008862:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013784832:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094022.008864:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094022.008874:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094022.008878:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094022.008901:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013784832:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094022.008909:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 591 00010000:00010000:0.0:1784094022.122589:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094022.633614:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024296704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094022.633621:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024296448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094022.633635:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024296832:0@lo:400:kworker.0 00000100:00100000:0.0:1784094022.633687:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024296960:0@lo:400:kworker.0 00000100:00100000:1.0:1784094022.633802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094022.633810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094022.633824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094022.633879:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296704 00000100:00100000:1.0:1784094022.633885:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024296576:0@lo:400:kworker.0 00000100:00100000:3.0:1784094022.633889:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024297216:0@lo:400:kworker.0 00000100:00100000:2.0:1784094022.633893:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296704 00000100:00100000:0.0:1784094022.633917:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296448 00000100:00100000:0.0:1784094022.633926:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296448 00000100:00100000:3.0:1784094022.633950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094022.633950:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094022.633988:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094022.634004:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024297088:0@lo:400:kworker.0 00000100:00100000:2.0:1784094022.634009:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1784094022.634018:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1784094022.634030:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024296704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094022.634034:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024296448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094022.634055:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784094022.634065:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1784094022.634091:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094022.634097:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296576 00000100:00100000:3.0:1784094022.634099:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297088 00000100:00100000:1.0:1784094022.634103:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296576 00000100:00100000:3.0:1784094022.634116:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297088 00000100:00100000:2.0:1784094022.634151:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024296704:12345-0@lo:400:kworker.0 Request processed in 124us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094022.634161:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1784094022.634167:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024296448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094022.634177:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1784094022.634183:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024296576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094022.634190:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1784094022.634193:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1784094022.634206:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024297088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094022.634234:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024296576:12345-0@lo:400:kworker.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094022.634241:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296960 00000100:00100000:2.0:1784094022.634250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094022.634250:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296960 00000100:00100000:3.0:1784094022.634258:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024297088:12345-0@lo:400:kworker.0 Request processed in 56us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094022.634258:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1784094022.634283:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1784094022.634313:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024296832 00000100:00100000:0.0:1784094022.634313:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297216 00000100:00100000:3.0:1784094022.634317:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024296832 00000100:00100000:0.0:1784094022.634317:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297216 00000100:00100000:1.0:1784094022.634318:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1784094022.634337:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024296960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094022.634356:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1784094022.634356:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1784094022.634368:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024296832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094022.634368:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024297216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094022.634371:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024297088:0@lo:400:kworker.0 00000100:00100000:1.0:1784094022.634395:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024296960:12345-0@lo:400:kworker.0 Request processed in 66us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094022.634406:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024296704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094022.634407:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1784094022.634450:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024297216:12345-0@lo:400:kworker.0 Request processed in 56us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094022.634461:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1784094022.634472:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024296832:12345-0@lo:400:kworker.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094022.634478:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1784094022.634503:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024296960:0@lo:400:kworker.0 00000100:00100000:2.0:1784094022.634507:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024297216:0@lo:400:kworker.0 00000100:00080000:3.0:1784094022.634513:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094022.634520:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094022.634537:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024296448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094022.634549:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024296576:0@lo:400:kworker.0 00000100:00100000:3.0:1784094022.634555:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024296832:0@lo:400:kworker.0 00000100:00100000:2.0:1784094022.900542:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094022.900595:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013785088 00000100:00100000:1.0:1784094022.900604:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013785088 00000100:00100000:1.0:1784094022.900647:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 812 00000100:00100000:1.0:1784094022.900655:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:50726:x1870757013785088:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094022.900672:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094022.900695:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a71 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.900748:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb28d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.900760:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.900774:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094022.900972:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784094022.900975:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094022.901028:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.901060:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a71 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.901071:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb28d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a71 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.901077:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094022.901079:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094022.901081:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784094022.901132:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:50726:x1870757013785088:12345-192.168.204.57@tcp:101:rm.0 Request processed in 477us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094022.901138:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 812 00000100:00100000:3.0:1784094022.901963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094022.902004:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013785216 00000100:00100000:2.0:1784094022.902009:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013785216 00000100:00100000:2.0:1784094022.902057:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 813 00000100:00100000:2.0:1784094022.902066:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50726:x1870757013785216:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094022.902076:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094022.902086:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a78 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902116:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902126:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902134:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902145:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902152:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902160:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902325:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902334:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902340:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902347:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094022.902351:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902358:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902367:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:2.0:1784094022.902370:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094022.902373:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902379:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902387:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902393:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902399:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902403:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094022.902406:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902412:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902449:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff90721a781400) 00010000:00010000:2.0:1784094022.902453:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094022.902456:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902462:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb2a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902486:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb294 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a78 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902494:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:2.0:1784094022.902497:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094022.902500:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cb294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a78 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094022.902508:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094022.902537:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50726:x1870757013785216:12345-192.168.204.57@tcp:101:rm.0 Request processed in 473us (574us total) trans 0 rc 301/301 00000100:00100000:2.0:1784094022.902541:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 813 00000100:00100000:2.0:1784094022.917101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094022.917144:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013785344 00000100:00100000:3.0:1784094022.917161:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013785344 00000100:00100000:2.0:1784094022.917168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094022.917242:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013785600 00000100:00100000:0.0:1784094022.917251:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013785600 00000100:00100000:3.0:1784094022.917297:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 814 00000100:00100000:0.0:1784094022.917319:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 815 00000100:00100000:3.0:1784094022.917321:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013785344:12345-192.168.204.57@tcp:41:mkdir.0 00000100:00100000:0.0:1784094022.917338:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:50730:x1870757013785600:12345-192.168.204.57@tcp:36:mkdir.0 00000004:00000024:3.0:1784094022.917384:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:0.0:1784094022.917388:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094022.917417:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb28d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a71 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.917473:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12500) 00010000:00010000:0.0:1784094022.917493:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094022.917536:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013785344:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 223us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094022.917548:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 814 00010000:00010000:0.0:1784094022.917773:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.917788:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.917798:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.917810:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.917817:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.917824:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094022.918758:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00010000:00010000:0.0:1784094022.918768:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.918775:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.918782:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.918788:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094022.918793:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.918800:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.918812:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094022.918815:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094022.918818:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.918824:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094022.918835:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000378366b8 reply state 000000000fe2911f transno 4294967609 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094022.918843:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094022.918915:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:50730:x1870757013785600:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1583us (1744us total) trans 4294967609 rc 0/0 00000100:00100000:0.0:1784094022.918923:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 815 00010000:00010000:1.0:1784094022.919437:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.919444:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.919449:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.919456:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094022.919459:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.919463:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.919470:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6b300) 00010000:00010000:1.0:1784094022.919472:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094022.919475:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.919479:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2b0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094022.935719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094022.935806:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013785728 00000100:00100000:0.0:1784094022.935815:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013785728 00000100:00100000:0.0:1784094022.935877:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 816 00000100:00100000:0.0:1784094022.935887:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50734:x1870757013785728:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784094022.935911:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094022.935934:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a7f expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.935989:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.936000:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.936012:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094022.936074:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094022.936077:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094022.936094:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.936115:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb2b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a7f expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.936127:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a7f expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.936133:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094022.936135:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094022.936137:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094022.936192:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:50734:x1870757013785728:12345-192.168.204.57@tcp:101:chown.0 Request processed in 306us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094022.936197:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 816 00000100:00100000:2.0:1784094022.937105:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094022.937150:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013785856 00000100:00100000:3.0:1784094022.937156:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013785856 00000100:00100000:3.0:1784094022.937192:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 817 00000100:00100000:3.0:1784094022.937200:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:50734:x1870757013785856:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784094022.937209:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094022.937229:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb2c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a86 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937260:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937271:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937279:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937296:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937304:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937310:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937371:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb2da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937376:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937380:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094022.937402:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00000004:00200000:3.0:1784094022.937406:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094022.937443:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb2da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937455:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937463:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937469:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937475:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094022.937478:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937484:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937490:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:3.0:1784094022.937493:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094022.937496:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937502:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937513:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937519:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937525:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937530:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094022.937532:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937537:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937541:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fce500) 00010000:00010000:3.0:1784094022.937543:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094022.937545:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937548:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb2d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937568:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb2c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a86 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937595:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb2da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a86 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094022.937603:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784094022.937605:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094022.937606:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784094022.937634:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:50734:x1870757013785856:12345-192.168.204.57@tcp:101:chown.0 Request processed in 436us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094022.937639:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 817 00000100:00100000:2.0:1784094022.938777:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094022.938816:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013786112 00000100:00100000:0.0:1784094022.938821:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013786112 00000100:00100000:0.0:1784094022.938848:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 818 00000100:00100000:0.0:1784094022.938854:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:50734:x1870757013786112:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:0.0:1784094022.938875:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094022.938887:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb2da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a86 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.938900:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907204fce200) 00010000:00010000:0.0:1784094022.938904:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094022.938915:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.938921:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094022.938926:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094022.939079:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e1344f81 reply state 00000000dc0bcb4d transno 4294967610 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094022.939086:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094022.939093:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00000100:00100000:0.0:1784094022.939128:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:50734:x1870757013786112:12345-192.168.204.57@tcp:36:chown.0 Request processed in 275us (354us total) trans 4294967610 rc 0/0 00000100:00100000:0.0:1784094022.939133:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 818 00010000:00010000:1.0:1784094022.939728:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.939738:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.939744:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.939749:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094022.939752:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.939758:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.939772:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:1.0:1784094022.939775:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094022.939778:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094022.939784:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb2e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.145523:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094023.247323:0:85300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1897ca20 20000000:00000080:3.0:1784094023.247343:0:85300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb3f000 uarg=0000000000000000 00010000:00010000:3.0:1784094023.247661:0:85300:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784094023.247701:0:85300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:3.0:1784094023.247705:0:85300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094023.247717:0:85300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb2be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a7f expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247741:0:85300:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784094023.247755:0:85300:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094023.247772:0:85300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247787:0:85300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247799:0:85300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247811:0:85300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247819:0:85300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247825:0:85300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247832:0:85300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094023.247837:0:85300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247845:0:85300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247854:0:85300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247861:0:85300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.247867:0:85300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cb2e8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094023.337471:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094023.337476:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094023.337480:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094023.337517:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.337528:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.337539:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094023.337565:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024297344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094023.337625:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094023.337664:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297344 00000100:00100000:0.0:1784094023.337672:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784094023.337673:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297344 00000100:00100000:2.0:1784094023.337720:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1784094023.337730:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024297344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094023.337743:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094023.337757:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb2ef expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094023.337779:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094023.337786:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094023.337792:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784094023.337830:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024297344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094023.337838:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1784094023.337859:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024297344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094023.337874:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.337881:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094023.337893:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094023.337896:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.337901:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094023.549901:0:85348:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7e21b950 20000000:00000080:0.0:1784094023.549917:0:85348:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a5c800 uarg=0000000000000000 00010000:00010000:0.0:1784094023.550130:0:85348:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094023.550145:0:85348:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094023.550159:0:85348:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094023.550177:0:85348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550193:0:85348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550207:0:85348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550245:0:85348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550259:0:85348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 18 pid: 5770 timeout: 1334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094023.550273:0:85348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85348:1870757024297472:0@lo:104: 00000100:00100000:0.0:1784094023.550331:0:85348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094023.550382:0:85348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071034863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094023.550395:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297472 00000100:00100000:3.0:1784094023.550403:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297472 00000100:00100000:3.0:1784094023.550471:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784094023.550485:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:85348:x1870757024297472:12345-0@lo:104: 00010000:00010000:3.0:1784094023.550497:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550560:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094023.550567:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:85348:x1870757024297472:12345-0@lo:104: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094023.550577:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1784094023.550578:0:85348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85348:1870757024297472:0@lo:104: 00010000:00010000:1.0:1784094023.550582:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094023.550589:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094023.550596:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094023.550600:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550601:0:85348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094023.550612:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094023.550619:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094023.550623:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094023.550646:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094023.550649:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094023.550673:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094023.550685:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cb2ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb2f6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094023.550692:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1784094023.550704:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094023.550704:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024297600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094023.550708:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094023.550711:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094023.550729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094023.550762:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297600 00000100:00100000:3.0:1784094023.550767:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297600 00010000:00010000:3.0:1784094023.550782:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 19 pid: 5770 timeout: 1334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094023.550801:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1784094023.550806:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024297600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094023.550814:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094023.550818:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 19 pid: 5770 timeout: 1334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550824:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 19 pid: 5770 timeout: 1334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550832:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214cb2f6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb2ef expref: 19 pid: 5770 timeout: 1334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550842:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550849:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550857:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550865:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550869:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550873:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550876:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094023.550879:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550883:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550893:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094023.550899:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094023.550913:0:85348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550922:0:85348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094023.550929:0:85348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76600/0x9ce98053214cb2fd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094023.550935:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024297600:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094023.550944:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784094023.550955:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024297600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094024.169691:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094024.583164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094024.583215:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013786240 00000100:00100000:1.0:1784094024.583225:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013786240 00000100:00080000:3.0:1784094024.583257:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094024.583295:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 13 00000100:00100000:1.0:1784094024.583307:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:5559:x1870757013786240:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094024.583322:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094024.583326:0:5763:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cb2be) 00010000:00010000:1.0:1784094024.583328:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094024.583374:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:5559:x1870757013786240:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 70us (215us total) trans 0 rc 116/116 00000100:00100000:1.0:1784094024.583384:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 13 00000100:00100000:1.0:1784094024.681592:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024297728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094024.681681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094024.681746:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297728 00000100:00100000:0.0:1784094024.681755:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297728 00000100:00080000:3.0:1784094024.681785:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094024.681809:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1784094024.681820:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024297728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094024.681866:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094024.681921:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024297728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094024.681929:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1784094024.681948:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024297728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094024.915092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.915145:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013786368 00000100:00100000:0.0:1784094024.915154:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013786368 00000100:00100000:0.0:1784094024.915211:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 819 00000100:00100000:0.0:1784094024.915223:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:50838:x1870757013786368:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094024.915247:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094024.915328:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a8d expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.915389:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb30b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.915404:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.915417:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094024.915507:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094024.915512:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094024.915539:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb30b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.915575:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a8d expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.915592:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb30b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a8d expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.915601:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094024.915604:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094024.915608:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76800, rc 0) 00000100:00100000:0.0:1784094024.915667:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:50838:x1870757013786368:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 448us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094024.915675:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 819 00000100:00100000:3.0:1784094024.917895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.917942:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013786496 00000100:00100000:0.0:1784094024.917952:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013786496 00000100:00100000:0.0:1784094024.918008:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 820 00000100:00100000:0.0:1784094024.918019:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:50838:x1870757013786496:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094024.918036:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094024.918053:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a94 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918108:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918121:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918130:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918146:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918153:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918160:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918304:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918313:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918321:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094024.918356:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 512 00000004:00200000:0.0:1784094024.918360:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094024.918382:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918392:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918399:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918405:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918412:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.918416:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918448:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918461:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094024.918464:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.918482:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918489:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918502:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918509:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918515:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918521:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.918524:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918531:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918539:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6ba00) 00010000:00010000:0.0:1784094024.918632:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.918638:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918650:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918678:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a94 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918691:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a94 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.918698:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094024.918701:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094024.918703:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094024.918754:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:50838:x1870757013786496:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 737us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094024.918761:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 820 00000100:00100000:1.0:1784094024.921834:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.921913:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013786752 00000100:00100000:0.0:1784094024.921922:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013786752 00000100:00100000:0.0:1784094024.922014:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 821 00000100:00100000:0.0:1784094024.922025:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:50838:x1870757013786752:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094024.922080:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094024.922102:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a94 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.922117:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094024.922124:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094024.922142:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.922156:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.922163:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094024.936187:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967611 is committed 00000004:00010000:2.0:1784094024.936217:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b12e2754 reply state 000000003db810ea transno 4294967611 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094024.936240:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094024.936390:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00080000:2.0:1784094024.936523:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094024.936556:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:50838:x1870757013786752:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 14518us (14712us total) trans 4294967611 rc 0/0 00010000:00010000:0.0:1784094024.936560:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094024.936568:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 821 00010000:00010000:0.0:1784094024.936574:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.936583:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.936592:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.936597:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.936606:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.936623:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784094024.936627:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094024.936631:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.936638:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb32e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094024.959554:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.959661:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013786880 00000100:00100000:0.0:1784094024.959670:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013786880 00000100:00100000:0.0:1784094024.959949:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 822 00000100:00100000:0.0:1784094024.959961:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50842:x1870757013786880:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094024.959986:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094024.960123:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5a9b expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960192:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960206:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960218:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960233:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960240:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960247:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960658:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb34a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960668:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960676:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094024.960760:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094024.960764:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094024.960881:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb34a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960894:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960900:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960908:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960914:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.960918:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960926:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960937:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094024.960940:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.960944:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960950:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb33c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960961:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960972:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960979:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960983:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.960986:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.960992:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.961009:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6bf00) 00010000:00010000:0.0:1784094024.961012:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.961014:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.961019:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb343 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.961045:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a9b expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.961058:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb34a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a9b expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.961124:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094024.961127:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094024.961129:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784094024.961182:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:50842:x1870757013786880:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1224us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094024.961187:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 822 00000100:00100000:3.0:1784094024.962959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.963023:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013787136 00000100:00100000:0.0:1784094024.963031:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013787136 00000100:00100000:0.0:1784094024.963077:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 823 00000100:00100000:0.0:1784094024.963085:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:50842:x1870757013787136:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094024.963101:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094024.963115:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb351 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5aa2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.963367:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.963377:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.963387:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.963398:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.963405:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.963410:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094024.964156:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:0.0:1784094024.964390:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964399:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964406:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964463:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964469:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964474:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964480:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.964485:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964491:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964502:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094024.964504:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.964508:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964513:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb358 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094024.964528:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bf59d5c4 reply state 00000000fdaa5229 transno 4294967612 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094024.964536:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094024.964559:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb351 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aa2 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964573:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aa2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.964580:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784094024.964582:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094024.964584:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784094024.964643:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:50842:x1870757013787136:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1558us (1686us total) trans 4294967612 rc 0/0 00000100:00100000:0.0:1784094024.964651:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 823 00010000:00010000:0.0:1784094024.965845:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.965857:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.965863:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.965869:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.965872:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.965883:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.965896:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907202e6bc00) 00010000:00010000:0.0:1784094024.965898:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.965902:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.965909:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb35f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094024.967147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094024.967216:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013787392 00000100:00100000:2.0:1784094024.967226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013787392 00000100:00100000:2.0:1784094024.967288:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 824 00000100:00100000:2.0:1784094024.967299:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:50842:x1870757013787392:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:2.0:1784094024.967349:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094024.967370:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aa2 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.967386:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:2.0:1784094024.967395:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094024.967456:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.967473:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.967484:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094024.967622:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000759fab7d reply state 00000000cf0a7107 transno 4294967613 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094024.967632:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094024.967698:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:50842:x1870757013787392:12345-192.168.204.57@tcp:36:touch.0 Request processed in 402us (556us total) trans 4294967613 rc 0/0 00000100:00100000:2.0:1784094024.967703:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 824 00010000:00010000:2.0:1784094024.968613:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.968622:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.968628:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.968638:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094024.968642:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.968649:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.968660:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff90721a781e00) 00010000:00010000:2.0:1784094024.968663:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094024.968667:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.968673:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb374 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094024.968783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.968874:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013787520 00000100:00100000:0.0:1784094024.968880:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013787520 00000100:00100000:0.0:1784094024.968923:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 825 00000100:00100000:0.0:1784094024.968932:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:50842:x1870757013787520:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094024.968948:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094024.968961:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb37b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5aa9 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.969011:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb37b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aa9 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.969025:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb37b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aa9 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.969042:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094024.969045:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784094024.969048:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784094024.969081:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:50842:x1870757013787520:12345-192.168.204.57@tcp:101:touch.0 Request processed in 150us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094024.969088:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 825 00000100:00100000:1.0:1784094024.970668:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094024.970719:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013787648 00000100:00100000:2.0:1784094024.970731:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013787648 00000100:00080000:3.0:1784094024.970784:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094024.970785:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 412 00000100:00100000:2.0:1784094024.970797:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013787648:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:2.0:1784094024.971150:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013787648:12345-192.168.204.57@tcp:2:touch.0 Request processed in 354us (484us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1784094024.971158:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 412 00000100:00100000:1.0:1784094024.972303:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094024.972391:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013787904 00000100:00100000:3.0:1784094024.972397:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013787904 00000100:00100000:3.0:1784094024.972499:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 86 00000100:00100000:3.0:1784094024.972508:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:50842:x1870757013787904:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:3.0:1784094024.972760:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:50842:x1870757013787904:12345-192.168.204.57@tcp:35:touch.0 Request processed in 248us (454us total) trans 4294967614 rc 0/0 00000100:00100000:3.0:1784094024.972768:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 86 00000100:00100000:3.0:1784094024.991666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094024.991737:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013788032 00000100:00100000:0.0:1784094024.991746:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013788032 00000100:00100000:0.0:1784094024.991801:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 826 00000100:00100000:0.0:1784094024.991811:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:50846:x1870757013788032:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094024.991834:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094024.991862:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ab0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.991921:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.991933:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.991945:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.991957:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.991964:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.991970:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992079:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992088:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992094:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094024.992127:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00000004:00200000:0.0:1784094024.992132:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094024.992150:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992160:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992169:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992175:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992181:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992187:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.992191:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992198:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992220:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094024.992224:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.992228:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992234:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992247:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992253:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992258:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992263:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.992266:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992272:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992278:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907202e6bc00) 00010000:00010000:0.0:1784094024.992280:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.992283:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992288:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992313:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cb382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab0 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992330:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.992337:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094024.992340:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094024.992342:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784094024.992398:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:50846:x1870757013788032:12345-192.168.204.57@tcp:101:rm.0 Request processed in 588us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094024.992406:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 826 00000100:00100000:1.0:1784094024.994072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094024.994139:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013788160 00000100:00100000:2.0:1784094024.994145:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013788160 00000100:00100000:2.0:1784094024.994183:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 413 00000100:00100000:2.0:1784094024.994191:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013788160:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094024.994201:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094024.994214:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ab7 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094024.994232:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6a571d49, atime: 0x6a571d49, ctime: 0x6a571d49, blocks: 0x1 00010000:00010000:2.0:1784094024.994245:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1186s v=(0 0) 00010000:00010000:2.0:1784094024.994248:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094024.994253:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.994264:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.994272:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784094024.994308:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013788160:12345-192.168.204.57@tcp:101:rm.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094024.994312:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 413 00000100:00100000:1.0:1784094024.995633:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094024.995683:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013788416 00000100:00100000:2.0:1784094024.995689:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013788416 00000100:00100000:2.0:1784094024.995723:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 827 00000100:00100000:2.0:1784094024.995731:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:50846:x1870757013788416:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784094024.995774:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094024.995793:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab0 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995809:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb37b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aa9 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995823:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff907202e6b400) 00010000:00010000:2.0:1784094024.995831:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094024.995845:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995856:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995864:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995878:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995886:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995893:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995981:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995986:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.995992:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094024.996510:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off9856 00000004:00080000:2.0:1784094024.996520:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1186074097686ns, next at 1187074095721ns, rc = 0 00010000:00010000:2.0:1784094024.996583:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996592:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996599:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996605:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996610:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996616:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996634:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094024.996650:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996656:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996662:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996662:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094024.996672:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.996673:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996677:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996687:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094024.996690:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996693:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996707:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784094024.996711:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094024.996714:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996716:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996724:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb3b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996735:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff90721a781700) 00010000:00010000:0.0:1784094024.996739:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094024.996741:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996744:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996756:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996759:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb3ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996769:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996775:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094024.996778:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996782:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094024.996785:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.996786:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094024.996789:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094024.996798:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:2.0:1784094024.996801:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094024.996803:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094024.996808:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb3a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094024.996821:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d4db5d51 reply state 000000008d8aafed transno 4294967615 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094024.996828:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094024.996884:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:50846:x1870757013788416:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1154us (1251us total) trans 4294967615 rc 0/0 00000100:00100000:2.0:1784094024.996891:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 827 00010000:00010000:0.0:1784094024.997891:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.997901:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.997908:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.997913:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094024.997916:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.997922:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.997931:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff90721a781600) 00010000:00010000:0.0:1784094024.997934:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094024.997937:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094024.997953:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb3ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094025.193554:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094025.193562:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094025.193568:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094025.193614:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094025.193622:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.193634:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.193645:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094025.193674:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024297856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094025.193741:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094025.193789:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297856 00000100:00100000:2.0:1784094025.193793:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072091006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094025.193798:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297856 00000100:00100000:0.0:1784094025.193854:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1784094025.193866:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024297856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094025.193880:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094025.193895:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb3c1 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.193920:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.193932:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.193952:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784094025.194014:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024297856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094025.194022:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1784094025.194030:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024297856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094025.194046:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.194053:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094025.194074:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094025.194079:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.194087:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094025.328075:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.328141:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013788544 00000100:00100000:0.0:1784094025.328154:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013788544 00000100:00100000:0.0:1784094025.328227:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 828 00000100:00100000:0.0:1784094025.328239:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:50861:x1870757013788544:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094025.328272:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094025.328299:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5abe expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.328378:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.328396:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.328410:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094025.328516:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094025.328521:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094025.328550:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.328579:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5abe expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.328599:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5abe expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.328609:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.328613:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094025.328617:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784094025.328691:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:50861:x1870757013788544:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 454us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094025.328701:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 828 00000100:00100000:3.0:1784094025.329750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.329787:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013788800 00000100:00100000:0.0:1784094025.329792:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013788800 00000100:00100000:0.0:1784094025.329828:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 829 00000100:00100000:0.0:1784094025.329833:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:50861:x1870757013788800:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094025.329882:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094025.329899:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5abe expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.329912:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb34a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a9b expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.329923:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.329930:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094025.329944:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.329950:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.329956:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094025.339823:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e1a1de02 reply state 000000008230e80f transno 4294967616 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094025.339834:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967616 is committed 00000100:00100000:0.0:1784094025.339838:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1784094025.339867:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 68 committed 00000100:00100000:2.0:1784094025.340056:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094025.340082:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024297984:0@lo:6:osp-syn-0-0.0 00000004:00200000:0.0:1784094025.340083:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:2.0:1784094025.340194:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784094025.340204:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784094025.340232:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:50861:x1870757013788800:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 10392us (10478us total) trans 4294967616 rc 0/0 00000100:00100000:0.0:1784094025.340241:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 829 00000100:00100000:2.0:1784094025.340306:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024297984 00000100:00100000:2.0:1784094025.340317:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024297984 00000100:00100000:2.0:1784094025.340400:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1784094025.340414:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024297984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784094025.340480:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00010000:00010000:2.0:1784094025.340515:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340541:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340553:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094025.340559:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094025.340565:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340611:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340632:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 6 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094025.340649:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024298112:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094025.340722:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c480 going to sleep for 11 seconds 00010000:00010000:2.0:1784094025.340751:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340760:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340768:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340776:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094025.340782:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340791:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340811:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b300) 00010000:00010000:2.0:1784094025.340814:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094025.340820:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.340828:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb3dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.341750:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024298112:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094025.341775:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094025.342108:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.342162:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013788928 00000100:00100000:0.0:1784094025.342170:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013788928 00010000:00010000:0.0:1784094025.342208:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 7 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.342265:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 298 00000100:00100000:0.0:1784094025.342275:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013788928:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094025.342292:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094025.342298:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 7 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.342312:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 7 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.342344:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc19c75/0x9ce98053214cb39e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ab7 expref: 7 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.342361:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094025.342366:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094025.342372:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.342386:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.342418:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094025.342468:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.342484:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.342496:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.342497:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013788928:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 219us (386us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094025.342526:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.342527:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 298 00010000:00010000:2.0:1784094025.342565:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094025.342628:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094025.342644:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.342658:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094025.342665:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.342680:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.342700:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.342713:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb3e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.342768:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094025.342775:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094025.342784:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094025.343152:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024297984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2738us (2957us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1784094025.343167:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000004:00080000:0.0:1784094025.343211:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907103b65f80/2, rc 0, transno 4294967349 00000100:00100000:0.0:1784094025.343225:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024297984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784094025.361731:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.361779:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013789056 00000100:00100000:0.0:1784094025.361789:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013789056 00000100:00100000:0.0:1784094025.361857:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 830 00000100:00100000:0.0:1784094025.361869:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:50865:x1870757013789056:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094025.361893:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094025.361913:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb3eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ac5 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.361970:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.361985:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362007:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362026:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362034:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362042:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362484:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362499:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362507:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094025.362602:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094025.362606:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094025.362700:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362713:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362720:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362727:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362734:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.362737:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362745:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362757:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094025.362761:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.362765:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362776:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362788:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362794:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362801:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362806:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.362810:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362816:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362823:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6b900) 00010000:00010000:0.0:1784094025.362826:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.362829:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362835:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb3f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362861:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb3eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ac5 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362873:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ac5 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.362879:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.362881:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094025.362883:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094025.362942:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:50865:x1870757013789056:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1076us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094025.362951:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 830 00000100:00100000:3.0:1784094025.364170:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.364297:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013789312 00000100:00100000:0.0:1784094025.364304:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013789312 00000100:00100000:0.0:1784094025.364346:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 831 00000100:00100000:0.0:1784094025.364357:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:50865:x1870757013789312:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094025.364368:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094025.364385:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb407 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5acc expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.364693:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.364705:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.364714:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.364728:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.364735:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.364747:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094025.365632:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:0.0:1784094025.366002:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb41c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366013:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366023:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366056:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366063:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366070:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366076:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.366080:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366087:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366098:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.366101:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.366106:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366112:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb40e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094025.366126:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a188133d reply state 000000005dd87901 transno 4294967617 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.366135:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094025.366163:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb407 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5acc expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366180:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb41c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5acc expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.366188:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094025.366191:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094025.366194:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094025.366245:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:50865:x1870757013789312:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1890us (2076us total) trans 4294967617 rc 0/0 00000100:00100000:0.0:1784094025.366255:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 831 00010000:00010000:0.0:1784094025.367343:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.367353:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.367359:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.367369:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.367373:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.367379:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.367390:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907202e6b800) 00010000:00010000:0.0:1784094025.367393:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.367396:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.367403:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb415 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.367963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.368003:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013789568 00000100:00100000:0.0:1784094025.368011:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013789568 00000100:00100000:0.0:1784094025.368050:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 832 00000100:00100000:0.0:1784094025.368061:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:50865:x1870757013789568:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:0.0:1784094025.368102:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094025.368116:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb41c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5acc expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368127:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094025.368134:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094025.368158:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368171:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368180:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094025.368262:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bc3bcfcd reply state 0000000006e629b6 transno 4294967618 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.368269:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094025.368324:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:50865:x1870757013789568:12345-192.168.204.57@tcp:36:touch.0 Request processed in 265us (362us total) trans 4294967618 rc 0/0 00000100:00100000:0.0:1784094025.368331:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 832 00010000:00010000:0.0:1784094025.368769:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368778:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368784:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368790:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.368793:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368799:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368807:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094025.368810:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.368813:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.368819:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb42a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.370039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.370066:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013789696 00000100:00100000:2.0:1784094025.370074:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013789696 00000100:00100000:2.0:1784094025.370111:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 833 00000100:00100000:2.0:1784094025.370120:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:50865:x1870757013789696:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784094025.370136:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094025.370151:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb431 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ad3 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.370192:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb431 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ad3 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.370206:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb431 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ad3 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.370225:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784094025.370227:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784094025.370229:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784094025.370261:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:50865:x1870757013789696:12345-192.168.204.57@tcp:101:touch.0 Request processed in 143us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.370267:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 833 00000100:00100000:2.0:1784094025.371198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094025.371266:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013789824 00000100:00100000:3.0:1784094025.371273:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013789824 00000100:00080000:2.0:1784094025.371303:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094025.371323:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 415 00000100:00100000:3.0:1784094025.371332:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013789824:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:3.0:1784094025.371626:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013789824:12345-192.168.204.57@tcp:2:touch.0 Request processed in 294us (429us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1784094025.371633:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 415 00000100:00100000:3.0:1784094025.372574:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.372619:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013790080 00000100:00100000:0.0:1784094025.372625:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013790080 00000100:00100000:0.0:1784094025.372673:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 87 00000100:00100000:0.0:1784094025.372683:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:50865:x1870757013790080:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:0.0:1784094025.372920:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:50865:x1870757013790080:12345-192.168.204.57@tcp:35:touch.0 Request processed in 237us (345us total) trans 4294967619 rc 0/0 00000100:00100000:0.0:1784094025.372928:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 87 00000100:00100000:2.0:1784094025.392670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.392740:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013790208 00000100:00100000:0.0:1784094025.392748:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013790208 00000100:00100000:0.0:1784094025.392798:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 834 00000100:00100000:0.0:1784094025.392808:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:50869:x1870757013790208:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094025.392832:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094025.392852:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ada expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.392923:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.392937:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.392954:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.392969:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.392976:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.392983:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393082:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393091:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393097:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094025.393128:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x45:0x0]: returning size 0 00000004:00200000:0.0:1784094025.393132:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094025.393149:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393158:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393164:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393170:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393175:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393179:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.393182:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393189:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393200:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.393204:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.393208:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393214:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb43f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393227:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393232:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393236:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393239:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.393242:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393246:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393250:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907202e6be00) 00010000:00010000:0.0:1784094025.393252:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.393253:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393257:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393277:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ada expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393301:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ada expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.393309:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff90721a781400) 00010000:00010000:0.0:1784094025.393311:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094025.393314:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76e00, rc 0) 00000100:00100000:0.0:1784094025.393374:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:50869:x1870757013790208:12345-192.168.204.57@tcp:101:rm.0 Request processed in 568us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094025.393379:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 834 00000100:00100000:3.0:1784094025.394689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.394736:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013790336 00000100:00100000:2.0:1784094025.394742:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013790336 00000100:00100000:2.0:1784094025.394781:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 416 00000100:00100000:2.0:1784094025.394790:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013790336:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094025.394800:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094025.394813:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ae1 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094025.394840:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6a571d49, atime: 0x6a571d49, ctime: 0x6a571d49, blocks: 0x1 00010000:00010000:2.0:1784094025.394855:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=1186s v=(0 0) 00010000:00010000:2.0:1784094025.394860:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094025.394869:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.394885:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.394896:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094025.394933:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013790336:12345-192.168.204.57@tcp:101:rm.0 Request processed in 144us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.394944:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 416 00000100:00100000:3.0:1784094025.396252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.396296:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013790592 00000100:00100000:0.0:1784094025.396303:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013790592 00000100:00100000:0.0:1784094025.396391:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 835 00000100:00100000:0.0:1784094025.396397:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:50869:x1870757013790592:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094025.396470:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094025.396492:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb44d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ada expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396509:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cb431 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ad3 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396516:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff90721a781400) 00010000:00010000:0.0:1784094025.396522:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094025.396535:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396545:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396553:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396564:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396571:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396579:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396653:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396658:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.396663:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094025.397194:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off9856 00000004:00080000:0.0:1784094025.397216:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1186474793620ns, next at 1187474791263ns, rc = 0 00010000:00010000:0.0:1784094025.397269:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397276:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397282:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397289:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397295:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397302:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397333:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094025.397351:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397358:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397362:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397366:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.397370:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397377:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397385:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094025.397388:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094025.397392:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397397:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb469 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397410:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397416:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397448:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397452:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.397454:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397458:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397467:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.397469:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094025.397470:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.397474:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb45b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094025.397480:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000058e1127d reply state 0000000063bbb972 transno 4294967620 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.397484:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094025.397534:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:50869:x1870757013790592:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1135us (1284us total) trans 4294967620 rc 0/0 00000100:00100000:0.0:1784094025.397540:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 835 00010000:00010000:1.0:1784094025.397626:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094025.397632:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.397637:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094025.397640:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.397645:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.397654:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff907202e6b800) 00010000:00010000:1.0:1784094025.397656:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784094025.397659:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.397665:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.397678:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094025.397680:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094025.397682:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094025.398247:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.398257:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.398264:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.398270:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094025.398273:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.398280:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.398289:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907202e6b200) 00010000:00010000:2.0:1784094025.398292:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094025.398296:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.398302:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb462 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784094025.719320:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967348 is committed 00000001:00080000:0.0:1784094025.721892:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000001:00080000:0.0:1784094025.721906:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000100:00100000:3.0:1784094025.722482:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.722523:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013790720 00000100:00100000:0.0:1784094025.722533:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013790720 00000100:00100000:0.0:1784094025.722592:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 836 00000100:00100000:0.0:1784094025.722605:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:50883:x1870757013790720:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094025.722628:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094025.722647:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ae8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.722705:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb47e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.722725:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.722738:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094025.722793:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094025.722799:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094025.722824:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.722855:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae8 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.722869:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb47e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae8 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.722878:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094025.722881:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094025.722885:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784094025.722942:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:50883:x1870757013790720:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 341us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094025.722949:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 836 00000100:00100000:0.0:1784094025.723948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.724010:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013790976 00000100:00100000:1.0:1784094025.724016:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013790976 00000100:00100000:1.0:1784094025.724054:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 837 00000100:00100000:1.0:1784094025.724064:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710243aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:50883:x1870757013790976:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784094025.724096:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784094025.724111:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb47e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae8 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.724130:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ac5 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.724147:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b000) 00010000:00010000:1.0:1784094025.724156:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094025.724172:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.724182:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.724190:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094025.724405:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b08ad0eb reply state 00000000343f0ebc transno 4294967621 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094025.724414:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784094025.724462:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:1.0:1784094025.724519:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710243aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:50883:x1870757013790976:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 456us (572us total) trans 4294967621 rc 0/0 00000100:00100000:1.0:1784094025.724526:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 837 00010000:00010000:0.0:1784094025.725019:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.725028:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.725037:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.725043:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094025.725048:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.725055:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.725065:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12d00) 00010000:00010000:0.0:1784094025.725068:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094025.725072:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.725076:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb485 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.763770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.763819:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791104 00000100:00100000:1.0:1784094025.763828:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791104 00000100:00100000:1.0:1784094025.763873:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 838 00000100:00100000:1.0:1784094025.763882:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013791104:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094025.763958:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013791104:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094025.763963:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 838 00000100:00100000:3.0:1784094025.764626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.764675:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791232 00000100:00100000:2.0:1784094025.764680:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791232 00000100:00100000:2.0:1784094025.764711:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 417 00000100:00100000:2.0:1784094025.764719:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:50895:x1870757013791232:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094025.764977:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:50895:x1870757013791232:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 258us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.764998:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 417 00000100:00100000:3.0:1784094025.765564:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094025.765607:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791360 00000100:00100000:0.0:1784094025.765613:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791360 00000100:00100000:0.0:1784094025.765640:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 418 00000100:00100000:0.0:1784094025.765646:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50895:x1870757013791360:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094025.765797:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50895:x1870757013791360:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 150us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094025.765801:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 418 00000100:00100000:0.0:1784094025.766364:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.766397:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791488 00000100:00100000:2.0:1784094025.766400:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791488 00000100:00100000:2.0:1784094025.766450:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 839 00000100:00100000:2.0:1784094025.766459:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013791488:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094025.766679:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013791488:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 221us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.766687:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 839 00000100:00100000:3.0:1784094025.767735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.767774:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791616 00000100:00100000:1.0:1784094025.767779:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791616 00000100:00100000:1.0:1784094025.767805:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 840 00000100:00100000:1.0:1784094025.767812:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013791616:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094025.767871:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013791616:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094025.767879:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 840 00000100:00100000:3.0:1784094025.768501:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.768536:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791744 00000100:00100000:2.0:1784094025.768545:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791744 00000100:00100000:2.0:1784094025.768580:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 419 00000100:00100000:2.0:1784094025.768588:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:50895:x1870757013791744:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094025.768771:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:50895:x1870757013791744:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 184us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.768779:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 419 00000100:00100000:0.0:1784094025.769360:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.769393:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013791872 00000100:00100000:2.0:1784094025.769398:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013791872 00000100:00100000:2.0:1784094025.769443:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 420 00000100:00100000:2.0:1784094025.769449:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:50895:x1870757013791872:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094025.769631:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:50895:x1870757013791872:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 182us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.769636:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 420 00000100:00100000:3.0:1784094025.770139:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.770172:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792000 00000100:00100000:1.0:1784094025.770176:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792000 00000100:00100000:1.0:1784094025.770199:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 841 00000100:00100000:1.0:1784094025.770212:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013792000:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094025.770747:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:50895:x1870757013792000:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 542us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094025.770752:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 841 00000100:00100000:3.0:1784094025.789956:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.790009:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792128 00000100:00100000:2.0:1784094025.790017:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792128 00000100:00100000:2.0:1784094025.790061:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 842 00000100:00100000:2.0:1784094025.790069:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226370c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:50899:x1870757013792128:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094025.790085:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094025.790100:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb48c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5aef expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790144:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790157:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790168:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790183:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790191:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790203:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790489:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb4a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790495:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790500:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094025.790529:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:2.0:1784094025.790533:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094025.790557:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790566:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790570:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790574:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790578:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094025.790581:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790586:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790597:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:2.0:1784094025.790600:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094025.790604:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790620:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790631:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790637:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790642:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790648:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094025.790651:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790657:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790664:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff90721a781c00) 00010000:00010000:2.0:1784094025.790667:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094025.790670:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790675:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb49a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790701:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb48c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aef expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790710:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aef expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.790715:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784094025.790717:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094025.790718:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094025.790763:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226370c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:50899:x1870757013792128:12345-192.168.204.57@tcp:101:dd.0 Request processed in 695us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.790769:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 842 00000100:00100000:0.0:1784094025.791933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.792003:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792384 00000100:00100000:1.0:1784094025.792009:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792384 00000100:00100000:1.0:1784094025.792042:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 843 00000100:00100000:1.0:1784094025.792057:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:50899:x1870757013792384:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784094025.792069:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094025.792080:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb4a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5af6 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792160:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792171:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792185:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792213:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792222:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792232:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094025.792662:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:1.0:1784094025.792806:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb4bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792816:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb4bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792823:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb4bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792849:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792855:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792861:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792866:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094025.792869:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792879:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792888:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff90721a781300) 00010000:00010000:1.0:1784094025.792890:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094025.792895:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792901:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb4af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094025.792910:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bd9eb8dc reply state 00000000d9ce514b transno 4294967622 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094025.792919:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784094025.792938:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb4a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5af6 expref: 15 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792950:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb4bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5af6 expref: 14 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.792956:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094025.792959:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094025.792961:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784094025.793017:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+15:50899:x1870757013792384:12345-192.168.204.57@tcp:101:dd.0 Request processed in 960us (1084us total) trans 4294967622 rc 0/0 00000100:00100000:1.0:1784094025.793024:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 843 00010000:00010000:2.0:1784094025.793651:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.793660:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.793666:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.793670:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094025.793674:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.793679:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.793686:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907219c12b00) 00010000:00010000:2.0:1784094025.793689:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094025.793693:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.793698:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb4b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.796190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094025.796281:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792512 00000100:00100000:3.0:1784094025.796289:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792512 00000100:00100000:3.0:1784094025.796334:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 421 00000100:00100000:3.0:1784094025.796342:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:50899:x1870757013792512:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784094025.796357:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094025.796374:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5afd expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784094025.796396:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784094025.796412:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=1186s v=(0 0) 00010000:00010000:3.0:1784094025.796417:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094025.796444:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.796459:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.796470:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094025.796519:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:50899:x1870757013792512:12345-192.168.204.57@tcp:101:dd.0 Request processed in 178us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094025.796525:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 421 00000100:00100000:3.0:1784094025.805016:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.805088:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792640 00000100:00100000:1.0:1784094025.805098:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792640 00002000:00100000:1.0:1784094025.805145:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff907103b5ce00 x1870757013792640/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:346/0 lens 488/0 e 0 to 0 dl 1784094036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784094025.805157:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907103b5ce00 with x1870757013792640 ext(0->1048575) 00002000:00010000:1.0:1784094025.805162:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907103b5ce00 00000100:00100000:1.0:1784094025.805187:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 20 00000100:00100000:1.0:1784094025.805198:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013792640:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784094025.811217:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013792640:12345-192.168.204.57@tcp:4:dd.0 Request processed in 6012us (6199us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784094025.811231:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 20 00002000:00100000:1.0:1784094025.811243:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff907103b5ce00 x1870757013792640/t4294967350(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:346/0 lens 488/448 e 0 to 0 dl 1784094036 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784094025.811253:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907103b5ce00 with x1870757013792640 ext(0->1048575) 00002000:00010000:1.0:1784094025.811258:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907103b5ce00 00000100:00100000:0.0:1784094025.812404:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.812455:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792768 00000100:00100000:1.0:1784094025.812462:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792768 00000100:00100000:1.0:1784094025.812502:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 844 00000100:00100000:1.0:1784094025.812511:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+14:50899:x1870757013792768:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:3.0:1784094025.820414:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967620 is committed 00000004:00080000:3.0:1784094025.820452:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 67 committed 00000001:00080000:3.0:1784094025.820485:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967622 is committed 00000100:00100000:1.0:1784094025.820486:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:50899:x1870757013792768:12345-192.168.204.57@tcp:44:dd.0 Request processed in 7972us (8079us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094025.820495:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 844 00000100:00100000:1.0:1784094025.820590:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024298240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094025.820627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094025.820663:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024298240 00000100:00100000:2.0:1784094025.820671:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024298240 00000100:00080000:3.0:1784094025.820719:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094025.820726:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1784094025.820738:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024298240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784094025.820764:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00010000:00010000:2.0:1784094025.820786:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.820808:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 5 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.820817:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094025.820821:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094025.820827:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.820854:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 5 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094025.820867:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 5 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094025.820886:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024298368:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094025.820933:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484480 going to sleep for 11 seconds 00000100:00100000:0.0:1784094025.821448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094025.821495:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013792896 00000100:00100000:2.0:1784094025.821500:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013792896 00000100:00100000:2.0:1784094025.821531:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 423 00000100:00100000:2.0:1784094025.821539:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013792896:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:1.0:1784094025.821691:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024298368:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784094025.821710:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094025.821834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094025.821878:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793024 00000100:00100000:1.0:1784094025.821883:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793024 00010000:00010000:1.0:1784094025.821907:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 6 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094025.821935:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 299 00000100:00100000:1.0:1784094025.821944:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013793024:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094025.821954:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094025.821961:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 6 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.821973:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 6 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.822006:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b152f10/0x9ce98053214cb454 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ae1 expref: 6 pid: 6573 timeout: 1286 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.822022:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094025.822026:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094025.822032:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.822041:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094025.822064:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094025.822085:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094025.822097:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013793024:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 153us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1784094025.822099:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094025.822113:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 299 00010000:00010000:0.0:1784094025.822114:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.822122:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094025.822138:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094025.822156:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094025.822165:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.822177:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094025.822182:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.822193:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.822207:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.822216:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eceb1cce/0x9ce98053214cb4d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094025.822235:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094025.822238:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094025.822240:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094025.822747:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024298240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2012us (2118us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1784094025.822753:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000004:00080000:2.0:1784094025.822891:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907103b65180/2, rc 0, transno 4294967349 00000100:00100000:2.0:1784094025.822898:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024298240:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1784094025.830131:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000100:00100000:2.0:1784094025.830212:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013792896:12345-192.168.204.57@tcp:16:dd.0 Request processed in 8669us (8758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094025.830222:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 423 00000100:00100000:0.0:1784094025.831462:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094025.831501:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793280 00000100:00100000:3.0:1784094025.831509:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793280 00000100:00100000:3.0:1784094025.831544:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 88 00000100:00100000:3.0:1784094025.831550:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:50899:x1870757013793280:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:3.0:1784094025.831907:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:50899:x1870757013793280:12345-192.168.204.57@tcp:35:dd.0 Request processed in 356us (445us total) trans 4294967623 rc 0/0 00000100:00100000:3.0:1784094025.831918:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 88 00010000:00010000:2.0:1784094026.217551:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784094026.263871:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967623 is committed 00000004:00080000:3.0:1784094026.666132:0:85740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1187743707482ns, next at 1187074095721ns, rc = 0 00000004:00080000:3.0:1784094026.666234:0:85740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1187743811479ns, next at 1187474791263ns, rc = 0 00000004:00080000:2.0:1784094026.667053:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00000004:00080000:2.0:1784094026.667572:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 68 committed 00000001:00080000:0.0:1784094027.067591:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000100:00100000:0.0:1784094027.097142:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094027.097205:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793408 00000100:00100000:2.0:1784094027.097212:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793408 00000100:00080000:3.0:1784094027.097257:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094027.097279:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 845 00000100:00100000:2.0:1784094027.097287:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013793408:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094027.097355:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013793408:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.097361:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 845 00000100:00100000:0.0:1784094027.098103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094027.098131:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793536 00000100:00100000:3.0:1784094027.098135:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793536 00000100:00100000:3.0:1784094027.098179:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 424 00000100:00080000:2.0:1784094027.098186:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094027.098190:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:51091:x1870757013793536:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094027.098519:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:51091:x1870757013793536:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 331us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094027.098525:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 424 00000100:00100000:0.0:1784094027.099069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094027.099115:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793664 00000100:00100000:2.0:1784094027.099119:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793664 00000100:00080000:3.0:1784094027.099141:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094027.099155:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 425 00000100:00100000:2.0:1784094027.099163:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:51091:x1870757013793664:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094027.099411:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:51091:x1870757013793664:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 247us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.099438:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 425 00000100:00100000:2.0:1784094027.099997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094027.100034:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793792 00000100:00100000:1.0:1784094027.100038:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793792 00000100:00100000:1.0:1784094027.100062:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 846 00000100:00100000:1.0:1784094027.100068:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013793792:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094027.100307:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013793792:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 239us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094027.100313:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 846 00000100:00100000:1.0:1784094027.101310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094027.101354:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013793920 00000100:00100000:2.0:1784094027.101359:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013793920 00000100:00100000:2.0:1784094027.101391:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 847 00000100:00100000:2.0:1784094027.101398:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013793920:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094027.101474:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013793920:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.101481:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 847 00000100:00100000:0.0:1784094027.102018:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094027.102061:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794048 00000100:00100000:2.0:1784094027.102066:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794048 00000100:00100000:2.0:1784094027.102097:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 426 00000100:00100000:2.0:1784094027.102111:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:51091:x1870757013794048:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094027.102412:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:51091:x1870757013794048:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 306us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.102441:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 426 00000100:00100000:2.0:1784094027.103670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094027.103697:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794176 00000100:00100000:3.0:1784094027.103703:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794176 00000100:00100000:3.0:1784094027.103737:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 427 00000100:00100000:3.0:1784094027.103745:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:51091:x1870757013794176:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094027.103989:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:51091:x1870757013794176:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 244us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094027.103997:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 427 00000100:00100000:0.0:1784094027.104535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094027.104580:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794304 00000100:00100000:2.0:1784094027.104586:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794304 00000100:00100000:2.0:1784094027.104621:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 848 00000100:00100000:2.0:1784094027.104630:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013794304:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094027.104951:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:51091:x1870757013794304:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 323us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.104972:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 848 00000100:00100000:0.0:1784094027.125147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094027.125209:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794560 00000100:00100000:1.0:1784094027.125219:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794560 00000100:00100000:1.0:1784094027.125270:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 849 00000100:00100000:1.0:1784094027.125282:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51095:x1870757013794560:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784094027.125328:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094027.125351:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb4bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5af6 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125363:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094027.125371:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094027.125387:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125400:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125414:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125443:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125448:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125452:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125720:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125729:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.125736:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094027.126402:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 64 off9920 00000004:00080000:1.0:1784094027.126409:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1188203986624ns, next at 1189203984975ns, rc = 0 00010000:00010000:1.0:1784094027.126535:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126543:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126552:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126557:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126561:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126564:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126578:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094027.126594:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126597:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126601:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126604:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094027.126605:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094027.126611:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126613:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126619:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126631:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094027.126633:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784094027.126637:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784094027.126640:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126643:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126645:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb4e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126659:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126668:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126670:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff907219c12b00) 00010000:00010000:0.0:1784094027.126675:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784094027.126679:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126682:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126686:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb4ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126697:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126705:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094027.126705:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094027.126708:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094027.126711:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.126711:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094027.126720:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126728:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff90721a781300) 00010000:00010000:1.0:1784094027.126731:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094027.126734:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.126739:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb4d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094027.126749:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004ef14a1e reply state 000000009b469e4c transno 4294967624 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094027.126763:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094027.126824:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:51095:x1870757013794560:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1545us (1683us total) trans 4294967624 rc 0/0 00000100:00100000:1.0:1784094027.126833:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 849 00010000:00010000:0.0:1784094027.127501:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.127510:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.127517:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.127526:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094027.127529:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.127535:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.127545:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907219c12d00) 00010000:00010000:0.0:1784094027.127548:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094027.127551:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.127555:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb4e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094027.128077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094027.128118:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794688 00000100:00100000:2.0:1784094027.128123:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794688 00000100:00100000:2.0:1784094027.128159:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 780 00000100:00100000:2.0:1784094027.128167:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013794688:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094027.128208:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013794688:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 42us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.128215:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 780 00010000:00010000:1.0:1784094027.241628:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094027.753543:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024298880:0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.753558:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024298496:0@lo:400:kworker.0 00000100:00100000:2.0:1784094027.753608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094027.753612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094027.753668:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094027.753673:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024299008:0@lo:400:kworker.0 00000100:00100000:2.0:1784094027.753675:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024298752:0@lo:400:kworker.0 00000100:00100000:2.0:1784094027.753710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094027.753722:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024298624:0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.753729:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024298496 00000100:00100000:1.0:1784094027.753736:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024298496 00000100:00100000:2.0:1784094027.753744:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024298880 00000100:00100000:2.0:1784094027.753748:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024298880 00000100:00100000:0.0:1784094027.753769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094027.753798:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024299136:0@lo:400:kworker.0 00000100:00100000:2.0:1784094027.753799:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1784094027.753805:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1784094027.753810:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024298880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.753817:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024298496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094027.753829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094027.753872:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024298880:12345-0@lo:400:kworker.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094027.753876:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024298752 00000100:00100000:2.0:1784094027.753879:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1784094027.753882:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024298752 00000100:00100000:1.0:1784094027.753884:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024298496:12345-0@lo:400:kworker.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094027.753892:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1784094027.753899:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299136 00000100:00100000:2.0:1784094027.753903:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299136 00000100:00100000:0.0:1784094027.753931:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024298624 00000100:00100000:1.0:1784094027.753932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094027.753938:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024298624 00000100:00100000:2.0:1784094027.753939:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1784094027.753964:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024299136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.753984:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024298496:0@lo:400:kworker.0 00000100:00100000:0.0:1784094027.753989:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299008 00000100:00100000:0.0:1784094027.753994:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299008 00000100:00100000:2.0:1784094027.754008:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024299136:12345-0@lo:400:kworker.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.754021:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1784094027.754021:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:0.0:1784094027.754031:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1784094027.754037:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024298752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094027.754044:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094027.754055:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1784094027.754066:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024299008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.754084:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024298752:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094027.754092:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:0.0:1784094027.754102:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024298624:12345-0@lo:400:kworker.0 Request processed in 61us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094027.754110:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1784094027.754118:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024299008:12345-0@lo:400:kworker.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094027.754126:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00080000:2.0:1784094027.754151:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094027.754154:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024299008:0@lo:400:kworker.0 00000100:00080000:2.0:1784094027.754156:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094027.754163:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094027.754212:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024298752:0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.754218:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024298624:0@lo:400:kworker.0 00000100:00100000:2.0:1784094027.754229:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:2.0:1784094027.754236:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907103b65f80, transno 4294967349 00000100:00100000:1.0:1784094027.754237:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:1.0:1784094027.754241:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907103b65180, transno 4294967349 00000100:00100000:2.0:1784094027.754250:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024298880:0@lo:400:kworker.0 00000100:00100000:1.0:1784094027.754255:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024299136:0@lo:400:kworker.0 00000100:00100000:3.0:1784094027.754505:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024299264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094027.754541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094027.754582:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299264 00000100:00100000:1.0:1784094027.754587:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299264 00000100:00100000:1.0:1784094027.754619:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1784094027.754626:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024299264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094027.754645:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094027.754696:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024299264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094027.754705:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1784094027.754722:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024299264:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1784094027.800324:0:85884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1188877899616ns, next at 1189203984975ns, rc = 0 00000004:00080000:2.0:1784094027.811998:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000001:00080000:2.0:1784094027.812038:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967624 is committed 00000004:00080000:2.0:1784094027.812045:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00000100:00100000:2.0:1784094027.812111:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024299392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784094027.812224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094027.812270:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299392 00000100:00100000:3.0:1784094027.812281:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299392 00000100:00100000:3.0:1784094027.812339:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1784094027.812350:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024299392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784094027.812383:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00010000:00010000:3.0:1784094027.812413:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094027.812465:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094027.812477:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1784094027.812482:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094027.812488:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094027.812518:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094027.812536:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 5 pid: 53396 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094027.812548:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024299520:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094027.812621:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094027.813688:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024299520:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094027.813713:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094027.813981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094027.814044:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794816 00000100:00100000:1.0:1784094027.814052:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794816 00010000:00010000:1.0:1784094027.814086:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 6 pid: 53396 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094027.814123:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 300 00000100:00100000:1.0:1784094027.814134:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013794816:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094027.814146:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094027.814154:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 6 pid: 53396 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.814166:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 6 pid: 53396 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.814191:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cb4cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5afd expref: 6 pid: 53396 timeout: 1288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.814207:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094027.814211:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094027.814218:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.814229:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094027.814254:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094027.814279:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094027.814291:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094027.814303:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094027.814309:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013794816:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 167us (330us total) trans 0 rc 0/0 00010000:00010000:3.0:1784094027.814315:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094027.814326:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 300 00010000:00010000:3.0:1784094027.814341:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094027.814365:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094027.814373:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.814386:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094027.814393:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.814407:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.814473:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.814482:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f1a097/0x9ce98053214cb4f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094027.814515:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094027.814517:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094027.814520:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094027.814989:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024299392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2640us (2764us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1784094027.814999:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000004:00080000:2.0:1784094027.815037:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907226113800/2, rc 0, transno 4294967351 00000100:00100000:2.0:1784094027.815054:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024299392:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1784094027.815387:0:85884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1188892964058ns, next at 1187474791263ns, rc = 0 00000004:00080000:2.0:1784094027.816727:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 69 committed 00010000:00010000:0.0:1784094028.265588:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094029.289600:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094029.801670:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024299648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094029.801764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094029.801806:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299648 00000100:00100000:0.0:1784094029.801813:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299648 00000100:00080000:2.0:1784094029.801855:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094029.801878:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1784094029.801891:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024299648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094029.801941:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784094029.801997:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024299648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094029.802005:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1784094029.802043:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024299648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094030.313599:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094031.337591:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094032.248198:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094032.248234:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795072 00000100:00100000:2.0:1784094032.248240:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094032.248246:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795072 00000100:00100000:2.0:1784094032.248275:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094032.248284:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013794944 00000100:00100000:0.0:1784094032.248290:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013794944 00000100:00100000:2.0:1784094032.248307:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094032.248323:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00080000:2.0:1784094032.248332:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094032.248338:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013795072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094032.248341:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 782 00000100:00100000:2.0:1784094032.248350:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795200 00000100:00100000:2.0:1784094032.248357:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795200 00000100:00100000:0.0:1784094032.248357:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013794944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094032.248360:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795328 00000100:00100000:3.0:1784094032.248367:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795328 00000100:00100000:3.0:1784094032.248403:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:3.0:1784094032.248416:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013795328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094032.248418:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013794944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094032.248419:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013795072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094032.248444:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 597 00000100:00100000:1.0:1784094032.248450:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00100000:2.0:1784094032.248461:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013795200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094032.248468:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 782 00000100:00100000:3.0:1784094032.248491:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013795328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094032.248504:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:2.0:1784094032.248504:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013795200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094032.248515:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 597 00000100:00080000:3.0:1784094032.248546:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094032.248551:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094032.361619:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094032.370122:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000100:00100000:1.0:1784094032.873624:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024299776:0@lo:400:kworker.0 00000100:00100000:2.0:1784094032.873677:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024299904:0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.873703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094032.873722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094032.873764:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024300416:0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.873781:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024300288:0@lo:400:kworker.0 00000100:00100000:2.0:1784094032.873794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094032.873797:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024300160:0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.873816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094032.873822:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784094032.873831:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024300032:0@lo:400:kworker.0 00000100:00100000:0.0:1784094032.873840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094032.873869:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299776 00000100:00100000:1.0:1784094032.873876:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299776 00000100:00100000:2.0:1784094032.873877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094032.873903:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024299904 00000100:00100000:2.0:1784094032.873905:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024300544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094032.873909:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024299904 00000100:00100000:1.0:1784094032.873926:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1784094032.873940:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024299776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094032.873946:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300288 00000100:00100000:2.0:1784094032.873951:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094032.873952:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300288 00000100:00100000:0.0:1784094032.873990:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300032 00000100:00100000:0.0:1784094032.873994:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300032 00000100:00100000:1.0:1784094032.873999:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024299776:12345-0@lo:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094032.874006:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1784094032.874011:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1784094032.874020:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024299904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.874051:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300544 00000100:00100000:1.0:1784094032.874055:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300544 00000100:00100000:2.0:1784094032.874081:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024299904:12345-0@lo:400:kworker.0 Request processed in 56us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094032.874088:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1784094032.874096:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024300544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094032.874123:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094032.874160:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024300544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094032.874167:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1784094032.874211:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300416 00000100:00100000:3.0:1784094032.874216:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300416 00000100:00100000:3.0:1784094032.874241:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300160 00000100:00100000:3.0:1784094032.874244:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300160 00000100:00100000:3.0:1784094032.874263:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1784094032.874269:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094032.874305:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024300416:12345-0@lo:400:kworker.0 Request processed in 36us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094032.874311:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1784094032.874322:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1784094032.874328:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024300160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094032.874357:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024300160:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094032.874363:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1784094032.874472:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1784094032.874479:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1784094032.874490:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024300288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094032.874495:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1784094032.874507:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024300032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.874521:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024300288:12345-0@lo:400:kworker.0 Request processed in 33us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094032.874528:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1784094032.874554:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024300032:12345-0@lo:400:kworker.0 Request processed in 49us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094032.874562:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1784094032.874570:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024300288:0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.874582:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024299776:0@lo:400:kworker.0 00000100:00100000:2.0:1784094032.874608:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024300032:0@lo:400:kworker.0 00000100:00100000:2.0:1784094032.874627:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024300544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094032.874640:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024299904:0@lo:400:kworker.0 00000100:00080000:1.0:1784094032.874640:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094032.874648:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094032.874654:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094032.874659:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024300416:0@lo:400:kworker.0 00000100:00100000:1.0:1784094032.874688:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:1.0:1784094032.874694:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907226113800, transno 4294967351 00000100:00100000:1.0:1784094032.874709:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024300160:0@lo:400:kworker.0 00010000:00010000:0.0:1784094033.385531:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094034.409599:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094034.921599:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024300672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094034.921688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094034.921750:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300672 00000100:00100000:3.0:1784094034.921761:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300672 00000100:00080000:2.0:1784094034.921795:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094034.921846:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1784094034.921860:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024300672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094034.921890:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094034.921955:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024300672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094034.921961:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1784094034.922017:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024300672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094035.433579:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094036.457570:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094037.368259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094037.368296:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094037.368316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094037.368322:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795584 00000100:00100000:2.0:1784094037.368335:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795584 00000100:00100000:1.0:1784094037.368346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094037.368355:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795456 00000100:00100000:0.0:1784094037.368362:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795456 00000100:00100000:3.0:1784094037.368372:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795840 00000100:00100000:1.0:1784094037.368374:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795712 00000100:00100000:3.0:1784094037.368378:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795840 00000100:00100000:1.0:1784094037.368378:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795712 00000100:00100000:2.0:1784094037.368411:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 808 00000100:00100000:0.0:1784094037.368412:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 784 00000100:00100000:1.0:1784094037.368452:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:2.0:1784094037.368462:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013795584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094037.368463:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 601 00000100:00100000:1.0:1784094037.368464:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013795712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094037.368464:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013795456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094037.368475:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013795840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094037.368534:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013795712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094037.368543:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013795840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094037.368544:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013795456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094037.368545:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013795584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 121us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094037.368549:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:2.0:1784094037.368564:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 808 00000100:00100000:3.0:1784094037.368567:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 601 00000100:00100000:0.0:1784094037.368567:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 784 00000100:00080000:3.0:1784094037.368611:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094037.368616:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094037.368619:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094037.481556:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094037.993599:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094037.993620:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024301056:0@lo:400:kworker.0 00000100:00100000:1.0:1784094037.993668:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024301184:0@lo:400:kworker.0 00000100:00100000:0.0:1784094037.993671:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024300928:0@lo:400:kworker.0 00000100:00100000:2.0:1784094037.993687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094037.993700:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024301440:0@lo:400:kworker.0 00000100:00100000:1.0:1784094037.993722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094037.993726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094037.993749:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024300800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094037.993778:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024301312:0@lo:400:kworker.0 00000100:00100000:1.0:1784094037.993797:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301056 00000100:00100000:2.0:1784094037.993798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094037.993806:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301056 00000100:00100000:0.0:1784094037.993812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094037.993835:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024301568:0@lo:400:kworker.0 00000100:00100000:1.0:1784094037.993857:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301184 00000100:00100000:1.0:1784094037.993861:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301184 00000100:00100000:2.0:1784094037.993868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094037.993870:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301312 00000100:00100000:0.0:1784094037.993876:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301312 00000100:00100000:1.0:1784094037.993914:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1784094037.993921:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301568 00000100:00100000:0.0:1784094037.993925:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301568 00000100:00100000:2.0:1784094037.993929:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1784094037.993931:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024301056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094037.993943:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024301184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094037.993956:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1784094037.993965:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024301312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094037.993999:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024301056:12345-0@lo:400:kworker.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094037.994004:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024301184:12345-0@lo:400:kworker.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094037.994009:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1784094037.994017:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1784094037.994018:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024301312:12345-0@lo:400:kworker.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094037.994026:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1784094037.994046:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300800 00000100:00100000:2.0:1784094037.994050:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300800 00000100:00100000:2.0:1784094037.994079:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1784094037.994084:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024300928 00000100:00100000:2.0:1784094037.994085:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024300800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094037.994088:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024300928 00000100:00100000:3.0:1784094037.994096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784094037.994108:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094037.994120:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1784094037.994128:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024300928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094037.994146:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024300800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094037.994153:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1784094037.994171:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024300928:12345-0@lo:400:kworker.0 Request processed in 43us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094037.994181:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1784094037.994182:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1784094037.994195:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024301568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784094037.994216:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094037.994221:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094037.994224:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094037.994225:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024301056:0@lo:400:kworker.0 00000100:00100000:0.0:1784094037.994245:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024301568:12345-0@lo:400:kworker.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094037.994248:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024300800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094037.994256:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301440 00000100:00100000:0.0:1784094037.994260:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1784094037.994261:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301440 00000100:00100000:3.0:1784094037.994280:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024301568:0@lo:400:kworker.0 00000100:00100000:2.0:1784094037.994297:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1784094037.994307:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024301440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094037.994326:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024300928:0@lo:400:kworker.0 00000100:00100000:3.0:1784094037.994336:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024301184:0@lo:400:kworker.0 00000100:00100000:0.0:1784094037.994344:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024301312:0@lo:400:kworker.0 00000100:00100000:2.0:1784094037.994355:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024301440:12345-0@lo:400:kworker.0 Request processed in 50us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094037.994361:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00080000:0.0:1784094037.994375:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094037.994388:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024301440:0@lo:400:kworker.0 00010000:00010000:1.0:1784094038.505594:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094039.529543:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094040.041616:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024301696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094040.041680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094040.041728:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301696 00000100:00100000:1.0:1784094040.041737:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301696 00000100:00080000:0.0:1784094040.041775:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094040.041795:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1784094040.041805:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024301696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094040.041838:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094040.041881:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024301696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094040.041886:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1784094040.041918:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024301696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094040.553575:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094041.577511:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094042.488262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094042.488299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094042.488321:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094042.488338:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094042.488362:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796352 00000100:00100000:1.0:1784094042.488362:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013795968 00000100:00100000:3.0:1784094042.488374:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796352 00000100:00100000:1.0:1784094042.488374:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013795968 00000100:00100000:0.0:1784094042.488383:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796224 00000100:00100000:0.0:1784094042.488387:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796224 00000100:00100000:2.0:1784094042.488408:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796096 00000100:00100000:2.0:1784094042.488457:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796096 00000100:00100000:1.0:1784094042.488469:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 786 00000100:00100000:3.0:1784094042.488470:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 604 00000100:00100000:0.0:1784094042.488479:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 605 00000100:00100000:3.0:1784094042.488485:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013796352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094042.488485:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013795968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094042.488490:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013796224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094042.488541:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 812 00000100:00100000:0.0:1784094042.488552:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013796224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094042.488560:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013796352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094042.488561:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013795968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094042.488564:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013796096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094042.488588:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 605 00000100:00100000:1.0:1784094042.488589:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 786 00000100:00100000:3.0:1784094042.488597:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 604 00000100:00080000:3.0:1784094042.488636:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094042.488642:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094042.488644:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094042.488664:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013796096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 101us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094042.488687:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 812 00010000:00010000:1.0:1784094042.601577:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094043.113561:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094043.113588:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024301824:0@lo:400:kworker.0 00000100:00100000:0.0:1784094043.113619:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024302336:0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.113639:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024302080:0@lo:400:kworker.0 00000100:00100000:3.0:1784094043.113680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094043.113688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094043.113729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094043.113774:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024302464:0@lo:400:kworker.0 00000100:00100000:3.0:1784094043.113777:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024302208:0@lo:400:kworker.0 00000100:00100000:0.0:1784094043.113787:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302336 00000100:00100000:0.0:1784094043.113795:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302336 00000100:00100000:2.0:1784094043.113816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094043.113829:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024301952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094043.113876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094043.113881:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1784094043.113897:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024302336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.113906:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302080 00000100:00100000:3.0:1784094043.113914:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024302592:0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.113915:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302080 00000100:00100000:3.0:1784094043.113962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094043.113976:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024302336:12345-0@lo:400:kworker.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094043.113990:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1784094043.113998:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302464 00000100:00100000:2.0:1784094043.114003:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302464 00000100:00100000:1.0:1784094043.114018:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302592 00000100:00100000:1.0:1784094043.114025:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302592 00000100:00100000:3.0:1784094043.114036:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301824 00000100:00100000:3.0:1784094043.114041:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301824 00000100:00100000:2.0:1784094043.114045:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:2.0:1784094043.114057:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024302080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094043.114069:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024302336:0@lo:400:kworker.0 00000100:00100000:1.0:1784094043.114075:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1784094043.114086:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1784094043.114086:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024302592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094043.114102:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024301824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.114118:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024302080:12345-0@lo:400:kworker.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094043.114125:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:2.0:1784094043.114151:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1784094043.114162:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024301824:12345-0@lo:400:kworker.0 Request processed in 64us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094043.114165:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024302592:12345-0@lo:400:kworker.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094043.114172:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024302464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094043.114180:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1784094043.114189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094043.114194:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1784094043.114243:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024301952 00000100:00100000:2.0:1784094043.114248:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024302464:12345-0@lo:400:kworker.0 Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094043.114249:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024301824:0@lo:400:kworker.0 00000100:00100000:1.0:1784094043.114250:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024301952 00000100:00100000:3.0:1784094043.114257:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024302592:0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.114276:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:2.0:1784094043.114307:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302208 00000100:00100000:1.0:1784094043.114311:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1784094043.114314:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302208 00000100:00100000:1.0:1784094043.114322:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024301952:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094043.114337:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094043.114348:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094043.114354:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00080000:0.0:1784094043.114355:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784094043.114357:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094043.114360:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024302080:0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.114372:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024302208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094043.114391:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024302464:0@lo:400:kworker.0 00000100:00100000:2.0:1784094043.114476:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024302208:12345-0@lo:400:kworker.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094043.114488:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1784094043.114492:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024302208:0@lo:400:kworker.0 00000100:00100000:1.0:1784094043.114497:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024301952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094043.114506:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024301952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094043.114512:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00010000:00010000:0.0:1784094043.625584:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094043.703294:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094043.703359:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796480 00000100:00100000:0.0:1784094043.703369:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796480 00000100:00100000:2.0:1784094043.703447:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 850 00000100:00100000:2.0:1784094043.703459:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013796480:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094043.703573:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013796480:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094043.703581:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 850 00000100:00100000:1.0:1784094043.704486:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094043.704556:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796608 00000100:00100000:3.0:1784094043.704564:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796608 00000100:00100000:3.0:1784094043.704606:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 429 00000100:00100000:3.0:1784094043.704615:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013796608:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094043.704988:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013796608:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 373us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094043.704995:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 429 00000100:00100000:0.0:1784094043.705728:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094043.705796:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796736 00000100:00100000:2.0:1784094043.705806:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796736 00000100:00100000:2.0:1784094043.705867:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 430 00000100:00100000:2.0:1784094043.705877:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013796736:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094043.706215:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013796736:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 339us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094043.706224:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 430 00000100:00100000:2.0:1784094043.707129:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094043.707231:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796864 00000100:00100000:0.0:1784094043.707241:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796864 00000100:00100000:0.0:1784094043.707297:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 851 00000100:00100000:0.0:1784094043.707308:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013796864:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094043.707691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013796864:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 386us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094043.707698:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 851 00000100:00100000:1.0:1784094043.709106:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094043.709169:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013796992 00000100:00100000:2.0:1784094043.709177:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013796992 00000100:00100000:2.0:1784094043.709223:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 852 00000100:00100000:2.0:1784094043.709231:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013796992:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094043.709297:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013796992:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094043.709302:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 852 00000100:00100000:2.0:1784094043.710141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094043.710201:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013797120 00000100:00100000:1.0:1784094043.710208:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013797120 00000100:00100000:1.0:1784094043.710257:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 431 00000100:00100000:1.0:1784094043.710264:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013797120:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094043.710588:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013797120:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 324us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094043.710593:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 431 00000100:00100000:0.0:1784094043.711479:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094043.711541:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013797248 00000100:00100000:3.0:1784094043.711548:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013797248 00000100:00100000:3.0:1784094043.711585:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 432 00000100:00100000:3.0:1784094043.711592:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013797248:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094043.711867:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:51393:x1870757013797248:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 275us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094043.711875:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 432 00000100:00100000:2.0:1784094043.712634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094043.712717:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013797376 00000100:00100000:0.0:1784094043.712725:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013797376 00000100:00100000:0.0:1784094043.712776:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 853 00000100:00100000:0.0:1784094043.712786:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013797376:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094043.713146:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51393:x1870757013797376:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 361us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094043.713154:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 853 00000100:00100000:2.0:1784094044.232292:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.232348:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013797504 00000100:00100000:0.0:1784094044.232360:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013797504 00000100:00080000:1.0:1784094044.232412:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094044.232478:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 854 00000100:00100000:1.0:1784094044.232490:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:51407:x1870757013797504:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094044.232508:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094044.232525:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb4fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b04 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.232577:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.232588:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.232598:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094044.232774:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:1.0:1784094044.232777:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094044.232860:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.232885:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb4fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b04 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.232902:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b04 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.232910:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff90721a781300) 00010000:00010000:1.0:1784094044.232913:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094044.232917:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094044.232979:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51407:x1870757013797504:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 492us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094044.232988:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 854 00000100:00100000:2.0:1784094044.234329:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.234445:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013797760 00000100:00100000:0.0:1784094044.234451:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013797760 00000100:00100000:0.0:1784094044.234490:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 855 00000100:00100000:0.0:1784094044.234501:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51407:x1870757013797760:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094044.234539:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094044.234558:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cb503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b04 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.234577:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb4a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5aef expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.234588:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff90721a781300) 00010000:00010000:0.0:1784094044.234598:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094044.234618:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.234628:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.234650:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094044.242535:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967625 is committed 00000004:00010000:2.0:1784094044.242539:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c26a0716 reply state 0000000038ee8c02 transno 4294967625 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094044.242554:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094044.242628:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00080000:2.0:1784094044.242718:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094044.242731:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51407:x1870757013797760:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 8232us (8402us total) trans 4294967625 rc 0/0 00000100:00100000:2.0:1784094044.242738:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 855 00010000:00010000:2.0:1784094044.242769:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.242777:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.242786:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.242792:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094044.242798:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.242805:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.242821:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b900) 00010000:00010000:2.0:1784094044.242825:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094044.242830:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.242836:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb50a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094044.260361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.260628:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013797888 00000100:00100000:1.0:1784094044.260651:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013797888 00000100:00100000:1.0:1784094044.260704:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 856 00000100:00100000:1.0:1784094044.260714:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:51411:x1870757013797888:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094044.260736:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094044.260757:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b0b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.260819:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.260830:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.260839:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.260849:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.260854:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.260858:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261342:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261352:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261359:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094044.261507:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:1.0:1784094044.261512:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094044.261652:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261666:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261673:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261680:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261687:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094044.261691:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261699:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261714:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:1.0:1784094044.261718:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094044.261723:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261730:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261743:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261750:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261756:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261762:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094044.261766:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261773:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261782:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907219c12400) 00010000:00010000:1.0:1784094044.261785:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094044.261788:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261794:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb51f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261829:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b0b expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261851:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b0b expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.261859:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094044.261862:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094044.261865:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784094044.261926:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51411:x1870757013797888:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1213us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094044.261934:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 856 00000100:00100000:1.0:1784094044.262980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094044.263021:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013798144 00000100:00100000:3.0:1784094044.263026:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013798144 00000100:00100000:3.0:1784094044.263057:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 857 00000100:00100000:3.0:1784094044.263064:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:51411:x1870757013798144:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784094044.263073:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094044.263082:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb52d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b12 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.263311:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.263323:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.263331:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.263346:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.263352:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.263356:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094044.264056:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:3.0:1784094044.264245:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264252:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264257:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264283:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264290:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264295:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264299:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094044.264301:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264304:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264310:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12a00) 00010000:00010000:3.0:1784094044.264312:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094044.264314:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264317:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb534 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094044.264324:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b31b1730 reply state 000000003becc9fa transno 4294967626 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094044.264330:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094044.264350:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb52d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b12 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264363:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b12 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.264370:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094044.264372:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094044.264375:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784094044.264410:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:51411:x1870757013798144:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1347us (1433us total) trans 4294967626 rc 0/0 00000100:00100000:3.0:1784094044.264415:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 857 00010000:00010000:2.0:1784094044.265003:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265011:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265015:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265018:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094044.265020:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265024:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265030:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907204fce400) 00010000:00010000:2.0:1784094044.265032:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094044.265034:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265038:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb53b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094044.265694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094044.265732:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013798400 00000100:00100000:2.0:1784094044.265738:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013798400 00000100:00100000:2.0:1784094044.265777:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 858 00000100:00100000:2.0:1784094044.265786:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:51411:x1870757013798400:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:2.0:1784094044.265819:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094044.265842:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b12 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265859:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907204fceb00) 00010000:00010000:2.0:1784094044.265868:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094044.265891:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265900:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.265907:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094044.265975:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000009614bc96 reply state 0000000042346521 transno 4294967627 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094044.265982:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094044.266037:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:51411:x1870757013798400:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 252us (342us total) trans 4294967627 rc 0/0 00000100:00100000:2.0:1784094044.266044:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 858 00010000:00010000:1.0:1784094044.266666:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.266676:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094044.266679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:1.0:1784094044.266688:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.266695:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094044.266699:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.266707:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094044.266719:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013798528 00010000:00010000:1.0:1784094044.266720:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff90721a781f00) 00000100:00100000:0.0:1784094044.266724:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013798528 00010000:00010000:1.0:1784094044.266726:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094044.266731:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.266737:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb550 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094044.266760:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 859 00000100:00100000:0.0:1784094044.266770:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:51411:x1870757013798528:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094044.266782:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094044.266793:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb557 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b19 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.266823:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b19 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.266836:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb557 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b19 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.266852:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784094044.266854:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784094044.266856:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094044.266880:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:51411:x1870757013798528:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 114us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.266886:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 859 00000100:00100000:0.0:1784094044.267605:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094044.267652:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013798656 00000100:00100000:2.0:1784094044.267658:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013798656 00000100:00080000:1.0:1784094044.267695:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094044.267704:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 433 00000100:00100000:2.0:1784094044.267714:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013798656:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:2.0:1784094044.267931:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013798656:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 219us (325us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1784094044.267939:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 433 00000100:00100000:2.0:1784094044.268603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094044.268661:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013798912 00000100:00100000:3.0:1784094044.268666:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013798912 00000100:00100000:3.0:1784094044.268702:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 89 00000100:00100000:3.0:1784094044.268712:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:51411:x1870757013798912:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:3.0:1784094044.268859:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:51411:x1870757013798912:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 150us (257us total) trans 4294967628 rc 0/0 00000100:00100000:3.0:1784094044.268864:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 89 00000100:00100000:3.0:1784094044.284978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.285024:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013799040 00000100:00100000:1.0:1784094044.285033:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013799040 00000100:00100000:1.0:1784094044.285090:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 860 00000100:00100000:1.0:1784094044.285109:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:51415:x1870757013799040:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094044.285134:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094044.285151:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb55e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b20 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285203:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285213:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285221:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285230:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285234:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285238:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285309:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285314:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285318:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094044.285341:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 0 00000004:00200000:1.0:1784094044.285344:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094044.285356:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285364:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285370:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285374:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285377:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285381:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094044.285384:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285388:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285396:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094044.285398:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094044.285401:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285404:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285411:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285414:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285418:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285436:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094044.285438:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285442:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285447:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907219c12400) 00010000:00010000:1.0:1784094044.285449:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094044.285451:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285454:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb56c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285481:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb55e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b20 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285494:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b20 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.285501:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:1.0:1784094044.285503:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094044.285506:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784094044.285556:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:51415:x1870757013799040:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 457us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094044.285564:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 860 00000100:00100000:0.0:1784094044.286566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.286599:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013799168 00000100:00100000:1.0:1784094044.286603:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013799168 00000100:00100000:1.0:1784094044.286647:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 434 00000100:00100000:1.0:1784094044.286656:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013799168:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094044.286665:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094044.286676:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b27 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094044.286698:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x6a571d5c, atime: 0x6a571d5c, ctime: 0x6a571d5c, blocks: 0x1 00010000:00010000:1.0:1784094044.286711:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=1205s v=(0 0) 00010000:00010000:1.0:1784094044.286714:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094044.286719:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.286744:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.286751:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094044.286774:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013799168:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 121us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094044.286779:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 434 00000100:00100000:2.0:1784094044.287999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.288041:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013799424 00000100:00100000:0.0:1784094044.288046:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013799424 00000100:00100000:0.0:1784094044.288070:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 861 00000100:00100000:0.0:1784094044.288076:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:51415:x1870757013799424:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784094044.288099:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094044.288110:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cb573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b20 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288121:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb557 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b19 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288127:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784094044.288131:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094044.288139:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288145:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288150:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288156:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288160:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288164:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288208:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288212:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288216:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094044.288690:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 64 off9920 00000004:00080000:0.0:1784094044.288698:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1205366275221ns, next at 1206366273718ns, rc = 0 00010000:00010000:0.0:1784094044.288742:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288751:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288764:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288770:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288777:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288782:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288801:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094044.288817:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094044.288817:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288824:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288826:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288841:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094044.288841:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288847:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288849:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.288853:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288860:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288861:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288873:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094044.288877:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094044.288881:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288884:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff907202e6be00) 00010000:00010000:2.0:1784094044.288888:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094044.288892:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288897:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb58f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288898:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb596 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094044.288907:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094044.288909:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094044.288911:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094044.288921:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288926:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288930:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288934:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.288938:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288944:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288952:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12a00) 00010000:00010000:0.0:1784094044.288955:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094044.288957:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.288963:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb581 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094044.288972:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000066a3fe07 reply state 000000004b2ccac3 transno 4294967629 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094044.288983:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094044.289030:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:51415:x1870757013799424:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 952us (1030us total) trans 4294967629 rc 0/0 00000100:00100000:0.0:1784094044.289036:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 861 00010000:00010000:0.0:1784094044.289944:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.289953:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.289959:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.289964:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.289967:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.289973:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.289981:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907202e6b100) 00010000:00010000:0.0:1784094044.289983:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094044.289986:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.289991:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094044.599305:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.599362:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013799552 00000100:00100000:1.0:1784094044.599372:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013799552 00000100:00100000:1.0:1784094044.599455:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 862 00000100:00100000:1.0:1784094044.599468:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:51434:x1870757013799552:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094044.599489:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094044.599513:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb59d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b2e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.599572:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.599585:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.599596:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094044.599666:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:1.0:1784094044.599670:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094044.599693:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.599716:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cb59d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b2e expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.599731:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b2e expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.599739:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094044.599742:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094044.599746:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13400, rc 0) 00000100:00100000:1.0:1784094044.599796:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:51434:x1870757013799552:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 333us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094044.599803:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 862 00000100:00100000:3.0:1784094044.600897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.600932:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013799808 00000100:00100000:1.0:1784094044.600938:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013799808 00000100:00100000:1.0:1784094044.600971:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 863 00000100:00100000:1.0:1784094044.600979:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:51434:x1870757013799808:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784094044.601008:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784094044.601022:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cb5a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b2e expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.601038:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cb526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b0b expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.601046:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094044.601054:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094044.601069:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.601079:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.601087:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094044.610186:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967629 is committed 00000004:00080000:2.0:1784094044.610197:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 70 committed 00000004:00010000:1.0:1784094044.610197:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c9b2f459 reply state 000000006163b72f transno 4294967630 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094044.610212:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784094044.610220:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967630 is committed 00000004:00200000:1.0:1784094044.610322:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:0.0:1784094044.610343:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024302720:0@lo:6:osp-syn-1-0.0 00010000:00080000:1.0:1784094044.610401:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784094044.610412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094044.610440:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:51434:x1870757013799808:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 9439us (9521us total) trans 4294967630 rc 0/0 00000100:00100000:1.0:1784094044.610450:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 863 00010000:00010000:3.0:1784094044.610453:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.610465:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.610474:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.610482:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094044.610486:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.610493:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.610510:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907219c12400) 00000100:00100000:0.0:1784094044.610511:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302720 00010000:00010000:3.0:1784094044.610515:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784094044.610519:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302720 00010000:00010000:3.0:1784094044.610522:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.610530:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cb5ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094044.610562:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1784094044.610573:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024302720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784094044.610595:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:27 count 1 00010000:00010000:0.0:1784094044.610612:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.610643:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.610653:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094044.610657:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094044.610662:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.610685:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.610699:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 6 pid: 6573 timeout: 1305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094044.610710:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024302848:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784094044.610752:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907226004cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094044.611298:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024302848:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094044.611366:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094044.611515:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.611540:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013799936 00000100:00100000:1.0:1784094044.611545:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013799936 00010000:00010000:1.0:1784094044.611565:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 7 pid: 6573 timeout: 1305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094044.611591:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 301 00000100:00100000:1.0:1784094044.611600:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013799936:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094044.611610:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094044.611616:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 7 pid: 6573 timeout: 1305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.611641:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 7 pid: 6573 timeout: 1305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.611658:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a723999d/0x9ce98053214cb57a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b27 expref: 7 pid: 6573 timeout: 1305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.611671:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094044.611674:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094044.611680:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.611690:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094044.611710:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094044.611718:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.611726:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.611732:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094044.611739:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013799936:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 140us (224us total) trans 0 rc 0/0 00010000:00010000:3.0:1784094044.611740:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094044.611758:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 301 00010000:00010000:3.0:1784094044.611769:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094044.611782:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094044.611790:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.611800:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094044.611804:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.611813:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.611825:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.611832:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095f8dcff/0x9ce98053214cb5b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.611848:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094044.611850:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094044.611852:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094044.612156:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024302720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1585us (1745us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1784094044.612163:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000004:00080000:1.0:1784094044.612182:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907103b5f480/2, rc 0, transno 4294967351 00000100:00100000:1.0:1784094044.612189:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024302720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094044.625594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.625621:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800064 00000100:00100000:0.0:1784094044.625642:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800064 00000100:00100000:0.0:1784094044.625683:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 864 00000100:00100000:0.0:1784094044.625691:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:51438:x1870757013800064:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094044.625710:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094044.625726:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb5b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b35 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.625773:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.625784:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.625792:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.625811:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.625816:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.625820:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626330:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb5ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626338:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626344:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094044.626838:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094044.626841:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094044.626918:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626928:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626935:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626940:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626946:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.626950:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626958:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626970:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094044.626973:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094044.626978:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626985:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626994:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.626998:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627002:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627006:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.627008:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627012:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627017:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6be00) 00010000:00010000:0.0:1784094044.627019:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094044.627020:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627024:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627046:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb5b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b35 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627057:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b35 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.627061:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784094044.627063:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094044.627064:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784094044.627111:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51438:x1870757013800064:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1421us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.627118:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 864 00010000:00010000:1.0:1784094044.649529:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094044.930219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.930276:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800192 00000100:00100000:0.0:1784094044.930286:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800192 00000100:00100000:0.0:1784094044.930338:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 865 00000100:00100000:0.0:1784094044.930348:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51456:x1870757013800192:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094044.930365:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094044.930383:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b3c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.930480:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.930491:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.930500:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094044.930684:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094044.930688:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094044.930757:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.930777:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb5d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b3c expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.930788:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b3c expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.930793:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784094044.930795:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094044.930798:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094044.930850:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51456:x1870757013800192:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 504us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.930855:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 865 00000100:00100000:2.0:1784094044.931704:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094044.931731:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800448 00000100:00100000:3.0:1784094044.931737:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800448 00000100:00100000:3.0:1784094044.931767:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 866 00000100:00100000:3.0:1784094044.931776:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51456:x1870757013800448:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094044.931815:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094044.931831:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b3c expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.931849:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb5ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b35 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.931860:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6b100) 00010000:00010000:3.0:1784094044.931868:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094044.931886:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.931895:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.931902:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094044.932288:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e0a75e22 reply state 0000000075083e67 transno 4294967631 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094044.932298:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094044.932389:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000100:00100000:3.0:1784094044.932460:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51456:x1870757013800448:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 683us (752us total) trans 4294967631 rc 0/0 00000100:00100000:3.0:1784094044.932470:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 866 00010000:00010000:3.0:1784094044.932962:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.932973:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.932981:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.932988:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094044.932992:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.932998:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.933006:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784094044.933008:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094044.933011:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.933015:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb5e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094044.973435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.973488:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800576 00000100:00100000:0.0:1784094044.973498:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800576 00000100:00100000:0.0:1784094044.973550:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 867 00000100:00100000:0.0:1784094044.973561:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013800576:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094044.973671:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013800576:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.973680:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 867 00000100:00100000:2.0:1784094044.974190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.974232:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800704 00000100:00100000:0.0:1784094044.974237:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800704 00000100:00080000:1.0:1784094044.974273:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094044.974275:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 436 00000100:00100000:0.0:1784094044.974283:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:51468:x1870757013800704:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094044.974541:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:51468:x1870757013800704:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 259us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.974547:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 436 00000100:00100000:2.0:1784094044.974988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094044.975017:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800832 00000100:00100000:1.0:1784094044.975022:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800832 00000100:00100000:1.0:1784094044.975049:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 437 00000100:00100000:1.0:1784094044.975055:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:51468:x1870757013800832:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094044.975201:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:51468:x1870757013800832:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 145us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094044.975206:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 437 00000100:00100000:2.0:1784094044.975633:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.975668:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013800960 00000100:00100000:0.0:1784094044.975673:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013800960 00000100:00100000:0.0:1784094044.975701:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 868 00000100:00100000:0.0:1784094044.975707:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013800960:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094044.975900:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013800960:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 191us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.975907:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 868 00000100:00100000:2.0:1784094044.976764:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094044.976807:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801088 00000100:00100000:3.0:1784094044.976812:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801088 00000100:00100000:3.0:1784094044.976849:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 869 00000100:00100000:3.0:1784094044.976858:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013801088:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094044.976902:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013801088:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 46us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094044.976907:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 869 00000100:00100000:2.0:1784094044.977389:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094044.977440:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801216 00000100:00100000:3.0:1784094044.977445:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801216 00000100:00100000:3.0:1784094044.977466:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 438 00000100:00100000:3.0:1784094044.977473:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:51468:x1870757013801216:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094044.977640:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:51468:x1870757013801216:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 169us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094044.977645:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 438 00000100:00100000:2.0:1784094044.978128:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.978164:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801344 00000100:00100000:0.0:1784094044.978169:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801344 00000100:00100000:0.0:1784094044.978198:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 439 00000100:00100000:0.0:1784094044.978205:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:51468:x1870757013801344:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094044.978400:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:51468:x1870757013801344:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 195us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.978409:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 439 00000100:00100000:2.0:1784094044.978959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.978995:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801472 00000100:00100000:0.0:1784094044.978999:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801472 00000100:00100000:0.0:1784094044.979023:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 870 00000100:00100000:0.0:1784094044.979028:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013801472:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094044.979198:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:51468:x1870757013801472:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 168us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.979205:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 870 00000100:00100000:2.0:1784094044.997054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094044.997115:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801600 00000100:00100000:0.0:1784094044.997124:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801600 00000100:00100000:0.0:1784094044.997172:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 871 00000100:00100000:0.0:1784094044.997184:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:51472:x1870757013801600:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784094044.997202:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094044.997220:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb5ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b43 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997275:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997288:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997299:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997312:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997323:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997329:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997749:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb5ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997758:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997766:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094044.997835:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094044.997839:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094044.997908:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997920:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997927:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997933:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997940:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.997944:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997953:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997963:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094044.997966:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094044.997970:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997976:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb5f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997986:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997991:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.997997:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998002:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094044.998005:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998010:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998016:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6be00) 00010000:00010000:0.0:1784094044.998019:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094044.998022:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998031:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb5f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998056:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb5ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b43 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998068:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b43 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094044.998075:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784094044.998078:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094044.998080:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76e00, rc 0) 00000100:00100000:0.0:1784094044.998131:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51472:x1870757013801600:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 950us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094044.998138:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 871 00000100:00100000:2.0:1784094044.999065:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094044.999106:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801856 00000100:00100000:3.0:1784094044.999113:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801856 00000100:00100000:3.0:1784094044.999147:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 872 00000100:00100000:3.0:1784094044.999155:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51472:x1870757013801856:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784094044.999164:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094044.999173:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb606 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b4a expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.999340:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.999348:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.999354:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.999362:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.999367:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094044.999371:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094044.999919:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:3.0:1784094045.000078:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb61b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000085:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000090:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb61b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000109:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000114:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000117:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000120:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094045.000122:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000126:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000130:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:3.0:1784094045.000132:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094045.000134:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000141:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb60d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094045.000147:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000067df0040 reply state 00000000f84a6b02 transno 4294967632 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094045.000152:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094045.000165:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb606 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b4a expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000173:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb61b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b4a expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094045.000177:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094045.000178:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094045.000180:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784094045.000210:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:51472:x1870757013801856:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1057us (1145us total) trans 4294967632 rc 0/0 00000100:00100000:3.0:1784094045.000215:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 872 00010000:00010000:0.0:1784094045.000693:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094045.000702:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094045.000708:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094045.000713:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094045.000717:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094045.000723:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094045.000732:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907204fcec00) 00010000:00010000:0.0:1784094045.000735:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094045.000737:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094045.000743:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094045.002898:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094045.002938:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013801984 00000100:00100000:1.0:1784094045.002944:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013801984 00000100:00100000:1.0:1784094045.002980:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:1.0:1784094045.002987:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:51472:x1870757013801984:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784094045.002998:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094045.003012:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b51 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094045.003030:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784094045.003042:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=1206s v=(0 0) 00010000:00010000:1.0:1784094045.003046:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094045.003054:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 6 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094045.003067:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 6 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094045.003078:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784094045.003107:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:51472:x1870757013801984:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094045.003113:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 440 00000100:00100000:2.0:1784094045.011313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094045.011367:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013802112 00000100:00100000:1.0:1784094045.011379:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013802112 00002000:00100000:1.0:1784094045.011418:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff90723d3d4380 x1870757013802112/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:366/0 lens 488/0 e 0 to 0 dl 1784094056 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784094045.011461:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d3d4380 with x1870757013802112 ext(0->1048575) 00002000:00010000:1.0:1784094045.011466:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90723d3d4380 00000100:00100000:1.0:1784094045.011488:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 21 00000100:00100000:1.0:1784094045.011497:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013802112:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:3.0:1784094045.016848:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013802112:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 5348us (5536us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1784094045.016856:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 21 00002000:00100000:3.0:1784094045.016863:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff90723d3d4380 x1870757013802112/t4294967352(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:366/0 lens 488/448 e 0 to 0 dl 1784094056 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1784094045.016870:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d3d4380 with x1870757013802112 ext(0->1048575) 00002000:00010000:3.0:1784094045.016874:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90723d3d4380 00000100:00100000:2.0:1784094045.017725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094045.017769:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013802240 00000100:00100000:0.0:1784094045.017776:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013802240 00000100:00100000:0.0:1784094045.017814:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 873 00000100:00100000:0.0:1784094045.017824:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:51472:x1870757013802240:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:2.0:1784094045.025293:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967632 is committed 00000100:00100000:0.0:1784094045.025372:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51472:x1870757013802240:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 7548us (7646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094045.025380:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 873 00000100:00100000:2.0:1784094045.026363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094045.026398:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013802368 00000100:00100000:3.0:1784094045.026406:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013802368 00000100:00100000:3.0:1784094045.026454:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 441 00000100:00100000:3.0:1784094045.026460:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013802368:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:0.0:1784094045.034507:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000100:00100000:3.0:1784094045.034567:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013802368:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 8102us (8199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094045.034575:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 441 00000100:00100000:1.0:1784094045.035862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094045.035899:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013802624 00000100:00100000:0.0:1784094045.035907:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013802624 00000100:00100000:0.0:1784094045.035941:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 90 00000100:00100000:0.0:1784094045.035948:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51472:x1870757013802624:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:0.0:1784094045.036260:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:51472:x1870757013802624:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 311us (400us total) trans 4294967633 rc 0/0 00000100:00100000:0.0:1784094045.036266:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 90 00000100:00100000:2.0:1784094045.161612:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024302976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094045.161695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094045.161750:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024302976 00000100:00100000:1.0:1784094045.161762:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024302976 00000100:00080000:0.0:1784094045.161820:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094045.161842:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1784094045.161853:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024302976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094045.161878:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784094045.161933:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024302976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094045.161941:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1784094045.161964:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024302976:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1784094045.415316:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967633 is committed 00010000:00010000:0.0:1784094045.674543:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094045.812376:0:86395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1206889950455ns, next at 1189203984975ns, rc = 0 00000004:00080000:2.0:1784094045.812514:0:86395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1206890091133ns, next at 1206366273718ns, rc = 0 00000004:00080000:1.0:1784094045.813454:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00000004:00080000:1.0:1784094045.814008:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 71 committed 00000001:00080000:2.0:1784094046.216305:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000001:00080000:2.0:1784094046.216318:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00000100:00100000:2.0:1784094046.245060:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094046.245113:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013802752 00000100:00100000:1.0:1784094046.245121:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013802752 00000100:00080000:0.0:1784094046.245155:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094046.245176:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 874 00000100:00100000:1.0:1784094046.245185:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013802752:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094046.245277:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013802752:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 93us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094046.245283:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 874 00000100:00100000:2.0:1784094046.246026:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094046.246055:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013802880 00000100:00100000:0.0:1784094046.246061:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013802880 00000100:00080000:1.0:1784094046.246108:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094046.246112:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 442 00000100:00100000:0.0:1784094046.246124:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:51664:x1870757013802880:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094046.246516:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:51664:x1870757013802880:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 395us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094046.246525:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 442 00000100:00100000:2.0:1784094046.247029:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094046.247061:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803008 00000100:00100000:1.0:1784094046.247065:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803008 00000100:00100000:1.0:1784094046.247102:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 443 00000100:00080000:0.0:1784094046.247107:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094046.247110:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:51664:x1870757013803008:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094046.247314:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:51664:x1870757013803008:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 205us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094046.247319:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 443 00000100:00100000:2.0:1784094046.247897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094046.247953:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803136 00000100:00100000:1.0:1784094046.247959:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803136 00000100:00100000:1.0:1784094046.247988:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 875 00000100:00100000:1.0:1784094046.247997:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013803136:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094046.248261:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013803136:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 266us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094046.248267:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 875 00000100:00100000:2.0:1784094046.249263:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094046.249293:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803264 00000100:00100000:3.0:1784094046.249298:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803264 00000100:00100000:3.0:1784094046.249325:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 876 00000100:00100000:3.0:1784094046.249331:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013803264:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094046.249374:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013803264:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094046.249379:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 876 00000100:00100000:2.0:1784094046.249910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094046.249941:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803392 00000100:00100000:3.0:1784094046.249945:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803392 00000100:00100000:3.0:1784094046.249969:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 444 00000100:00100000:3.0:1784094046.249975:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:51664:x1870757013803392:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094046.250146:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:51664:x1870757013803392:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 170us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094046.250153:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 444 00000100:00100000:2.0:1784094046.250681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094046.250706:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803520 00000100:00100000:3.0:1784094046.250710:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803520 00000100:00100000:3.0:1784094046.250732:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 445 00000100:00100000:3.0:1784094046.250737:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:51664:x1870757013803520:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094046.250920:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:51664:x1870757013803520:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 182us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094046.250926:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 445 00000100:00100000:2.0:1784094046.251467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094046.251503:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803648 00000100:00100000:1.0:1784094046.251509:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803648 00000100:00100000:1.0:1784094046.251541:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 877 00000100:00100000:1.0:1784094046.251548:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013803648:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094046.251865:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:51664:x1870757013803648:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 317us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094046.251871:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 877 00000100:00100000:2.0:1784094046.270553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094046.270593:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013803904 00000100:00100000:1.0:1784094046.270611:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013803904 00000100:00100000:1.0:1784094046.270654:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 878 00000100:00100000:1.0:1784094046.270662:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:51668:x1870757013803904:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:1.0:1784094046.270702:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094046.270724:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb61b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b4a expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.270734:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff907204fcef00) 00010000:00010000:1.0:1784094046.270741:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094046.270757:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.270773:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.270780:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.270788:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.270793:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.270796:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271051:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271059:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271066:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094046.271725:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 64 off9984 00000004:00080000:1.0:1784094046.271732:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1207349310084ns, next at 1208349308486ns, rc = 0 00010000:00010000:1.0:1784094046.271795:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271801:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271807:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271811:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271815:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271819:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271833:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094046.271847:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271851:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271855:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271856:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094046.271864:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271864:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094046.271869:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271874:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094046.271880:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271883:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271888:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271892:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784094046.271895:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784094046.271897:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271902:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb63e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271904:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff907219c12b00) 00010000:00010000:2.0:1784094046.271907:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094046.271910:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271913:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271915:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271924:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271929:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271933:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094046.271933:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094046.271936:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094046.271938:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094046.271939:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094046.271945:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271950:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:1.0:1784094046.271951:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094046.271953:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.271959:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094046.271965:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000009c2afce5 reply state 00000000a9200c4f transno 4294967634 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094046.271970:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094046.272021:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:51668:x1870757013803904:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1360us (1473us total) trans 4294967634 rc 0/0 00000100:00100000:1.0:1784094046.272026:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 878 00010000:00010000:3.0:1784094046.272507:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.272513:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.272517:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.272520:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094046.272522:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.272526:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.272532:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff907219c12d00) 00010000:00010000:3.0:1784094046.272534:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094046.272536:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.272539:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094046.697537:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784094046.903142:0:86541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1207980718054ns, next at 1208349308486ns, rc = 0 00000004:00080000:0.0:1784094046.911271:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00000001:00080000:0.0:1784094046.911292:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967634 is committed 00000004:00080000:0.0:1784094046.911296:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000100:00100000:2.0:1784094046.911389:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094046.911406:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024303104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784094046.911490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094046.911520:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024303104 00000100:00100000:1.0:1784094046.911528:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024303104 00000100:00100000:1.0:1784094046.911573:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1784094046.911582:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024303104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784094046.911622:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:1.0:1784094046.911644:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.911664:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.911673:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784094046.911678:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094046.911682:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.911707:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.911722:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 5 pid: 6573 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094046.911735:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024303232:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784094046.911809:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907225ccb540 going to sleep for 11 seconds 00000100:00100000:1.0:1784094046.912635:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024303232:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784094046.912651:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094046.912919:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094046.912972:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804032 00000100:00100000:0.0:1784094046.912976:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804032 00010000:00010000:0.0:1784094046.912994:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 6 pid: 6573 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094046.913016:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 302 00000100:00100000:0.0:1784094046.913020:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013804032:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094046.913027:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094046.913032:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 6 pid: 6573 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094046.913041:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 6 pid: 6573 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094046.913061:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b14ec9df/0x9ce98053214cb629 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b51 expref: 6 pid: 6573 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094046.913071:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094046.913073:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094046.913076:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094046.913082:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094046.913097:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094046.913115:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094046.913123:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013804032:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 101us (203us total) trans 0 rc 0/0 00010000:00010000:1.0:1784094046.913126:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094046.913132:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 302 00010000:00010000:1.0:1784094046.913143:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.913152:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094046.913174:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094046.913217:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094046.913226:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.913269:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094046.913273:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.913279:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.913288:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.913293:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000608e0dbf/0x9ce98053214cb64c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094046.913304:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094046.913306:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094046.913307:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094046.913706:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024303104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2124us (2214us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1784094046.913719:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000004:00080000:2.0:1784094046.913738:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907226110000/2, rc 0, transno 4294967353 00000100:00100000:2.0:1784094046.913753:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024303104:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1784094046.913920:0:86541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1207991497349ns, next at 1206366273718ns, rc = 0 00000004:00080000:0.0:1784094046.914694:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00000100:00100000:2.0:1784094047.608271:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094047.608305:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094047.608325:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804288 00000100:00100000:2.0:1784094047.608329:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094047.608336:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804288 00000100:00100000:2.0:1784094047.608361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094047.608362:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804160 00000100:00100000:0.0:1784094047.608368:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804160 00000100:00100000:1.0:1784094047.608384:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804544 00000100:00100000:2.0:1784094047.608391:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804416 00000100:00100000:1.0:1784094047.608392:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804544 00000100:00100000:2.0:1784094047.608397:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804416 00000100:00100000:3.0:1784094047.608399:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 816 00000100:00100000:0.0:1784094047.608405:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 788 00000100:00100000:3.0:1784094047.608413:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013804288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094047.608417:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013804160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094047.608460:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 608 00000100:00100000:2.0:1784094047.608471:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 609 00000100:00100000:1.0:1784094047.608474:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013804544:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094047.608483:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013804416:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094047.608522:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013804160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 107us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094047.608525:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013804288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094047.608526:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013804416:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094047.608526:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013804544:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094047.608539:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 788 00000100:00100000:3.0:1784094047.608551:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 816 00000100:00100000:1.0:1784094047.608551:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 608 00000100:00100000:2.0:1784094047.608559:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 609 00010000:00010000:0.0:1784094047.721522:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094048.233606:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024303488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094048.233608:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024303744:0@lo:400:kworker.0 00000100:00100000:2.0:1784094048.233614:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024303360:0@lo:400:kworker.0 00000100:00100000:1.0:1784094048.233647:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024303616:0@lo:400:kworker.0 00000100:00100000:3.0:1784094048.233701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094048.233702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094048.233702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094048.233729:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024303744 00000100:00100000:1.0:1784094048.233735:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024303744 00000100:00100000:2.0:1784094048.233787:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024303872:0@lo:400:kworker.0 00000100:00100000:0.0:1784094048.233794:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024304000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094048.233801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094048.233815:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024303616 00000100:00100000:1.0:1784094048.233820:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024303616 00000100:00100000:2.0:1784094048.233828:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094048.233830:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024304128:0@lo:400:kworker.0 00000100:00100000:0.0:1784094048.233837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094048.233852:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304000 00000100:00100000:1.0:1784094048.233856:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304000 00000100:00100000:3.0:1784094048.233866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094048.233885:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1784094048.233897:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024303744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094048.233901:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024303360 00000100:00100000:0.0:1784094048.233901:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024303488 00000100:00100000:2.0:1784094048.233908:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024303360 00000100:00100000:0.0:1784094048.233909:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024303488 00000100:00100000:3.0:1784094048.233911:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1784094048.233922:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024303616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094048.233946:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1784094048.233956:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024303360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094048.233966:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1784094048.233967:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024303744:12345-0@lo:400:kworker.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094048.233968:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024303616:12345-0@lo:400:kworker.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094048.233983:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024303488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094048.233987:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:2.0:1784094048.233993:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024303360:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094048.233998:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1784094048.234003:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1784094048.234014:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00002000:00000024:0.0:1784094048.234019:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094048.234025:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024304000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784094048.234038:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094048.234043:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024303872 00000100:00080000:1.0:1784094048.234044:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094048.234049:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024303872 00000100:00100000:0.0:1784094048.234080:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024303488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094048.234082:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024304000:12345-0@lo:400:kworker.0 Request processed in 60us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094048.234087:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304128 00000100:00100000:2.0:1784094048.234092:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304128 00000100:00100000:3.0:1784094048.234097:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1784094048.234101:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1784094048.234105:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024304000:0@lo:400:kworker.0 00000100:00100000:2.0:1784094048.234113:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1784094048.234120:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000100:00100000:2.0:1784094048.234122:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024303872:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1784094048.234125:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907103b5f480, transno 4294967351 00000100:00100000:3.0:1784094048.234139:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024303616:0@lo:400:kworker.0 00000100:00100000:1.0:1784094048.234143:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024303488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094048.234163:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024303872:12345-0@lo:400:kworker.0 Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094048.234165:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1784094048.234173:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00080000:1.0:1784094048.234182:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094048.234191:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024304128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094048.234198:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024303360:0@lo:400:kworker.0 00000100:00100000:2.0:1784094048.234214:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024303872:0@lo:400:kworker.0 00000100:00100000:0.0:1784094048.234243:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024304128:12345-0@lo:400:kworker.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094048.234252:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1784094048.234264:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024303744:0@lo:400:kworker.0 00000100:00100000:0.0:1784094048.234290:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024304128:0@lo:400:kworker.0 00010000:00010000:2.0:1784094048.745671:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094049.769508:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094050.281641:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024304256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094050.281702:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094050.281762:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304256 00000100:00100000:1.0:1784094050.281772:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304256 00000100:00080000:2.0:1784094050.281812:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094050.281838:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1784094050.281849:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024304256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094050.281879:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784094050.281919:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024304256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094050.281925:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1784094050.281954:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024304256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094050.793592:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784094051.313223:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00010000:00010000:0.0:1784094051.817551:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094052.728490:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094052.728571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094052.728608:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094052.728650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094052.728680:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804928 00000100:00100000:2.0:1784094052.728689:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804928 00000100:00100000:0.0:1784094052.728691:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805056 00000100:00100000:0.0:1784094052.728697:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805056 00000100:00100000:0.0:1784094052.728764:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:1.0:1784094052.728769:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804800 00000100:00100000:1.0:1784094052.728775:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804800 00000100:00100000:0.0:1784094052.728776:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013805056:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094052.728815:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 820 00000100:00100000:1.0:1784094052.728825:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013804800:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094052.728848:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013805056:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094052.728857:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:1.0:1784094052.728866:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013804800:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094052.728875:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 820 00000100:00100000:3.0:1784094052.728946:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013804672 00000100:00100000:3.0:1784094052.728950:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013804672 00000100:00100000:3.0:1784094052.728985:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 790 00000100:00100000:3.0:1784094052.728992:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013804672:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094052.729033:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013804672:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094052.729041:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 790 00000100:00080000:0.0:1784094052.729054:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094052.729059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094052.729062:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094052.729189:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 613 00000100:00100000:2.0:1784094052.729197:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013804928:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094052.729230:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013804928:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094052.729236:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 613 00010000:00010000:2.0:1784094052.841627:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094053.353602:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784094053.353622:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024304512:0@lo:400:kworker.0 00000100:00100000:1.0:1784094053.353626:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024304640:0@lo:400:kworker.0 00000100:00100000:3.0:1784094053.353644:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024305024:0@lo:400:kworker.0 00000100:00100000:2.0:1784094053.353665:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024304768:0@lo:400:kworker.0 00000100:00100000:1.0:1784094053.353700:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094053.353700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094053.353725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094053.353738:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304640 00000100:00100000:3.0:1784094053.353745:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304640 00000100:00100000:0.0:1784094053.353755:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024304384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094053.353763:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024305152:0@lo:400:kworker.0 00000100:00100000:2.0:1784094053.353779:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094053.353787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094053.353791:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304768 00000100:00100000:3.0:1784094053.353795:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304768 00000100:00100000:1.0:1784094053.353805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094053.353816:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024304896:0@lo:400:kworker.0 00000100:00100000:2.0:1784094053.353828:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305024 00000100:00100000:2.0:1784094053.353833:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305024 00000100:00100000:3.0:1784094053.353846:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1784094053.353851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094053.353866:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024304640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094053.353866:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1784094053.353876:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1784094053.353881:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024304768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094053.353886:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304512 00000100:00100000:2.0:1784094053.353888:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024305024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094053.353890:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304512 00000100:00100000:0.0:1784094053.353922:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1784094053.353928:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024304512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094053.353948:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024304640:12345-0@lo:400:kworker.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094053.353953:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024304768:12345-0@lo:400:kworker.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094053.353954:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024305024:12345-0@lo:400:kworker.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094053.353965:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1784094053.353967:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024304512:12345-0@lo:400:kworker.0 Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094053.353980:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1784094053.353980:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1784094053.353988:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:3.0:1784094053.354026:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024304640:0@lo:400:kworker.0 00000100:00100000:2.0:1784094053.354032:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024304768:0@lo:400:kworker.0 00000100:00100000:1.0:1784094053.354039:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305152 00000100:00100000:0.0:1784094053.354044:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304896 00000100:00100000:1.0:1784094053.354046:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305152 00000100:00100000:0.0:1784094053.354050:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304896 00000100:00100000:2.0:1784094053.354063:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024305024:0@lo:400:kworker.0 00000100:00100000:3.0:1784094053.354076:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024304384 00000100:00100000:3.0:1784094053.354081:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024304384 00000100:00100000:0.0:1784094053.354092:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00080000:2.0:1784094053.354093:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094053.354098:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094053.354101:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00080000:2.0:1784094053.354102:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094053.354102:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094053.354116:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024305152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094053.354122:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1784094053.354135:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024304384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094053.354141:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024304896:12345-0@lo:400:kworker.0 Request processed in 40us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094053.354149:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00002000:00000024:3.0:1784094053.354167:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094053.354182:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000100:00100000:1.0:1784094053.354184:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024305152:12345-0@lo:400:kworker.0 Request processed in 71us (378us total) trans 0 rc 0/0 00000004:00080000:0.0:1784094053.354188:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907226110000, transno 4294967353 00000100:00100000:1.0:1784094053.354196:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1784094053.354203:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024305152:0@lo:400:kworker.0 00000100:00100000:0.0:1784094053.354203:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024304896:0@lo:400:kworker.0 00000100:00100000:3.0:1784094053.354218:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024304384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094053.354220:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024304512:0@lo:400:kworker.0 00000100:00100000:3.0:1784094053.354234:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1784094053.354245:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024304384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784094053.865724:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094054.889642:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094055.401634:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024305280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094055.401701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094055.401767:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305280 00000100:00100000:1.0:1784094055.401776:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305280 00000100:00080000:2.0:1784094055.401818:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094055.401842:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1784094055.401854:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024305280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094055.401889:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094055.401945:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024305280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094055.401953:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1784094055.401975:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024305280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094055.913524:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094056.937565:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094057.848486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094057.848513:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094057.848534:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805184 00000100:00100000:0.0:1784094057.848534:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094057.848544:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805184 00000100:00100000:3.0:1784094057.848558:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805312 00000100:00100000:0.0:1784094057.848558:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094057.848572:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805312 00000100:00100000:0.0:1784094057.848593:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805440 00000100:00100000:2.0:1784094057.848595:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805568 00000100:00100000:0.0:1784094057.848598:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805440 00000100:00100000:2.0:1784094057.848601:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805568 00000100:00100000:1.0:1784094057.848606:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 792 00000100:00100000:1.0:1784094057.848619:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013805184:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094057.848624:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 824 00000100:00100000:3.0:1784094057.848637:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013805312:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094057.848641:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 616 00000100:00100000:2.0:1784094057.848650:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:0.0:1784094057.848661:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013805440:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094057.848663:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013805568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094057.848701:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013805312:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094057.848701:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013805184:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094057.848702:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013805440:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094057.848711:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013805568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094057.848724:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 824 00000100:00100000:1.0:1784094057.848725:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 792 00000100:00100000:0.0:1784094057.848725:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 616 00000100:00100000:2.0:1784094057.848734:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00080000:3.0:1784094057.848764:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094057.848769:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094057.848772:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784094057.961671:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094058.473625:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024305408:0@lo:400:kworker.0 00000100:00100000:0.0:1784094058.473642:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024305664:0@lo:400:kworker.0 00000100:00100000:3.0:1784094058.473646:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024305536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094058.473683:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024305792:0@lo:400:kworker.0 00000100:00100000:2.0:1784094058.473719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094058.473719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094058.473722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094058.473755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094058.473797:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024306048:0@lo:400:kworker.0 00000100:00100000:3.0:1784094058.473800:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024305920:0@lo:400:kworker.0 00000100:00100000:1.0:1784094058.473808:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305664 00000100:00100000:0.0:1784094058.473808:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024306176:0@lo:400:kworker.0 00000100:00100000:1.0:1784094058.473817:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305664 00000100:00100000:3.0:1784094058.473835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094058.473855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094058.473860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094058.473873:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305792 00000100:00100000:1.0:1784094058.473878:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305792 00000100:00100000:3.0:1784094058.473883:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305536 00000100:00100000:3.0:1784094058.473889:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305536 00000100:00100000:0.0:1784094058.473920:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306048 00000100:00100000:0.0:1784094058.473926:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306048 00000100:00100000:1.0:1784094058.473927:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1784094058.473936:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1784094058.473938:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1784094058.473951:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024305792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094058.473957:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024305664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094058.473958:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024305536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094058.473973:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1784094058.473983:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024306048:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784094058.473995:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094058.474025:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024305792:12345-0@lo:400:kworker.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094058.474030:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024305664:12345-0@lo:400:kworker.0 Request processed in 90us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094058.474038:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1784094058.474044:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024306048:12345-0@lo:400:kworker.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094058.474047:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1784094058.474056:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024305536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094058.474058:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1784094058.474068:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1784094058.474078:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305920 00000100:00100000:1.0:1784094058.474083:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305920 00000100:00100000:0.0:1784094058.474102:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024305408 00000100:00100000:2.0:1784094058.474106:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024305536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094058.474109:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024305408 00000100:00100000:1.0:1784094058.474124:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306176 00000100:00100000:1.0:1784094058.474130:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306176 00000100:00080000:3.0:1784094058.474132:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094058.474138:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094058.474142:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094058.474156:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1784094058.474164:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024305664:0@lo:400:kworker.0 00000100:00100000:1.0:1784094058.474164:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1784094058.474169:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024305408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094058.474210:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024305408:12345-0@lo:400:kworker.0 Request processed in 47us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094058.474216:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1784094058.474501:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1784094058.474506:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024305920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094058.474514:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024306176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094058.474536:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024306048:0@lo:400:kworker.0 00000100:00100000:0.0:1784094058.474552:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024305408:0@lo:400:kworker.0 00000100:00100000:1.0:1784094058.474562:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024305920:12345-0@lo:400:kworker.0 Request processed in 59us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094058.474572:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024306176:12345-0@lo:400:kworker.0 Request processed in 60us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094058.474572:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1784094058.474589:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1784094058.474591:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024305920:0@lo:400:kworker.0 00000100:00100000:0.0:1784094058.474607:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024305792:0@lo:400:kworker.0 00000100:00100000:1.0:1784094058.474626:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024306176:0@lo:400:kworker.0 00010000:00010000:3.0:1784094058.985541:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094060.009549:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094060.521623:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024306304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094060.521687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094060.521724:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306304 00000100:00100000:1.0:1784094060.521731:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306304 00000100:00080000:3.0:1784094060.521773:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094060.521788:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1784094060.521796:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024306304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094060.521824:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094060.521864:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024306304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094060.521873:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1784094060.521903:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024306304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094061.033622:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094062.057579:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094062.968347:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094062.968388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094062.968452:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805824 00000100:00100000:3.0:1784094062.968455:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094062.968458:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805696 00000100:00100000:0.0:1784094062.968463:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805824 00000100:00100000:2.0:1784094062.968465:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805696 00000100:00100000:3.0:1784094062.968495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094062.968508:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013805952 00000100:00100000:1.0:1784094062.968515:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013805952 00000100:00080000:3.0:1784094062.968522:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094062.968529:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 794 00000100:00080000:3.0:1784094062.968531:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094062.968531:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 828 00000100:00100000:2.0:1784094062.968546:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013805696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094062.968548:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013805824:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094062.968565:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806080 00000100:00100000:3.0:1784094062.968571:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806080 00000100:00100000:1.0:1784094062.968571:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:1.0:1784094062.968583:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013805952:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094062.968612:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 621 00000100:00100000:2.0:1784094062.968625:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013805696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094062.968627:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013806080:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094062.968628:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013805952:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094062.968628:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013805824:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094062.968645:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 794 00000100:00100000:1.0:1784094062.968651:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:0.0:1784094062.968652:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 828 00000100:00100000:3.0:1784094062.968664:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013806080:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094062.968670:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 621 00000100:00080000:3.0:1784094062.968689:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784094063.081585:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094063.593589:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024306560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094063.593589:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024306688:0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.593598:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024306944:0@lo:400:kworker.0 00000100:00100000:2.0:1784094063.593638:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024306816:0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.593663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094063.593664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094063.593667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094063.593698:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306944 00000100:00100000:2.0:1784094063.593706:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306944 00000100:00100000:3.0:1784094063.593744:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024306432:0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.593745:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024307200:0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.593762:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306560 00000100:00100000:0.0:1784094063.593767:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306560 00000100:00100000:2.0:1784094063.593780:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1784094063.593784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094063.593797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094063.593798:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024306944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.593807:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094063.593814:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1784094063.593816:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024307072:0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.593828:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024306560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094063.593842:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306432 00000100:00100000:3.0:1784094063.593846:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306432 00000100:00100000:1.0:1784094063.593850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1784094063.593858:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54329344 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094063.593860:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024306944:12345-0@lo:400:kworker.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094063.593868:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1784094063.593883:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1784094063.593888:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306688 00000100:00100000:2.0:1784094063.593889:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307200 00000100:00100000:3.0:1784094063.593893:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024306432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.593895:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306688 00000100:00100000:2.0:1784094063.593896:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307200 00000100:00100000:0.0:1784094063.593913:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024306560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.593923:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1784094063.593934:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024306432:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094063.593934:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1784094063.593937:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307072 00000100:00100000:1.0:1784094063.593942:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307072 00000100:00100000:3.0:1784094063.593946:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:2.0:1784094063.593950:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024307200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.593974:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1784094063.593985:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024306688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.593985:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1784094063.594000:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024307072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094063.594005:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024306560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094063.594007:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024307200:12345-0@lo:400:kworker.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094063.594018:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1784094063.594021:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024306432:0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.594026:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024306688:12345-0@lo:400:kworker.0 Request processed in 44us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094063.594033:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:2.0:1784094063.594046:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094063.594051:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024307072:12345-0@lo:400:kworker.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00080000:2.0:1784094063.594053:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094063.594059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094063.594063:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1784094063.594070:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024306944:0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.594088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094063.594094:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024307072:0@lo:400:kworker.0 00000100:00100000:2.0:1784094063.594115:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024307200:0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.594122:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024306816 00000100:00100000:0.0:1784094063.594127:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024306816 00000100:00100000:2.0:1784094063.594129:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024306688:0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.594165:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00080000:3.0:1784094063.594166:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094063.594176:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024306816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094063.594214:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024306816:12345-0@lo:400:kworker.0 Request processed in 39us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.594220:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:1.0:1784094063.594226:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024306816:0@lo:400:kworker.0 00000100:00100000:1.0:1784094063.952962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094063.953010:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806208 00000100:00100000:3.0:1784094063.953019:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806208 00000100:00100000:3.0:1784094063.953066:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 879 00000100:00100000:3.0:1784094063.953075:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013806208:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094063.953152:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013806208:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094063.953158:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 879 00000100:00100000:2.0:1784094063.953982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.954040:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806336 00000100:00100000:0.0:1784094063.954046:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806336 00000100:00100000:0.0:1784094063.954077:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 447 00000100:00100000:0.0:1784094063.954084:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806336:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094063.954362:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806336:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 279us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.954367:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 447 00000100:00100000:2.0:1784094063.954846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094063.954878:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806464 00000100:00100000:3.0:1784094063.954882:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806464 00000100:00100000:3.0:1784094063.954906:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 448 00000100:00100000:3.0:1784094063.954911:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806464:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094063.955068:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806464:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 156us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094063.955073:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 448 00000100:00100000:1.0:1784094063.955572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.955610:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806592 00000100:00100000:0.0:1784094063.955614:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806592 00000100:00100000:0.0:1784094063.955637:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 880 00000100:00100000:0.0:1784094063.955643:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013806592:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094063.955842:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013806592:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 199us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.955847:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 880 00000100:00100000:2.0:1784094063.956739:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.956780:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806720 00000100:00100000:0.0:1784094063.956785:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806720 00000100:00100000:0.0:1784094063.956813:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 881 00000100:00100000:0.0:1784094063.956819:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013806720:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094063.956856:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013806720:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.956860:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 881 00000100:00100000:2.0:1784094063.957364:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094063.957403:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806848 00000100:00100000:1.0:1784094063.957406:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806848 00000100:00100000:1.0:1784094063.957451:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 449 00000100:00100000:1.0:1784094063.957457:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806848:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094063.957614:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806848:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 156us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094063.957621:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 449 00000100:00100000:1.0:1784094063.958190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.958228:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013806976 00000100:00100000:0.0:1784094063.958234:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013806976 00000100:00100000:0.0:1784094063.958256:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 450 00000100:00100000:0.0:1784094063.958260:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806976:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094063.958464:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52006:x1870757013806976:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 203us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.958469:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 450 00000100:00100000:2.0:1784094063.959162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094063.959216:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013807104 00000100:00100000:3.0:1784094063.959227:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013807104 00000100:00100000:3.0:1784094063.959281:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 882 00000100:00100000:3.0:1784094063.959291:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013807104:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094063.959612:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52006:x1870757013807104:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 323us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094063.959619:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 882 00000100:00100000:2.0:1784094063.967725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.967786:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013807232 00000100:00100000:0.0:1784094063.967796:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013807232 00000100:00100000:0.0:1784094063.967847:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 883 00000100:00100000:0.0:1784094063.967858:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52007:x1870757013807232:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094063.967876:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094063.967893:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b58 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.967937:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb65a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.967948:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb65a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.967957:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb65a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094063.968119:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00000004:00200000:0.0:1784094063.968122:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094063.968186:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb65a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.968211:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b58 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.968229:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb65a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b58 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.968237:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784094063.968240:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094063.968243:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094063.968301:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52007:x1870757013807232:12345-192.168.204.57@tcp:101:rm.0 Request processed in 446us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094063.968305:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 883 00000100:00100000:1.0:1784094063.969241:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.969279:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013807488 00000100:00100000:0.0:1784094063.969283:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013807488 00000100:00100000:0.0:1784094063.969306:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 884 00000100:00100000:0.0:1784094063.969311:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52007:x1870757013807488:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094063.969318:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094063.969324:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b5f expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094063.969408:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00010000:0.0:1784094063.969607:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb661 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b5f expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.969616:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094063.969617:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784094063.969620:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b5f expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.969626:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094063.969653:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:52007:x1870757013807488:12345-192.168.204.57@tcp:101:rm.0 Request processed in 341us (412us total) trans 4294967635 rc 301/301 00000100:00100000:0.0:1784094063.969660:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 884 00000100:00100000:2.0:1784094063.970814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094063.970851:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013807616 00000100:00100000:1.0:1784094063.970855:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013807616 00000100:00100000:1.0:1784094063.970887:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 91 00000100:00100000:1.0:1784094063.970892:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52007:x1870757013807616:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784094063.972438:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52007:x1870757013807616:12345-192.168.204.57@tcp:37:rm.0 Request processed in 1543us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094063.972445:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 91 00000100:00100000:3.0:1784094063.973540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094063.973570:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013807872 00000100:00100000:0.0:1784094063.973574:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013807872 00000100:00100000:0.0:1784094063.973596:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 92 00000100:00100000:0.0:1784094063.973601:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:52007:x1870757013807872:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:0.0:1784094063.973852:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:52007:x1870757013807872:12345-192.168.204.57@tcp:35:rm.0 Request processed in 248us (312us total) trans 4294967636 rc 0/0 00000100:00100000:0.0:1784094063.973859:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 92 00000100:00100000:2.0:1784094063.974796:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094063.974831:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013808128 00000100:00100000:3.0:1784094063.974836:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013808128 00000100:00100000:3.0:1784094063.974866:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 885 00000100:00100000:3.0:1784094063.974875:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:52007:x1870757013808128:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094063.974898:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784094063.974913:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb65a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b58 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.974928:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb5ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b43 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.974938:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:3.0:1784094063.974951:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb30b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5a8d expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.974959:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b700) 00010000:00010000:3.0:1784094063.974964:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094063.974981:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.974989:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.974995:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975003:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975007:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975011:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975228:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975238:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975246:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094063.975873:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 7680 00010000:00010000:3.0:1784094063.975883:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975888:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975892:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975896:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094063.975898:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975903:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975908:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784094063.975910:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094063.975912:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975916:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb67d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975925:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975930:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975933:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975936:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094063.975937:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975940:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975944:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094063.975945:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094063.975946:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094063.975949:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb66f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094063.975955:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005fc3e6c1 reply state 00000000a1f4538e transno 4294967637 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094063.975960:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094063.975992:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52007:x1870757013808128:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1119us (1196us total) trans 4294967637 rc 0/0 00000100:00100000:3.0:1784094063.975996:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 885 00010000:00010000:0.0:1784094063.976519:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.976528:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.976534:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.976540:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094063.976544:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.976550:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.976559:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fce800) 00010000:00010000:0.0:1784094063.976562:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094063.976565:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094063.976571:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cb676 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094064.105497:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094064.942007:0:87000:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe18b995b0 20000000:00000080:2.0:1784094064.942021:0:87000:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907231063c00 uarg=0000000000000000 00010000:00010000:2.0:1784094064.942499:0:87000:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094064.942514:0:87000:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094064.942526:0:87000:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094064.942542:0:87000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094064.942555:0:87000:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094064.942564:0:87000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094064.942601:0:87000:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094064.942615:0:87000:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 18 pid: 5772 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094064.942629:0:87000:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87000:1870757024307328:0@lo:104: 00000100:00100000:2.0:1784094064.942683:0:87000:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094064.942726:0:87000:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2fa600 going to sleep for 11 seconds 00000100:00100000:1.0:1784094064.942732:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784094064.942745:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307328 00000100:00100000:1.0:1784094064.942751:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307328 00000100:00100000:1.0:1784094064.942798:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784094064.942806:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:87000:x1870757024307328:12345-0@lo:104: 00010000:00010000:1.0:1784094064.942822:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094064.942869:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094064.942873:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:87000:x1870757024307328:12345-0@lo:104: Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094064.942878:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00010000:0.0:1784094064.942897:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094064.942905:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094064.942906:0:87000:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87000:1870757024307328:0@lo:104: 00010000:00010000:0.0:1784094064.942921:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094064.942925:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094064.942932:0:87000:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094064.942935:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094064.942952:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094064.942958:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094064.942986:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094064.942992:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094064.943011:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094064.943018:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb3c1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb3c8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094064.943026:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024307456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094064.943033:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094064.943036:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094064.943038:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094064.943050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094064.943074:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307456 00000100:00100000:3.0:1784094064.943078:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307456 00010000:00010000:3.0:1784094064.943095:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 19 pid: 5772 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094064.943114:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784094064.943119:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024307456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094064.943127:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094064.943131:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 19 pid: 5772 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943137:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 19 pid: 5772 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943146:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214cb3c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb3c1 expref: 19 pid: 5772 timeout: 1376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943155:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943160:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943168:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943172:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943179:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943186:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943193:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094064.943197:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943204:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943218:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094064.943226:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094064.943259:0:87000:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094064.943266:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024307456:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094064.943274:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00010000:2.0:1784094064.943274:0:87000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094064.943278:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024307456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094064.943289:0:87000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214cb684 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094065.129530:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094065.209459:0:87049:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4b905c00 20000000:00000080:1.0:1784094065.209472:0:87049:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019de000 uarg=0000000000000000 00010000:00010000:1.0:1784094065.209648:0:87049:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094065.209661:0:87049:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094065.209674:0:87049:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094065.209690:0:87049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209705:0:87049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209714:0:87049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209721:0:87049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209729:0:87049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209736:0:87049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209742:0:87049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094065.209746:0:87049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209754:0:87049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209766:0:87049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209774:0:87049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094065.209781:0:87049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12e00/0x9ce98053214cb68b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094065.641547:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094065.641567:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024307584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094065.641630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094065.641677:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307584 00000100:00100000:2.0:1784094065.641686:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307584 00000100:00080000:3.0:1784094065.641727:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094065.641750:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1784094065.641761:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024307584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094065.641796:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094065.641852:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024307584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094065.641861:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1784094065.641881:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024307584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094066.106552:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094066.106793:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013808256 00000100:00100000:0.0:1784094066.106804:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013808256 00000100:00080000:3.0:1784094066.106855:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094066.106874:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 886 00000100:00100000:0.0:1784094066.106886:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52119:x1870757013808256:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094066.106910:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094066.106932:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b66 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.106989:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.106999:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.107009:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094066.107058:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094066.107061:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094066.107076:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.107093:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b66 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.107104:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b66 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.107109:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784094066.107112:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094066.107114:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094066.107156:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:52119:x1870757013808256:12345-192.168.204.57@tcp:101:rm.0 Request processed in 275us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094066.107163:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 886 00000100:00100000:2.0:1784094066.108143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094066.108188:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013808384 00000100:00100000:0.0:1784094066.108193:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013808384 00000100:00100000:0.0:1784094066.108231:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 887 00000100:00100000:0.0:1784094066.108237:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:52119:x1870757013808384:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094066.108245:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094066.108251:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb6a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b6d expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108275:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108281:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108287:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108295:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108299:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108303:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108338:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108349:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108356:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108363:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094066.108367:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108375:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108384:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784094066.108387:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094066.108391:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108398:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108407:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108413:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108444:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108451:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094066.108456:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108464:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108471:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6b200) 00010000:00010000:0.0:1784094066.108473:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094066.108475:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108481:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108499:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb6a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b6d expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108505:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784094066.108507:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094066.108509:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb6a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b6d expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.108514:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784094066.108539:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:52119:x1870757013808384:12345-192.168.204.57@tcp:101:rm.0 Request processed in 304us (407us total) trans 0 rc 301/301 00000100:00100000:0.0:1784094066.108544:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 887 00000100:00100000:1.0:1784094066.124214:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094066.124288:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013808640 00000100:00100000:3.0:1784094066.124304:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013808640 00000100:00100000:3.0:1784094066.124372:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 888 00000100:00100000:3.0:1784094066.124386:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52123:x1870757013808640:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:3.0:1784094066.124490:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094066.124524:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b66 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.124546:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:3.0:1784094066.124564:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094066.124662:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.124677:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.124689:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.124701:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.124709:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.124715:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094066.125465:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00010000:00010000:3.0:1784094066.125477:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.125485:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.125492:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.125499:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094066.125504:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.125518:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.125527:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784094066.125530:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094066.125534:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.125541:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cb6b5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094066.125554:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000611f0e2f reply state 00000000d3a86c81 transno 4294967638 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094066.125564:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094066.125654:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:52123:x1870757013808640:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 1270us (1445us total) trans 4294967638 rc 0/0 00000100:00100000:3.0:1784094066.125663:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 888 00010000:00010000:3.0:1784094066.126367:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.126377:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.126383:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.126389:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094066.126393:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.126404:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.126414:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fcee00) 00010000:00010000:3.0:1784094066.126417:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094066.126445:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.126453:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6bc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094066.142518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094066.142574:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013808768 00000100:00100000:0.0:1784094066.142582:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013808768 00000100:00100000:0.0:1784094066.142629:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 889 00000100:00100000:0.0:1784094066.142636:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:52127:x1870757013808768:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784094066.142657:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094066.142678:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb6c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b74 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.142731:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.142741:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.142757:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094066.142804:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094066.142807:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094066.142821:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.142836:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cb6c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b74 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.142847:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b74 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.142853:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094066.142855:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094066.142857:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094066.142902:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:52127:x1870757013808768:12345-192.168.204.57@tcp:101:chown.0 Request processed in 267us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094066.142906:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 889 00000100:00100000:2.0:1784094066.143867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094066.143906:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013808896 00000100:00100000:0.0:1784094066.143911:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013808896 00000100:00100000:0.0:1784094066.143939:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 890 00000100:00100000:0.0:1784094066.143944:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:52127:x1870757013808896:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784094066.143950:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094066.143957:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b7b expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.143981:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.143988:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.143995:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144007:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144013:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144020:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144129:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb6e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144138:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144150:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094066.144173:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00000004:00200000:0.0:1784094066.144175:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094066.144183:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144191:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144195:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144200:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144203:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094066.144206:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144210:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144217:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094066.144218:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094066.144233:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144238:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb6d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144247:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144251:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144254:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144257:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094066.144258:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144262:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144266:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6b800) 00010000:00010000:0.0:1784094066.144267:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094066.144269:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144272:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cb6df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144290:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cb6d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b7b expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144300:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b7b expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.144311:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094066.144313:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094066.144315:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094066.144353:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52127:x1870757013808896:12345-192.168.204.57@tcp:101:chown.0 Request processed in 409us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094066.144358:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 890 00000100:00100000:2.0:1784094066.145267:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094066.145315:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013809152 00000100:00100000:3.0:1784094066.145325:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013809152 00000100:00100000:3.0:1784094066.145368:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 891 00000100:00100000:3.0:1784094066.145378:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:52127:x1870757013809152:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:3.0:1784094066.145452:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094066.145473:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cb6e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b7b expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.145488:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:3.0:1784094066.145495:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094066.145513:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.145522:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.145528:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.153528:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094066.155720:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967636 is committed 00000001:00080000:0.0:1784094066.155741:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967639 is committed 00000004:00010000:1.0:1784094066.155746:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004893d2d2 reply state 000000001a59d109 transno 4294967639 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094066.155756:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784094066.155829:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00080000:1.0:1784094066.155896:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784094066.155908:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52127:x1870757013809152:12345-192.168.204.57@tcp:36:chown.0 Request processed in 10531us (10641us total) trans 4294967639 rc 0/0 00000100:00100000:1.0:1784094066.155914:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 891 00010000:00010000:0.0:1784094066.155938:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.155946:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.155951:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.155955:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094066.155958:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.155963:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.155971:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcee00) 00010000:00010000:0.0:1784094066.155973:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094066.155975:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.155983:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cb6ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094066.281496:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094066.281504:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094066.281509:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094066.281560:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.281571:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.281581:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094066.281606:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024307712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094066.281679:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094066.281727:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307712 00000100:00100000:3.0:1784094066.281737:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307712 00000100:00100000:2.0:1784094066.281757:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1784094066.281799:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1784094066.281808:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024307712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094066.281822:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094066.281836:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb6f4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.281860:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.281873:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094066.281882:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094066.281959:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024307712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094066.281968:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1784094066.282001:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024307712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094066.282020:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.282027:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094066.282044:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094066.282047:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.282053:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094066.411885:0:87246:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdb6ef6a0 20000000:00000080:1.0:1784094066.411901:0:87246:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019dc400 uarg=0000000000000000 00010000:00010000:1.0:1784094066.412342:0:87246:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094066.412367:0:87246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b200) 00010000:00010000:1.0:1784094066.412370:0:87246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094066.412377:0:87246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb6ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b74 expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.412391:0:87246:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094066.412401:0:87246:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094066.412410:0:87246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.412432:0:87246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.412438:0:87246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.412468:0:87246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.412478:0:87246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 18 pid: 5772 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094066.412489:0:87246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87246:1870757024307840:0@lo:104: 00000100:00100000:1.0:1784094066.412535:0:87246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094066.412573:0:87246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379af840 going to sleep for 11 seconds 00000100:00100000:2.0:1784094066.412574:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307840 00000100:00100000:2.0:1784094066.412584:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307840 00000100:00100000:2.0:1784094066.412638:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784094066.412648:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:87246:x1870757024307840:12345-0@lo:104: 00010000:00010000:2.0:1784094066.412669:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.412728:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094066.412735:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:87246:x1870757024307840:12345-0@lo:104: Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094066.412743:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784094066.412745:0:87246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87246:1870757024307840:0@lo:104: 00010000:00010000:0.0:1784094066.412754:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094066.412762:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.412763:0:87246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.412779:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094066.412785:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.412791:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094066.412795:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094066.412799:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094066.412821:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.412826:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094066.412843:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094066.412849:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cb6f4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb6fb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094066.412851:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1784094066.412861:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094066.412864:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094066.412866:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024307968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094066.412866:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094066.412895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094066.412924:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024307968 00000100:00100000:1.0:1784094066.412929:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024307968 00010000:00010000:1.0:1784094066.412949:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 19 pid: 5772 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094066.412974:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1784094066.412982:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024307968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094066.412991:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094066.412996:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 19 pid: 5772 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413006:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 19 pid: 5772 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413016:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214cb6fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb6f4 expref: 19 pid: 5772 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413027:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413034:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413044:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413050:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413057:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413063:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413069:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094066.413072:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413080:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413095:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.413103:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094066.413120:0:87246:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.413130:0:87246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094066.413138:0:87246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214cb702 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094066.413143:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024307968:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094066.413155:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784094066.413168:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024307968:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784094066.671693:0:87294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6226c710 20000000:00000080:1.0:1784094066.671708:0:87294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019ddc00 uarg=0000000000000000 00010000:00010000:1.0:1784094066.671902:0:87294:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094066.671917:0:87294:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094066.671929:0:87294:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094066.671947:0:87294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.671961:0:87294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.671972:0:87294:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.671980:0:87294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.671988:0:87294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.671995:0:87294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.672002:0:87294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094066.672006:0:87294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.672014:0:87294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.672026:0:87294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.672033:0:87294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094066.672040:0:87294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12c00/0x9ce98053214cb709 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.177476:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094067.559981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094067.560024:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013809280 00000100:00100000:0.0:1784094067.560036:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013809280 00000100:00100000:0.0:1784094067.560104:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 14 00000100:00100000:0.0:1784094067.560114:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013809280:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094067.560131:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094067.560134:0:5764:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cb6ca) 00010000:00010000:0.0:1784094067.560136:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094067.560187:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013809280:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 76us (215us total) trans 0 rc 116/116 00000100:00100000:0.0:1784094067.560193:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 14 10000000:01000000:2.0:1784094067.689514:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094067.689522:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094067.689528:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094067.689580:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.689594:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.689607:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094067.689641:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101287100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024308096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094067.689728:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094067.689773:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024308096 00000100:00100000:0.0:1784094067.689783:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024308096 00000100:00100000:2.0:1784094067.689788:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1784094067.689846:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1784094067.689858:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024308096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094067.689874:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094067.689892:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cb710 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.689919:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cb710 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.689928:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb710 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.689935:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784094067.689981:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024308096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094067.689994:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1784094067.690026:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101287100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024308096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094067.690044:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.690058:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094067.690081:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094067.690087:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.690095:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094067.842289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094067.842356:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013809408 00000100:00100000:0.0:1784094067.842371:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013809408 00000100:00100000:0.0:1784094067.842467:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 892 00000100:00100000:0.0:1784094067.842481:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52232:x1870757013809408:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094067.842511:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094067.842536:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b82 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.842616:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.842632:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.842647:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094067.842903:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094067.842907:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094067.842979:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.843018:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b82 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.843036:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b82 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.843051:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094067.843055:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094067.843059:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784094067.843135:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:52232:x1870757013809408:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 657us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094067.843142:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 892 00000100:00100000:2.0:1784094067.844149:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094067.844214:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013809536 00000100:00100000:0.0:1784094067.844222:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013809536 00000100:00100000:0.0:1784094067.844266:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 893 00000100:00100000:0.0:1784094067.844275:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:52232:x1870757013809536:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094067.844290:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094067.844306:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb72c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b89 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844353:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844367:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844377:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844394:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844402:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844415:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844804:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb741 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844815:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.844823:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094067.844937:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1784094067.844942:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094067.845036:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845048:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845053:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845057:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845062:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.845071:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845079:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845096:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094067.845100:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094067.845105:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845112:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845122:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845129:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845136:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845140:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.845143:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845147:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845152:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6b800) 00010000:00010000:0.0:1784094067.845153:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094067.845156:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845162:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb73a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845208:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb72c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b89 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845223:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b89 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.845230:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:0.0:1784094067.845232:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094067.845235:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094067.845297:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52232:x1870757013809536:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 1022us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094067.845305:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 893 00000100:00100000:2.0:1784094067.846161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.846214:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013809792 00000100:00100000:1.0:1784094067.846221:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013809792 00000100:00100000:1.0:1784094067.846256:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 894 00000100:00100000:1.0:1784094067.846267:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52232:x1870757013809792:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784094067.846311:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094067.846325:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb741 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b89 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.846336:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6ba00) 00010000:00010000:1.0:1784094067.846342:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094067.846357:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.846364:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.846372:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094067.854199:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967640 is committed 00000004:00010000:3.0:1784094067.854204:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000009cfe3c25 reply state 00000000d1efb2eb transno 4294967640 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094067.854217:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094067.854296:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00080000:3.0:1784094067.854410:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784094067.854453:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52232:x1870757013809792:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 8183us (8286us total) trans 4294967640 rc 0/0 00000100:00100000:3.0:1784094067.854462:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 894 00010000:00010000:0.0:1784094067.854474:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.854483:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.854488:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.854494:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.854500:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.854508:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.854526:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784094067.854530:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094067.854536:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.854542:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb748 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094067.868804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094067.868861:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013809920 00000100:00100000:0.0:1784094067.868873:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013809920 00000100:00100000:0.0:1784094067.868949:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 895 00000100:00100000:0.0:1784094067.868965:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:52236:x1870757013809920:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094067.868996:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094067.869022:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb74f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b90 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869099:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869118:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869133:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869152:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869160:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869174:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869767:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb764 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869777:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.869785:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094067.869887:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:0.0:1784094067.869893:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094067.870005:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb764 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870020:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870028:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870035:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870042:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.870048:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870056:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870072:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094067.870077:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094067.870082:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870089:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870102:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870108:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870115:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870121:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.870124:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870130:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870140:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907202e6b200) 00010000:00010000:0.0:1784094067.870143:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094067.870146:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870153:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb75d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870206:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb74f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b90 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870229:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b90 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.870236:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094067.870239:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094067.870241:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784094067.870315:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52236:x1870757013809920:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1354us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094067.870324:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 895 00000100:00100000:0.0:1784094067.871232:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.871274:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013810176 00000100:00100000:1.0:1784094067.871281:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013810176 00000100:00100000:1.0:1784094067.871328:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 896 00000100:00100000:1.0:1784094067.871340:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52236:x1870757013810176:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094067.871349:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094067.871360:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb76b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b97 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.871652:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.871663:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.871678:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.871819:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.871839:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.871851:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094067.873398:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:1.0:1784094067.873776:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873784:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873791:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873822:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873827:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873832:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873837:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094067.873840:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873848:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873856:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b800) 00010000:00010000:1.0:1784094067.873859:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094067.873861:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873865:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb772 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094067.873875:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000dd6c6613 reply state 0000000063bbb972 transno 4294967641 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094067.873881:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784094067.873908:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb76b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b97 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873922:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b97 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.873927:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094067.873929:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094067.873931:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784094067.873994:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:52236:x1870757013810176:12345-192.168.204.57@tcp:101:touch.0 Request processed in 2659us (2765us total) trans 4294967641 rc 0/0 00000100:00100000:1.0:1784094067.874001:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 896 00010000:00010000:2.0:1784094067.874559:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.874568:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.874573:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.874578:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094067.874580:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.874584:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.874596:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907219c12400) 00010000:00010000:2.0:1784094067.874598:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094067.874600:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.874604:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb779 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094067.875175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.875230:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013810432 00000100:00100000:1.0:1784094067.875238:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013810432 00000100:00100000:1.0:1784094067.875288:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 897 00000100:00100000:1.0:1784094067.875300:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52236:x1870757013810432:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:1.0:1784094067.875344:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094067.875361:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b97 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.875374:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094067.875381:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094067.875401:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.875408:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.875413:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094067.875525:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a3a5d604 reply state 00000000fb415f14 transno 4294967642 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094067.875530:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094067.875578:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:52236:x1870757013810432:12345-192.168.204.57@tcp:36:touch.0 Request processed in 281us (405us total) trans 4294967642 rc 0/0 00000100:00100000:1.0:1784094067.875584:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 897 00010000:00010000:1.0:1784094067.875991:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.875998:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876008:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876014:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094067.876019:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876026:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876035:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784094067.876037:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094067.876040:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876046:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb78e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094067.876137:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.876195:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013810560 00000100:00100000:1.0:1784094067.876201:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013810560 00000100:00100000:1.0:1784094067.876238:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 898 00000100:00100000:1.0:1784094067.876250:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:52236:x1870757013810560:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094067.876260:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094067.876270:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb795 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5b9e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876294:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b9e expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876304:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b9e expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.876327:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094067.876329:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094067.876331:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784094067.876356:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:52236:x1870757013810560:12345-192.168.204.57@tcp:101:touch.0 Request processed in 112us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094067.876361:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 898 00000100:00100000:0.0:1784094067.877108:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094067.877145:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013810688 00000100:00100000:2.0:1784094067.877150:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013810688 00000100:00080000:0.0:1784094067.877202:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094067.877216:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 451 00000100:00100000:2.0:1784094067.877224:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013810688:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:2.0:1784094067.877488:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013810688:12345-192.168.204.57@tcp:2:touch.0 Request processed in 265us (382us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1784094067.877495:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 451 00000100:00100000:2.0:1784094067.878260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.878300:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013810944 00000100:00100000:1.0:1784094067.878306:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013810944 00000100:00100000:1.0:1784094067.878337:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 93 00000100:00100000:1.0:1784094067.878343:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:52236:x1870757013810944:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:1.0:1784094067.879633:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:52236:x1870757013810944:12345-192.168.204.57@tcp:35:touch.0 Request processed in 1288us (1371us total) trans 4294967643 rc 0/0 00000100:00100000:1.0:1784094067.879639:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 93 00000100:00100000:1.0:1784094067.896756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094067.896831:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013811072 00000100:00100000:0.0:1784094067.896846:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013811072 00000100:00100000:0.0:1784094067.896909:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 899 00000100:00100000:0.0:1784094067.896918:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52240:x1870757013811072:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094067.896945:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094067.896966:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb79c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ba5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897028:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897041:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897058:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897068:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897073:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897077:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897164:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897169:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897173:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094067.897220:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 0 00000004:00200000:0.0:1784094067.897224:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094067.897243:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897252:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897258:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897266:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897271:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897275:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.897278:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897282:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897292:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094067.897294:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094067.897297:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897301:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cb7a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897308:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897312:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897316:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897319:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094067.897321:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897325:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897329:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907202e6b200) 00010000:00010000:0.0:1784094067.897330:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094067.897331:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897334:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cb7aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897355:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb79c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ba5 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897363:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ba5 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094067.897367:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784094067.897368:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094067.897370:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094067.897457:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52240:x1870757013811072:12345-192.168.204.57@tcp:101:rm.0 Request processed in 539us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094067.897463:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 899 00000100:00100000:0.0:1784094067.898474:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.898518:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013811200 00000100:00100000:1.0:1784094067.898526:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013811200 00000100:00100000:1.0:1784094067.898571:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 452 00000100:00100000:1.0:1784094067.898580:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013811200:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094067.898594:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094067.898609:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bac expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094067.898639:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x6a571d74, atime: 0x6a571d74, ctime: 0x6a571d74, blocks: 0x1 00010000:00010000:1.0:1784094067.898655:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1228s v=(0 0) 00010000:00010000:1.0:1784094067.898659:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094067.898668:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.898686:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 7 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.898699:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784094067.898746:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013811200:12345-192.168.204.57@tcp:101:rm.0 Request processed in 168us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094067.898750:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 452 00000100:00100000:2.0:1784094067.899661:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094067.899699:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013811456 00000100:00100000:1.0:1784094067.899704:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013811456 00000100:00100000:1.0:1784094067.899730:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 900 00000100:00100000:1.0:1784094067.899736:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:52240:x1870757013811456:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784094067.899766:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784094067.899782:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cb7b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ba5 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899795:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b9e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899804:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094067.899811:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094067.899827:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899839:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899848:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899862:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899867:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899871:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899946:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899951:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.899955:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094067.900380:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off9984 00000004:00080000:1.0:1784094067.900401:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228977978325ns, next at 1229977973535ns, rc = 0 00010000:00010000:1.0:1784094067.900489:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900497:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900503:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900508:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900514:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900519:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900537:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094067.900555:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900561:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900567:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900572:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094067.900576:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900583:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900593:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12d00) 00010000:00010000:3.0:1784094067.900597:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094067.900597:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094067.900613:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900614:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900634:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094067.900638:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb7cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900639:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900662:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900676:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff907219c12d00) 00010000:00010000:3.0:1784094067.900679:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784094067.900680:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900681:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900705:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb7d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900715:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900723:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094067.900725:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094067.900728:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094067.900731:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094067.900738:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094067.900742:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900748:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900757:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b800) 00010000:00010000:1.0:1784094067.900759:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094067.900763:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094067.900768:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb7bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094067.900783:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000003906410 reply state 00000000b5263607 transno 4294967644 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094067.900791:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094067.900840:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:52240:x1870757013811456:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1103us (1180us total) trans 4294967644 rc 0/0 00000100:00100000:1.0:1784094067.900847:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 900 00010000:00010000:2.0:1784094067.901357:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.901365:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.901369:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.901372:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094067.901375:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.901380:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.901388:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907219c12b00) 00010000:00010000:2.0:1784094067.901389:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094067.901392:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094067.901396:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb7c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.088328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.088382:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013811584 00000100:00100000:3.0:1784094068.088393:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013811584 00000100:00100000:2.0:1784094068.088475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.088481:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 798 00000100:00100000:3.0:1784094068.088493:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013811584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094068.088505:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013811712 00000100:00100000:0.0:1784094068.088517:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013811712 00000100:00080000:2.0:1784094068.088563:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094068.088579:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:0.0:1784094068.088591:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013811712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094068.088637:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013811712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 47us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094068.088640:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013811584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 144us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094068.088647:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:3.0:1784094068.088657:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 798 00010000:00010000:3.0:1784094068.201567:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094068.202818:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.202856:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013811840 00000100:00100000:2.0:1784094068.202868:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013811840 00000100:00100000:2.0:1784094068.202940:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 901 00000100:00100000:2.0:1784094068.202950:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52255:x1870757013811840:12345-192.168.204.57@tcp:101:chmod.0 00000100:00080000:0.0:1784094068.202954:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784094068.202976:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094068.202997:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb7db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bb3 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.203075:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb7e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.203089:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.203098:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094068.203198:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:2.0:1784094068.203201:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094068.203227:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.203255:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb7db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bb3 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.203273:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bb3 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.203284:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b800) 00010000:00010000:2.0:1784094068.203287:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094068.203292:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094068.203353:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52255:x1870757013811840:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 405us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.203360:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 901 00000100:00100000:2.0:1784094068.204441:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094068.204471:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013812096 00000100:00100000:0.0:1784094068.204476:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013812096 00000100:00100000:0.0:1784094068.204507:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:0.0:1784094068.204516:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52255:x1870757013812096:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094068.204552:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094068.204567:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb7e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bb3 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.204585:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cb764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b90 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.204592:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094068.204600:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094068.204614:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.204620:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.204626:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094068.212714:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967645 is committed 00000004:00010000:0.0:1784094068.212727:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000aa1933b1 reply state 00000000b3bdc5f1 transno 4294967645 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094068.212730:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000100:00100000:0.0:1784094068.212740:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094068.212844:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:2.0:1784094068.212859:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024308224:0@lo:6:osp-syn-1-0.0 00010000:00080000:0.0:1784094068.212930:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094068.212936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094068.212948:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52255:x1870757013812096:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 8432us (8525us total) trans 4294967645 rc 0/0 00000100:00100000:0.0:1784094068.212956:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:2.0:1784094068.212999:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024308224 00000100:00100000:2.0:1784094068.213005:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024308224 00000100:00080000:0.0:1784094068.213037:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784094068.213038:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.213047:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.213051:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00010000:00010000:1.0:1784094068.213059:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.213064:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024308224:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784094068.213069:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094068.213073:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.213079:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784094068.213090:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:28 count 1 00010000:00010000:1.0:1784094068.213091:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907202e6b200) 00010000:00010000:1.0:1784094068.213096:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094068.213098:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.213103:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cb7e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.213109:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.213125:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.213132:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784094068.213136:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094068.213140:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.213165:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.213191:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 6 pid: 6572 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.213205:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024308352:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094068.213250:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907201254600 going to sleep for 11 seconds 00000100:00100000:2.0:1784094068.214068:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024308352:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094068.214089:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094068.214372:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094068.214405:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013812224 00000100:00100000:1.0:1784094068.214409:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013812224 00010000:00010000:1.0:1784094068.214450:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 7 pid: 6572 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094068.214477:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 305 00000100:00100000:1.0:1784094068.214486:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013812224:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094068.214497:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094068.214503:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 7 pid: 6572 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.214517:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 7 pid: 6572 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.214535:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cb7b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bac expref: 7 pid: 6572 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.214547:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094068.214551:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094068.214557:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.214567:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.214595:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094068.214622:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094068.214622:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013812224:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 137us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094068.214639:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 305 00010000:00010000:2.0:1784094068.214650:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.214660:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.214669:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.214689:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094068.214696:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094068.214702:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.214709:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094068.214713:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.214719:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.214728:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.214734:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097171904/0x9ce98053214cb7f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.214752:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094068.214754:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094068.214755:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094068.215168:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024308224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2105us (2231us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1784094068.215177:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000004:00080000:0.0:1784094068.215197:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230e48e00/2, rc 0, transno 4294967353 00000100:00100000:0.0:1784094068.215203:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024308224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784094068.230931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.230978:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013812352 00000100:00100000:3.0:1784094068.230992:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013812352 00000100:00100000:3.0:1784094068.231058:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 903 00000100:00100000:3.0:1784094068.231072:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:52259:x1870757013812352:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094068.231103:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094068.231127:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb7f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bba expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.231218:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.231237:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.231252:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.231269:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.231277:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.231285:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232234:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb80c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232250:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232258:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094068.232357:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:3.0:1784094068.232362:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094068.232607:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb80c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232625:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232634:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232642:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232649:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094068.232654:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232663:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232678:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:3.0:1784094068.232682:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094068.232688:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232701:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb7fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232713:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232721:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232728:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232734:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094068.232737:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232744:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232751:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fce600) 00010000:00010000:3.0:1784094068.232754:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094068.232758:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232765:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb805 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232798:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb7f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bba expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232814:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb80c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bba expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.232823:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784094068.232826:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094068.232828:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784094068.232901:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52259:x1870757013812352:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1832us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094068.232911:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 903 00000100:00100000:0.0:1784094068.234047:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.234087:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013812608 00000100:00100000:2.0:1784094068.234094:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013812608 00000100:00100000:2.0:1784094068.234126:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 904 00000100:00100000:2.0:1784094068.234135:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52259:x1870757013812608:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784094068.234144:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094068.234152:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb813 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bc1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.234389:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.234398:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.234407:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.234441:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.234447:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.234453:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094068.235291:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:2.0:1784094068.235633:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235640:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235647:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235684:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235692:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235699:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235705:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.235710:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235714:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235721:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784094068.235723:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.235726:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235730:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb81a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094068.235740:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a4a7eed7 reply state 0000000067641e24 transno 4294967646 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.235748:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094068.235771:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb813 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bc1 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235785:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bc1 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.235790:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784094068.235792:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094068.235794:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094068.235838:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:52259:x1870757013812608:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1706us (1792us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1784094068.235844:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 904 00010000:00010000:2.0:1784094068.236370:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.236378:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.236382:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.236386:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.236389:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.236393:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.236402:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff90721a781e00) 00010000:00010000:2.0:1784094068.236404:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.236407:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.236411:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb821 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094068.236910:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.236954:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013812864 00000100:00100000:2.0:1784094068.236961:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013812864 00000100:00100000:2.0:1784094068.237003:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 905 00000100:00100000:2.0:1784094068.237013:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:52259:x1870757013812864:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:2.0:1784094068.237055:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094068.237071:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bc1 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.237089:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784094068.237097:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094068.237126:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.237135:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.237144:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094068.237239:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e260cba6 reply state 00000000bfda8750 transno 4294967647 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.237247:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094068.237299:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:52259:x1870757013812864:12345-192.168.204.57@tcp:36:touch.0 Request processed in 287us (391us total) trans 4294967647 rc 0/0 00000100:00100000:2.0:1784094068.237307:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 905 00010000:00010000:1.0:1784094068.237780:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.237790:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.237797:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.237803:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094068.237806:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.237813:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.237822:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff90721a781200) 00010000:00010000:1.0:1784094068.237825:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094068.237828:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.237834:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb836 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094068.237955:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094068.237984:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013812992 00000100:00100000:1.0:1784094068.237989:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013812992 00000100:00100000:1.0:1784094068.238019:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:1.0:1784094068.238024:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52259:x1870757013812992:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094068.238034:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094068.238046:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb83d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bc8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.238079:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb83d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bc8 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.238092:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb83d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bc8 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.238111:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094068.238114:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094068.238117:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784094068.238147:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:52259:x1870757013812992:12345-192.168.204.57@tcp:101:touch.0 Request processed in 123us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094068.238152:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:0.0:1784094068.239101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094068.239136:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013813120 00000100:00100000:1.0:1784094068.239141:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013813120 00000100:00100000:1.0:1784094068.239167:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 454 00000100:00100000:1.0:1784094068.239172:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013813120:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:1.0:1784094068.239379:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013813120:12345-192.168.204.57@tcp:2:touch.0 Request processed in 206us (279us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784094068.239383:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 454 00000100:00100000:0.0:1784094068.240098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.240132:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013813376 00000100:00100000:3.0:1784094068.240138:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013813376 00000100:00100000:3.0:1784094068.240174:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 94 00000100:00100000:3.0:1784094068.240194:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:52259:x1870757013813376:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:3.0:1784094068.240364:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:52259:x1870757013813376:12345-192.168.204.57@tcp:35:touch.0 Request processed in 183us (267us total) trans 4294967648 rc 0/0 00000100:00100000:3.0:1784094068.240370:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 94 00000100:00100000:0.0:1784094068.257334:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.257391:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013813504 00000100:00100000:2.0:1784094068.257402:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013813504 00000100:00100000:2.0:1784094068.257475:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 907 00000100:00100000:2.0:1784094068.257484:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52263:x1870757013813504:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094068.257512:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094068.257535:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bcf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257604:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257621:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257630:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257640:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257644:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257648:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257737:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257741:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257745:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094068.257778:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00000004:00200000:2.0:1784094068.257781:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094068.257799:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257807:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257816:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257821:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257825:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257829:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.257832:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257838:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257847:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784094068.257849:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.257853:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257857:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb84b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257869:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257873:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257877:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257880:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.257882:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257885:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257889:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff90721a781d00) 00010000:00010000:2.0:1784094068.257890:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.257892:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257895:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257915:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bcf expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257925:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bcf expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.257929:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff907219c12900) 00010000:00010000:2.0:1784094068.257930:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094068.257931:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784094068.257986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52263:x1870757013813504:12345-192.168.204.57@tcp:101:rm.0 Request processed in 504us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.257991:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 907 00000100:00100000:0.0:1784094068.259051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.259090:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013813632 00000100:00100000:2.0:1784094068.259096:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013813632 00000100:00100000:2.0:1784094068.259129:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 455 00000100:00100000:2.0:1784094068.259136:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013813632:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094068.259143:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094068.259152:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bd6 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094068.259172:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x6a571d74, atime: 0x6a571d74, ctime: 0x6a571d74, blocks: 0x1 00010000:00010000:2.0:1784094068.259195:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=1229s v=(0 0) 00010000:00010000:2.0:1784094068.259199:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094068.259207:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 7 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.259220:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 7 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.259228:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094068.259250:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013813632:12345-192.168.204.57@tcp:101:rm.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.259254:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 455 00000100:00100000:1.0:1784094068.260127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.260164:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013813888 00000100:00100000:2.0:1784094068.260171:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013813888 00000100:00100000:2.0:1784094068.260215:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 908 00000100:00100000:2.0:1784094068.260225:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52263:x1870757013813888:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784094068.260259:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094068.260275:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bcf expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260294:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cb83d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bc8 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260304:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff907219c12900) 00010000:00010000:2.0:1784094068.260313:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094068.260324:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260334:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260342:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260354:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260361:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260368:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260454:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260462:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.260470:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094068.261079:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 64 off10048 00000004:00080000:2.0:1784094068.261092:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229338669420ns, next at 1230338666456ns, rc = 0 00010000:00010000:2.0:1784094068.261153:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261162:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261171:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261178:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261197:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261202:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261220:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094068.261235:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261241:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261247:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261250:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094068.261254:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094068.261260:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261261:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261280:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261281:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094068.261288:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261293:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff90721a781300) 00010000:00010000:2.0:1784094068.261300:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094068.261303:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261304:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261317:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb875 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261324:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff90721a781300) 00010000:00010000:0.0:1784094068.261329:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094068.261331:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261333:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261348:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261350:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb87c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261362:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261373:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.261377:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261384:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094068.261384:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094068.261388:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094068.261391:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094068.261396:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784094068.261400:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.261404:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261410:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cb867 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094068.261435:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000786fa9d2 reply state 00000000e47a74d1 transno 4294967649 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.261445:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094068.261490:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52263:x1870757013813888:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1266us (1361us total) trans 4294967649 rc 0/0 00000100:00100000:2.0:1784094068.261499:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 908 00010000:00010000:2.0:1784094068.261916:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261925:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261931:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261938:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.261941:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261948:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261957:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff90721a781f00) 00010000:00010000:2.0:1784094068.261960:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.261963:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.261969:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cb86e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094068.568272:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094068.568325:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814016 00000100:00100000:1.0:1784094068.568335:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814016 00000100:00100000:1.0:1784094068.568400:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 909 00000100:00100000:1.0:1784094068.568414:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:52277:x1870757013814016:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094068.568459:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094068.568479:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bdd expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.568567:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb88a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.568580:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.568590:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094068.568665:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:1.0:1784094068.568670:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094068.568699:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb88a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.568723:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cb883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bdd expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.568736:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb88a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bdd expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.568743:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce500) 00010000:00010000:1.0:1784094068.568746:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094068.568749:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784094068.568806:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:52277:x1870757013814016:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 397us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094068.568812:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 909 00000100:00100000:1.0:1784094068.569931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.569966:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814272 00000100:00100000:3.0:1784094068.569972:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814272 00000100:00100000:3.0:1784094068.570000:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 910 00000100:00100000:3.0:1784094068.570006:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52277:x1870757013814272:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094068.570038:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094068.570052:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cb88a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bdd expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.570065:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb80c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bba expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.570072:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784094068.570081:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094068.570099:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.570108:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.570117:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094068.570362:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000984858f0 reply state 00000000e8815fcb transno 4294967650 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094068.570371:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094068.570381:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:3.0:1784094068.570438:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52277:x1870757013814272:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 431us (506us total) trans 4294967650 rc 0/0 00000100:00100000:3.0:1784094068.570443:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 910 00010000:00010000:1.0:1784094068.570888:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.570895:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.570900:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.570904:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094068.570907:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.570913:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.570920:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce600) 00010000:00010000:1.0:1784094068.570922:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094068.570925:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094068.570929:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cb891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094068.613397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.613463:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814400 00000100:00100000:2.0:1784094068.613471:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814400 00000100:00100000:2.0:1784094068.613513:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 911 00000100:00100000:2.0:1784094068.613521:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013814400:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094068.613596:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013814400:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.613601:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 911 00000100:00100000:3.0:1784094068.614164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.614219:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814528 00000100:00100000:2.0:1784094068.614224:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814528 00000100:00100000:2.0:1784094068.614255:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 456 00000100:00100000:2.0:1784094068.614261:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52289:x1870757013814528:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094068.614510:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52289:x1870757013814528:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 248us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.614515:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 456 00000100:00100000:0.0:1784094068.615028:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094068.615059:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814656 00000100:00100000:1.0:1784094068.615064:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814656 00000100:00100000:1.0:1784094068.615091:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 457 00000100:00100000:1.0:1784094068.615097:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:52289:x1870757013814656:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094068.615265:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:52289:x1870757013814656:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 168us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094068.615270:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 457 00000100:00100000:1.0:1784094068.615853:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.615893:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814784 00000100:00100000:3.0:1784094068.615901:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814784 00000100:00100000:3.0:1784094068.615940:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 912 00000100:00100000:3.0:1784094068.615950:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013814784:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094068.616262:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013814784:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 313us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094068.616275:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 912 00000100:00100000:3.0:1784094068.618042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.618086:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013814912 00000100:00100000:2.0:1784094068.618094:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013814912 00000100:00100000:2.0:1784094068.618138:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 913 00000100:00100000:2.0:1784094068.618148:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013814912:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094068.618214:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013814912:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 68us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.618222:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 913 00000100:00100000:0.0:1784094068.618790:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.618829:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815040 00000100:00100000:2.0:1784094068.618833:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815040 00000100:00100000:2.0:1784094068.618855:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 458 00000100:00100000:2.0:1784094068.618859:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52289:x1870757013815040:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094068.619032:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52289:x1870757013815040:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 169us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.619037:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 458 00000100:00100000:1.0:1784094068.619592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.619625:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815168 00000100:00100000:2.0:1784094068.619630:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815168 00000100:00100000:2.0:1784094068.619658:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:2.0:1784094068.619666:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:52289:x1870757013815168:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094068.619850:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:52289:x1870757013815168:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 184us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.619858:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 459 00000100:00100000:3.0:1784094068.620344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.620385:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815296 00000100:00100000:2.0:1784094068.620390:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815296 00000100:00100000:2.0:1784094068.620417:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 914 00000100:00100000:2.0:1784094068.620447:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013815296:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094068.620695:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52289:x1870757013815296:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 249us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.620703:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 914 00000100:00100000:0.0:1784094068.640631:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.640690:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815424 00000100:00100000:3.0:1784094068.640705:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815424 00000100:00100000:3.0:1784094068.640768:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 915 00000100:00100000:3.0:1784094068.640783:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:52293:x1870757013815424:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784094068.640805:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094068.640828:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5be4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.640888:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.640902:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.640911:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.640921:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.640925:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.640929:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641218:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb8ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641227:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb8ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641234:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb8ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094068.641275:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:3.0:1784094068.641280:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094068.641308:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb8ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641322:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641329:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641335:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641342:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094068.641348:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641356:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641371:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:3.0:1784094068.641374:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094068.641379:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641386:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb89f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641398:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641409:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641415:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641471:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094068.641474:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641480:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641488:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fce500) 00010000:00010000:3.0:1784094068.641492:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094068.641495:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641501:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641539:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5be4 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641554:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb8ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5be4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.641562:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784094068.641565:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094068.641568:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094068.641648:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:52293:x1870757013815424:12345-192.168.204.57@tcp:101:dd.0 Request processed in 871us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094068.641656:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 915 00000100:00100000:1.0:1784094068.643112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.643169:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815680 00000100:00100000:2.0:1784094068.643189:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815680 00000100:00100000:2.0:1784094068.643240:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 916 00000100:00100000:2.0:1784094068.643247:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52293:x1870757013815680:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094068.643264:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094068.643280:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb8b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5beb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643397:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643407:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643414:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643460:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643466:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643470:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094068.643812:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1784094068.643921:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb8c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643927:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643932:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643953:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643961:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643966:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643969:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.643972:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643976:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643983:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784094068.643985:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.643988:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.643991:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cb8bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094068.644000:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c31953da reply state 0000000051028519 transno 4294967651 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.644006:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094068.644022:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb8b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5beb expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644032:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5beb expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644040:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784094068.644042:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094068.644043:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784094068.644091:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+15:52293:x1870757013815680:12345-192.168.204.57@tcp:101:dd.0 Request processed in 845us (983us total) trans 4294967651 rc 0/0 00000100:00100000:2.0:1784094068.644095:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 916 00010000:00010000:2.0:1784094068.644856:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644865:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644870:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644874:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094068.644876:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644881:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644889:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff90721a781f00) 00010000:00010000:2.0:1784094068.644891:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094068.644893:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.644897:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cb8c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094068.648122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.648197:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815808 00000100:00100000:2.0:1784094068.648209:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815808 00000100:00100000:2.0:1784094068.648265:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 460 00000100:00100000:2.0:1784094068.648277:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:52293:x1870757013815808:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094068.648296:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094068.648318:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bf2 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094068.648348:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784094068.648386:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=1229s v=(0 0) 00010000:00010000:2.0:1784094068.648392:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094068.648404:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.648447:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 7 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.648462:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784094068.648517:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:52293:x1870757013815808:12345-192.168.204.57@tcp:101:dd.0 Request processed in 243us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.648523:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 460 00000100:00100000:0.0:1784094068.657500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.657546:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013815936 00000100:00100000:3.0:1784094068.657558:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013815936 00002000:00100000:3.0:1784094068.657611:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff90723d705180 x1870757013815936/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:389/0 lens 488/0 e 0 to 0 dl 1784094079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784094068.657619:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d705180 with x1870757013815936 ext(0->1048575) 00002000:00010000:3.0:1784094068.657624:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d705180 00000100:00100000:3.0:1784094068.657651:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 22 00000100:00100000:3.0:1784094068.657658:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013815936:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784094068.663456:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:2352:x1870757013815936:12345-192.168.204.57@tcp:4:dd.0 Request processed in 5789us (5957us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784094068.663468:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 22 00002000:00100000:1.0:1784094068.663481:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff90723d705180 x1870757013815936/t4294967354(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:389/0 lens 488/448 e 0 to 0 dl 1784094079 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784094068.663489:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d705180 with x1870757013815936 ext(0->1048575) 00002000:00010000:1.0:1784094068.663495:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d705180 00000100:00100000:0.0:1784094068.664645:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.664705:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816064 00000100:00100000:2.0:1784094068.664713:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816064 00000100:00100000:2.0:1784094068.664752:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 917 00000100:00100000:2.0:1784094068.664758:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+14:52293:x1870757013816064:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:0.0:1784094068.673669:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967651 is committed 00000004:00080000:0.0:1784094068.673687:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00000100:00100000:2.0:1784094068.673793:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52293:x1870757013816064:12345-192.168.204.57@tcp:44:dd.0 Request processed in 9026us (9139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.673806:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 917 00000100:00100000:0.0:1784094068.673870:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024308480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784094068.673936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094068.673985:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024308480 00000100:00100000:2.0:1784094068.673994:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024308480 00000100:00080000:1.0:1784094068.674053:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094068.674063:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1784094068.674078:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024308480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784094068.674111:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:2.0:1784094068.674139:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.674163:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 6 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.674182:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094068.674187:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094068.674192:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.674227:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 6 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094068.674243:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 6 pid: 8031 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094068.674256:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024308608:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094068.674316:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839840 going to sleep for 11 seconds 00000100:00100000:0.0:1784094068.675053:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094068.675091:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816192 00000100:00100000:2.0:1784094068.675095:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816192 00000100:00100000:2.0:1784094068.675119:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 462 00000100:00100000:2.0:1784094068.675123:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013816192:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:2.0:1784094068.675316:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024308608:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094068.675335:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094068.675541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.675576:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816320 00000100:00100000:3.0:1784094068.675582:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816320 00010000:00010000:3.0:1784094068.675606:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 7 pid: 8031 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094068.675633:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 306 00000100:00100000:3.0:1784094068.675645:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013816320:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784094068.675653:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094068.675659:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 7 pid: 8031 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675671:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 7 pid: 8031 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675694:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7764fbd/0x9ce98053214cb860 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bd6 expref: 7 pid: 8031 timeout: 1329 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675705:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094068.675708:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094068.675712:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675719:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675745:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094068.675776:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013816320:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 136us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094068.675784:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 306 00010000:00010000:3.0:1784094068.675829:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675834:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675841:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675846:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.675861:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784094068.676773:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024308480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2700us (2835us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1784094068.676784:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00010000:00010000:3.0:1784094068.676817:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094068.676826:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.676836:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094068.676842:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.676853:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.676868:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.676876:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74242d4/0x9ce98053214cb8de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094068.676898:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094068.676900:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094068.676904:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784094068.676938:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230e4ad80/2, rc 0, transno 4294967355 00000100:00100000:3.0:1784094068.676945:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024308480:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1784094068.685692:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000001:00080000:1.0:1784094068.685709:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000100:00100000:2.0:1784094068.685781:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013816192:12345-192.168.204.57@tcp:16:dd.0 Request processed in 10646us (10718us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.685794:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 462 00000100:00100000:1.0:1784094068.687027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094068.687065:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816576 00000100:00100000:3.0:1784094068.687075:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816576 00000100:00100000:3.0:1784094068.687118:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 95 00000100:00100000:3.0:1784094068.687125:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:52293:x1870757013816576:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:3.0:1784094068.687493:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:52293:x1870757013816576:12345-192.168.204.57@tcp:35:dd.0 Request processed in 368us (469us total) trans 4294967652 rc 0/0 00000100:00100000:3.0:1784094068.687500:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 95 00000100:00100000:3.0:1784094068.713606:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094068.713606:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024308992:0@lo:400:kworker.0 00000100:00100000:2.0:1784094068.713632:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024309120:0@lo:400:kworker.0 00000100:00100000:1.0:1784094068.713636:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024308736:0@lo:400:kworker.0 00000100:00100000:2.0:1784094068.713698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094068.713708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094068.713739:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024309120 00000100:00100000:0.0:1784094068.713748:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024309120 00000100:00100000:1.0:1784094068.713750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094068.713826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094068.713830:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024308864 00000100:00100000:3.0:1784094068.713836:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024308864 00000100:00100000:0.0:1784094068.713840:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024308992 00000100:00100000:0.0:1784094068.713845:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024308992 00000100:00100000:1.0:1784094068.713847:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024309248:0@lo:400:kworker.0 00000100:00100000:3.0:1784094068.713885:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1784094068.713892:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1784094068.713896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094068.713905:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1784094068.713906:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024309120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094068.713907:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024308864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094068.713918:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024308992:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784094068.713938:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56033280 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784094068.713964:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024308736 00000100:00100000:1.0:1784094068.713974:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024308736 00000100:00100000:2.0:1784094068.713995:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024309120:12345-0@lo:400:kworker.0 Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094068.713998:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024308992:12345-0@lo:400:kworker.0 Request processed in 82us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094068.714004:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1784094068.714011:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1784094068.714022:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024308864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094068.714034:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1784094068.714036:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024309248 00000100:00100000:2.0:1784094068.714040:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024309248 00000100:00100000:1.0:1784094068.714053:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1784094068.714070:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024308736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094068.714084:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000100:00100000:0.0:1784094068.714084:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000004:00080000:3.0:1784094068.714092:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230e48e00, transno 4294967353 00000100:00100000:0.0:1784094068.714095:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024309248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094068.714115:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024308992:0@lo:400:kworker.0 00000100:00100000:3.0:1784094068.714128:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094068.714161:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024309120:0@lo:400:kworker.0 00000100:00100000:0.0:1784094068.714171:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024309248:12345-0@lo:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094068.714185:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024308736:12345-0@lo:400:kworker.0 Request processed in 101us (417us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094068.714207:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094068.714214:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1784094068.714214:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1784094068.714275:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024308736:0@lo:400:kworker.0 00000100:00100000:0.0:1784094068.714291:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024309248:0@lo:400:kworker.0 00000001:00080000:0.0:1784094069.063660:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967652 is committed 00010000:00010000:3.0:1784094069.225546:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784094069.433477:0:87683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230511052641ns, next at 1230338666456ns, rc = 0 00000004:00080000:1.0:1784094069.433556:0:87683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230511133378ns, next at 1229977973535ns, rc = 0 00000004:00080000:0.0:1784094069.434304:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 76 committed 00000004:00080000:0.0:1784094069.434818:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00000001:00080000:2.0:1784094069.829344:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000001:00080000:2.0:1784094069.829361:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000100:00100000:0.0:1784094069.861830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094069.861875:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816704 00000100:00100000:2.0:1784094069.861885:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816704 00000100:00100000:2.0:1784094069.861939:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 918 00000100:00100000:2.0:1784094069.861951:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013816704:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094069.862041:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013816704:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094069.862049:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 918 00000100:00100000:2.0:1784094069.863190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094069.863229:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816832 00000100:00100000:1.0:1784094069.863233:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816832 00000100:00100000:1.0:1784094069.863258:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:1.0:1784094069.863265:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:52485:x1870757013816832:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094069.863523:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:52485:x1870757013816832:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 259us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094069.863528:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 463 00000100:00100000:1.0:1784094069.864120:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094069.864149:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013816960 00000100:00100000:2.0:1784094069.864164:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013816960 00000100:00080000:1.0:1784094069.864200:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094069.864204:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 464 00000100:00100000:2.0:1784094069.864211:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:52485:x1870757013816960:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094069.864415:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:52485:x1870757013816960:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 204us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094069.864648:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 464 00000100:00100000:0.0:1784094069.865031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094069.865061:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817088 00000100:00100000:2.0:1784094069.865065:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817088 00000100:00100000:2.0:1784094069.865090:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 919 00000100:00100000:2.0:1784094069.865095:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013817088:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094069.865308:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013817088:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 212us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094069.865313:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 919 00000100:00100000:0.0:1784094069.866384:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094069.866438:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817216 00000100:00100000:1.0:1784094069.866443:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817216 00000100:00100000:1.0:1784094069.866477:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 920 00000100:00100000:1.0:1784094069.866485:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013817216:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094069.866521:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013817216:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094069.866526:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 920 00000100:00100000:1.0:1784094069.867099:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094069.867135:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817344 00000100:00100000:2.0:1784094069.867138:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817344 00000100:00100000:2.0:1784094069.867176:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 465 00000100:00100000:2.0:1784094069.867183:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:52485:x1870757013817344:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094069.867390:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:52485:x1870757013817344:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 207us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094069.867397:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 465 00000100:00100000:0.0:1784094069.867949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094069.867976:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817472 00000100:00100000:1.0:1784094069.867980:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817472 00000100:00100000:1.0:1784094069.868005:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 466 00000100:00100000:1.0:1784094069.868013:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:52485:x1870757013817472:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094069.868214:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:52485:x1870757013817472:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 202us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094069.868220:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 466 00000100:00100000:0.0:1784094069.868788:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094069.868862:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817600 00000100:00100000:2.0:1784094069.868868:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817600 00000100:00100000:2.0:1784094069.868906:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 921 00000100:00100000:2.0:1784094069.868916:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013817600:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094069.869230:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52485:x1870757013817600:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 316us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094069.869239:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 921 00000100:00100000:2.0:1784094069.890453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094069.890490:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817856 00000100:00100000:3.0:1784094069.890499:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817856 00000100:00100000:3.0:1784094069.890543:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 922 00000100:00100000:3.0:1784094069.890550:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52489:x1870757013817856:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094069.890590:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094069.890611:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb8c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5beb expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890626:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff90721a781d00) 00010000:00010000:3.0:1784094069.890634:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094069.890650:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890659:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890665:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890675:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890679:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890683:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890939:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890944:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.890948:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094069.891559:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10048 00000004:00080000:3.0:1784094069.891566:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230969143330ns, next at 1231969141806ns, rc = 0 00010000:00010000:3.0:1784094069.891625:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891631:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891636:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891640:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891644:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891648:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891661:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094069.891675:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094069.891677:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891683:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094069.891683:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891702:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094069.891703:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094069.891709:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891710:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094069.891716:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094069.891721:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891723:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094069.891744:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff907204fcee00) 00010000:00010000:0.0:1784094069.891748:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784094069.891751:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff907204fcee00) 00010000:00010000:0.0:1784094069.891752:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891756:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094069.891760:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094069.891762:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cb8fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891768:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb8f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094069.891776:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094069.891779:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094069.891781:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094069.891785:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891790:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891793:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891796:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094069.891797:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891801:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891805:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784094069.891806:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094069.891808:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094069.891812:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb8e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094069.891817:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d76a8619 reply state 00000000348bfbbe transno 4294967653 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094069.891821:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094069.891872:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:52489:x1870757013817856:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1323us (1427us total) trans 4294967653 rc 0/0 00000100:00100000:3.0:1784094069.891878:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 922 00010000:00010000:1.0:1784094069.892523:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094069.892536:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094069.892541:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094069.892545:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094069.892548:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094069.892553:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094069.892565:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907204fce100) 00010000:00010000:1.0:1784094069.892567:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094069.892569:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094069.892573:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cb8ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094070.249516:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784094070.563816:0:87828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231641392255ns, next at 1230338666456ns, rc = 0 00000004:00080000:1.0:1784094070.563899:0:87828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231641476536ns, next at 1231969141806ns, rc = 0 00000004:00080000:0.0:1784094070.573345:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 77 committed 00000001:00080000:0.0:1784094070.573383:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967653 is committed 00000004:00080000:0.0:1784094070.573391:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00000100:00100000:0.0:1784094070.573612:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024309376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784094070.573693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094070.573727:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024309376 00000100:00100000:1.0:1784094070.573735:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024309376 00000100:00080000:3.0:1784094070.573777:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094070.573807:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1784094070.573816:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024309376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784094070.573843:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:29 count 1 00010000:00010000:1.0:1784094070.573864:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.573881:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.573887:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784094070.573891:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094070.573894:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.573915:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.573926:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 5 pid: 6572 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094070.573935:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024309504:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784094070.574019:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66a80 going to sleep for 11 seconds 00000004:00080000:1.0:1784094070.574471:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000100:00100000:1.0:1784094070.575250:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024309504:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784094070.575269:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094070.575344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094070.575393:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013817984 00000100:00100000:1.0:1784094070.575399:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013817984 00010000:00010000:1.0:1784094070.575449:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 6 pid: 6572 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094070.575476:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 307 00000100:00100000:1.0:1784094070.575484:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013817984:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094070.575494:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094070.575500:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 6 pid: 6572 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.575511:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 6 pid: 6572 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.575529:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cb8d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf2 expref: 6 pid: 6572 timeout: 1331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.575542:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094070.575545:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094070.575550:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.575559:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094070.575581:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094070.575598:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094070.575608:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094070.575615:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094070.575617:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013817984:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 133us (273us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094070.575630:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094070.575637:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 307 00010000:00010000:2.0:1784094070.575655:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094070.575685:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094070.575693:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094070.575704:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094070.575708:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094070.575717:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094070.575732:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094070.575741:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214cb901 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094070.575756:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094070.575757:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094070.575758:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094070.576070:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024309376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2255us (2375us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1784094070.576077:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000004:00080000:0.0:1784094070.576099:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907101285500/2, rc 0, transno 4294967355 00000100:00100000:0.0:1784094070.576111:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024309376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094070.762564:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024309632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094070.762641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094070.762685:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024309632 00000100:00100000:2.0:1784094070.762694:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024309632 00000100:00080000:3.0:1784094070.762729:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094070.762756:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1784094070.762770:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024309632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094070.762814:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094070.762862:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024309632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094070.762869:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1784094070.762892:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:1.0:1784094070.762898:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230e4ad80, transno 4294967355 00000100:00100000:1.0:1784094070.762918:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024309632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094071.273585:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094072.297511:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094073.208258:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094073.208292:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094073.208313:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818112 00000100:00100000:0.0:1784094073.208319:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094073.208325:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818112 00000100:00100000:1.0:1784094073.208344:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818240 00000100:00100000:1.0:1784094073.208349:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818240 00000100:00100000:0.0:1784094073.208371:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094073.208384:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 800 00000100:00100000:2.0:1784094073.208393:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818368 00000100:00100000:3.0:1784094073.208396:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013818112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094073.208401:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818368 00000100:00100000:1.0:1784094073.208407:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 835 00000100:00100000:0.0:1784094073.208412:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818496 00000100:00100000:0.0:1784094073.208418:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818496 00000100:00100000:1.0:1784094073.208453:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013818240:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094073.208480:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 625 00000100:00100000:0.0:1784094073.208488:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 626 00000100:00100000:2.0:1784094073.208493:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013818368:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094073.208497:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013818112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094073.208497:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013818240:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094073.208499:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013818496:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094073.208516:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 800 00000100:00100000:1.0:1784094073.208516:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 835 00000100:00100000:2.0:1784094073.208543:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013818368:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (223us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094073.208550:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094073.208551:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013818496:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094073.208556:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094073.208559:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 625 00000100:00080000:3.0:1784094073.208561:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094073.208568:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 626 00010000:00010000:2.0:1784094073.321653:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094073.833578:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024309760:0@lo:400:kworker.0 00000100:00100000:1.0:1784094073.833591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024309888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094073.833601:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024310016:0@lo:400:kworker.0 00000100:00100000:2.0:1784094073.833657:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024310144:0@lo:400:kworker.0 00000100:00100000:1.0:1784094073.833657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094073.833662:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094073.833664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094073.833705:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094073.833731:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024310400:0@lo:400:kworker.0 00000100:00100000:3.0:1784094073.833733:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024310272:0@lo:400:kworker.0 00000100:00100000:0.0:1784094073.833733:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024310528:0@lo:400:kworker.0 00000100:00100000:2.0:1784094073.833749:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024309888 00000100:00100000:2.0:1784094073.833756:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024309888 00000100:00100000:1.0:1784094073.833774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094073.833780:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784094073.833786:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094073.833806:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310016 00000100:00100000:3.0:1784094073.833811:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310016 00000100:00100000:1.0:1784094073.833815:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024309760 00000100:00100000:2.0:1784094073.833817:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1784094073.833819:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024309760 00000100:00100000:2.0:1784094073.833829:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024309888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094073.833837:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310144 00000100:00100000:0.0:1784094073.833842:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310144 00000100:00100000:3.0:1784094073.833847:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310400 00000100:00100000:3.0:1784094073.833851:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310400 00000100:00100000:1.0:1784094073.833855:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1784094073.833864:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024309760:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784094073.833872:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56033280 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784094073.833880:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1784094073.833890:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024310016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094073.833890:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1784094073.833909:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024310400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094073.833910:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024309760:12345-0@lo:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094073.833918:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024309888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094073.833923:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1784094073.833924:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:3.0:1784094073.833937:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024310016:12345-0@lo:400:kworker.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094073.833943:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1784094073.833952:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310528 00000100:00100000:2.0:1784094073.833957:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310528 00000100:00100000:3.0:1784094073.833961:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1784094073.833970:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024310144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094073.833974:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024310400:12345-0@lo:400:kworker.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094073.833979:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024310400:0@lo:400:kworker.0 00000100:00100000:0.0:1784094073.833985:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1784094073.833989:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1784094073.834000:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024310528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094073.834002:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024309888:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094073.834014:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094073.834019:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024310144:12345-0@lo:400:kworker.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094073.834028:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1784094073.834035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094073.834040:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024310528:12345-0@lo:400:kworker.0 Request processed in 40us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094073.834047:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:1.0:1784094073.834047:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024310528:0@lo:400:kworker.0 00000100:00100000:1.0:1784094073.834063:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024310016:0@lo:400:kworker.0 00000100:00100000:2.0:1784094073.834064:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310272 00000100:00100000:2.0:1784094073.834067:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310272 00000100:00100000:3.0:1784094073.834096:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024310144:0@lo:400:kworker.0 00000100:00100000:0.0:1784094073.834100:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024309760:0@lo:400:kworker.0 00000100:00100000:2.0:1784094073.834115:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1784094073.834124:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024310272:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094073.834127:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094073.834160:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024310272:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094073.834168:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1784094073.834182:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024310272:0@lo:400:kworker.0 00010000:00010000:0.0:1784094074.345581:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094074.867039:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967355 is committed 00010000:00010000:3.0:1784094075.369575:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094075.881612:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024310656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094075.881680:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094075.881726:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310656 00000100:00100000:1.0:1784094075.881734:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310656 00000100:00080000:2.0:1784094075.881770:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094075.881803:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1784094075.881813:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024310656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094075.881843:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094075.881919:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024310656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094075.881925:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1784094075.881957:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024310656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094076.393560:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094077.417622:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094078.328338:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094078.328375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094078.328403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094078.328404:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818752 00000100:00100000:0.0:1784094078.328414:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818752 00000100:00100000:3.0:1784094078.328461:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094078.328468:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818624 00000100:00100000:1.0:1784094078.328474:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818624 00000100:00100000:2.0:1784094078.328481:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819008 00000100:00100000:2.0:1784094078.328489:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819008 00000100:00080000:3.0:1784094078.328495:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094078.328502:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094078.328527:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 802 00000100:00100000:0.0:1784094078.328527:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 839 00000100:00100000:2.0:1784094078.328533:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013818880 00000100:00100000:2.0:1784094078.328538:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013818880 00000100:00100000:1.0:1784094078.328548:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013818624:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094078.328549:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013818752:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094078.328565:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 629 00000100:00100000:2.0:1784094078.328574:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00100000:3.0:1784094078.328580:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013819008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094078.328590:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013818880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094078.328612:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013818624:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094078.328612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013818752:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094078.328617:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013819008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094078.328633:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013818880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094078.328634:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 629 00000100:00100000:0.0:1784094078.328640:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 839 00000100:00100000:1.0:1784094078.328641:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 802 00000100:00100000:2.0:1784094078.328652:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00080000:3.0:1784094078.328667:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094078.441528:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094078.953558:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024310784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094078.953630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094078.953667:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310784 00000100:00100000:0.0:1784094078.953675:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310784 00000100:00080000:1.0:1784094078.953724:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094078.953745:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1784094078.953756:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024310784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094078.953792:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56033280 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094078.953842:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024310784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094078.953850:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1784094078.953873:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:3.0:1784094078.953880:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907101285500, transno 4294967355 00000100:00100000:3.0:1784094078.953904:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024310784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094078.954538:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024310912:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.954581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094078.954602:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024311040:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.954631:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024311424:0@lo:400:kworker.0 00000100:00100000:3.0:1784094078.954652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094078.954682:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311040 00000100:00100000:1.0:1784094078.954686:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311040 00000100:00100000:3.0:1784094078.954697:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094078.954707:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024311168:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.954713:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1784094078.954720:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024311040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094078.954738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094078.954755:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024311296:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.954763:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024311040:12345-0@lo:400:kworker.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094078.954771:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1784094078.954777:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024311040:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.954787:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311168 00000100:00100000:1.0:1784094078.954792:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311168 00000100:00100000:0.0:1784094078.954796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094078.954809:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024310912 00000100:00100000:3.0:1784094078.954815:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024310912 00000100:00100000:1.0:1784094078.954833:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1784094078.954839:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311296 00000100:00100000:1.0:1784094078.954844:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024311168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094078.954845:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311296 00000100:00100000:3.0:1784094078.954852:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1784094078.954863:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024310912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094078.954886:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1784094078.954892:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024311168:12345-0@lo:400:kworker.0 Request processed in 51us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094078.954899:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024311296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.954905:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1784094078.954911:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024310912:12345-0@lo:400:kworker.0 Request processed in 48us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094078.954919:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00080000:1.0:1784094078.954927:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094078.954933:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094078.954946:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024311296:12345-0@lo:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094078.954952:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1784094078.954974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094078.955003:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024311296:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.955020:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311424 00000100:00100000:3.0:1784094078.955024:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024310912:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.955026:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311424 00000100:00080000:0.0:1784094078.955058:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094078.955069:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024311168:0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.955073:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1784094078.955083:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024311424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094078.955120:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024311424:12345-0@lo:400:kworker.0 Request processed in 39us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094078.955128:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1784094078.955138:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024311424:0@lo:400:kworker.0 00010000:00010000:1.0:1784094079.465669:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094080.489522:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094081.001596:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094081.001621:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024311552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094081.001686:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094081.001724:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311552 00000100:00100000:1.0:1784094081.001732:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311552 00000100:00080000:0.0:1784094081.001767:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094081.001787:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1784094081.001798:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024311552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094081.001830:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094081.001887:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024311552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094081.001896:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1784094081.001913:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024311552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094081.513626:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094082.537561:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094083.448586:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094083.448634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094083.448660:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819264 00000100:00100000:3.0:1784094083.448668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094083.448677:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819264 00000100:00100000:1.0:1784094083.448691:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819136 00000100:00100000:1.0:1784094083.448698:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819136 00000100:00100000:3.0:1784094083.448726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094083.448774:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819392 00000100:00100000:2.0:1784094083.448786:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819392 00000100:00100000:0.0:1784094083.448793:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 843 00000100:00100000:1.0:1784094083.448794:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00100000:1.0:1784094083.448819:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013819136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094083.448822:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013819264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094083.448874:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819520 00000100:00100000:2.0:1784094083.448880:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819520 00000100:00100000:3.0:1784094083.448891:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 632 00000100:00100000:3.0:1784094083.448924:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013819392:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094083.448938:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:1.0:1784094083.448952:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013819136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 131us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094083.448952:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013819264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 130us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094083.448956:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013819520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094083.449002:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 843 00000100:00100000:3.0:1784094083.449004:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013819392:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094083.449016:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013819520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094083.449016:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00100000:3.0:1784094083.449033:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 632 00000100:00100000:2.0:1784094083.449044:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00080000:0.0:1784094083.449048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094083.449059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094083.449068:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094083.561623:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094084.073606:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024311936:0@lo:400:kworker.0 00000100:00100000:2.0:1784094084.073650:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024311680:0@lo:400:kworker.0 00000100:00100000:1.0:1784094084.073661:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024311808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094084.073685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094084.073722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094084.073732:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311936 00000100:00100000:0.0:1784094084.073740:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311936 00000100:00100000:3.0:1784094084.073765:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024312448:0@lo:400:kworker.0 00000100:00100000:2.0:1784094084.073781:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094084.073783:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024312320:0@lo:400:kworker.0 00000100:00100000:0.0:1784094084.073796:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1784094084.073806:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024311936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094084.073832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094084.073839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094084.073878:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024312192:0@lo:400:kworker.0 00000100:00100000:0.0:1784094084.073911:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024311936:12345-0@lo:400:kworker.0 Request processed in 104us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094084.073921:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1784094084.073931:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024312064:0@lo:400:kworker.0 00000100:00100000:3.0:1784094084.073938:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024311936:0@lo:400:kworker.0 00000100:00100000:0.0:1784094084.073943:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312320 00000100:00100000:2.0:1784094084.073950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094084.073950:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312320 00000100:00100000:1.0:1784094084.073979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094084.073980:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311680 00000100:00100000:3.0:1784094084.073986:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311680 00000100:00100000:0.0:1784094084.074006:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312064 00000100:00100000:0.0:1784094084.074011:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312064 00000100:00100000:3.0:1784094084.074043:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1784094084.074054:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312448 00000100:00100000:3.0:1784094084.074056:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024311680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094084.074061:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1784094084.074062:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024311808 00000100:00100000:2.0:1784094084.074065:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312448 00000100:00100000:1.0:1784094084.074071:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024311808 00000100:00100000:0.0:1784094084.074075:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024312320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094084.074136:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1784094084.074136:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024312320:12345-0@lo:400:kworker.0 Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094084.074148:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1784094084.074152:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024311808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094084.074164:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312192 00000100:00100000:3.0:1784094084.074166:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024311680:12345-0@lo:400:kworker.0 Request processed in 106us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094084.074173:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312192 00000100:00100000:0.0:1784094084.074173:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00002000:00000024:1.0:1784094084.074187:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56033280 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094084.074188:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1784094084.074193:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024312064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094084.074237:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1784094084.074252:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024312448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094084.074261:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024311808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094084.074261:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024312064:12345-0@lo:400:kworker.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094084.074271:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1784094084.074284:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1784094084.074288:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1784094084.074293:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024312192:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094084.074315:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094084.074324:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094084.074328:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094084.074356:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024312448:12345-0@lo:400:kworker.0 Request processed in 105us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094084.074361:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024312192:12345-0@lo:400:kworker.0 Request processed in 72us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094084.074376:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024312064:0@lo:400:kworker.0 00000100:00100000:2.0:1784094084.074377:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1784094084.074398:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1784094084.074414:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024311808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094084.074468:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024312320:0@lo:400:kworker.0 00000100:00100000:2.0:1784094084.074521:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024311680:0@lo:400:kworker.0 00000100:00100000:3.0:1784094084.074522:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024312448:0@lo:400:kworker.0 00000100:00100000:2.0:1784094084.074561:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024312192:0@lo:400:kworker.0 00010000:00010000:0.0:1784094084.585544:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094085.609603:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094086.121660:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024312576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094086.121743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094086.121801:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312576 00000100:00100000:0.0:1784094086.121810:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312576 00000100:00080000:2.0:1784094086.121869:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094086.121898:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1784094086.121911:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024312576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094086.121961:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094086.122022:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024312576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094086.122031:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1784094086.122079:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024312576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094086.633575:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094087.657611:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094088.568541:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094088.568583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094088.568596:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819776 00000100:00100000:0.0:1784094088.568606:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094088.568609:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819776 00000100:00100000:0.0:1784094088.568637:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094088.568651:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819648 00000100:00100000:1.0:1784094088.568659:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819648 00000100:00100000:3.0:1784094088.568669:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013819904 00000100:00080000:0.0:1784094088.568674:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094088.568676:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013819904 00000100:00100000:2.0:1784094088.568695:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 847 00000100:00100000:1.0:1784094088.568715:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 806 00000100:00100000:2.0:1784094088.568717:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013819776:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094088.568723:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094088.568732:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013819648:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094088.568738:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820032 00000100:00100000:3.0:1784094088.568744:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820032 00000100:00100000:0.0:1784094088.568749:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:0.0:1784094088.568760:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013819904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094088.568790:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 637 00000100:00100000:1.0:1784094088.568818:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013819648:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094088.568825:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013820032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094088.568825:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013819776:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094088.568826:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013819904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094088.568836:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 806 00000100:00100000:0.0:1784094088.568849:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:2.0:1784094088.568851:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 847 00000100:00100000:3.0:1784094088.568886:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013820032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094088.568896:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 637 00000100:00080000:1.0:1784094088.568905:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784094088.681567:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094089.193581:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024312704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094089.193590:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024312960:0@lo:400:kworker.0 00000100:00100000:2.0:1784094089.193599:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024313088:0@lo:400:kworker.0 00000100:00100000:1.0:1784094089.193641:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024312832:0@lo:400:kworker.0 00000100:00100000:0.0:1784094089.193663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094089.193665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094089.193702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094089.193704:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312704 00000100:00100000:2.0:1784094089.193714:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312704 00000100:00100000:1.0:1784094089.193745:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024313344:0@lo:400:kworker.0 00000100:00100000:3.0:1784094089.193758:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024313472:0@lo:400:kworker.0 00000100:00100000:0.0:1784094089.193758:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024313216:0@lo:400:kworker.0 00000100:00100000:1.0:1784094089.193771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094089.193804:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1784094089.193820:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024312704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094089.193829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094089.193835:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312832 00000100:00100000:0.0:1784094089.193840:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312832 00000100:00100000:1.0:1784094089.193852:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024312960 00000100:00100000:1.0:1784094089.193858:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024312960 00002000:00000024:2.0:1784094089.193865:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56033280 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094089.193881:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1784094089.193885:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313472 00000100:00100000:3.0:1784094089.193891:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313472 00000100:00100000:0.0:1784094089.193891:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024312832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094089.193895:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313344 00000100:00100000:1.0:1784094089.193900:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313344 00000100:00100000:2.0:1784094089.193936:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024312704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094089.193943:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1784094089.193944:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1784094089.193956:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1784094089.193959:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024312960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094089.193961:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024313472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094089.193965:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024312832:12345-0@lo:400:kworker.0 Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094089.193977:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1784094089.194000:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1784094089.194014:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024313344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094089.194035:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024313472:12345-0@lo:400:kworker.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094089.194042:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024312960:12345-0@lo:400:kworker.0 Request processed in 85us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094089.194044:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024312832:0@lo:400:kworker.0 00000100:00100000:3.0:1784094089.194047:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1784094089.194060:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1784094089.194072:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024313344:12345-0@lo:400:kworker.0 Request processed in 60us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094089.194077:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024313344:0@lo:400:kworker.0 00000100:00100000:2.0:1784094089.194089:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1784094089.194100:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024313472:0@lo:400:kworker.0 00000100:00100000:1.0:1784094089.194107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094089.194117:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024312960:0@lo:400:kworker.0 00000100:00100000:2.0:1784094089.194138:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784094089.194139:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094089.194146:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094089.194163:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313216 00000100:00100000:3.0:1784094089.194168:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313216 00000100:00100000:1.0:1784094089.194169:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024312704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094089.194171:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313088 00000100:00100000:0.0:1784094089.194177:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313088 00000100:00080000:2.0:1784094089.194205:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094089.194212:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094089.194216:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1784094089.194220:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1784094089.194227:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024313216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094089.194233:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024313088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094089.194271:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024313216:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094089.194282:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1784094089.194283:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024313088:12345-0@lo:400:kworker.0 Request processed in 52us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094089.194291:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1784094089.194317:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024313088:0@lo:400:kworker.0 00000100:00100000:1.0:1784094089.194319:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024313216:0@lo:400:kworker.0 00010000:00010000:2.0:1784094089.705662:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094090.336459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094090.336517:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820160 00000100:00100000:3.0:1784094090.336529:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820160 00000100:00080000:2.0:1784094090.336591:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094090.336600:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 923 00000100:00100000:3.0:1784094090.336613:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013820160:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094090.336699:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013820160:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094090.336709:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 923 00000100:00100000:2.0:1784094090.337689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094090.337737:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820288 00000100:00100000:1.0:1784094090.337743:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820288 00000100:00080000:2.0:1784094090.337809:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094090.337811:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 468 00000100:00100000:1.0:1784094090.337823:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820288:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094090.338151:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820288:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 330us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094090.338157:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 468 00000100:00100000:0.0:1784094090.338933:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094090.338981:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820416 00000100:00100000:3.0:1784094090.338988:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820416 00000100:00100000:3.0:1784094090.339042:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 469 00000100:00080000:2.0:1784094090.339048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094090.339055:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820416:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094090.339286:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820416:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 234us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094090.339296:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 469 00000100:00100000:0.0:1784094090.339988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094090.340038:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820544 00000100:00100000:2.0:1784094090.340044:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820544 00000100:00100000:2.0:1784094090.340077:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 924 00000100:00100000:2.0:1784094090.340084:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013820544:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094090.340404:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013820544:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 319us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094090.340412:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 924 00000100:00100000:2.0:1784094090.341949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094090.341999:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820672 00000100:00100000:0.0:1784094090.342004:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820672 00000100:00100000:0.0:1784094090.342031:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 925 00000100:00100000:0.0:1784094090.342037:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013820672:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094090.342077:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013820672:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094090.342085:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 925 00000100:00100000:0.0:1784094090.342804:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094090.342852:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820800 00000100:00100000:3.0:1784094090.342858:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820800 00000100:00100000:3.0:1784094090.342891:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 470 00000100:00100000:3.0:1784094090.342900:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820800:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094090.343161:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820800:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 261us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094090.343170:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 470 00000100:00100000:3.0:1784094090.343860:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094090.343913:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013820928 00000100:00100000:1.0:1784094090.343919:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013820928 00000100:00100000:1.0:1784094090.343964:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:1.0:1784094090.343973:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820928:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094090.344198:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:52907:x1870757013820928:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 225us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094090.344206:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 471 00000100:00100000:2.0:1784094090.345058:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094090.345106:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013821056 00000100:00100000:3.0:1784094090.345111:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013821056 00000100:00100000:3.0:1784094090.345146:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 926 00000100:00100000:3.0:1784094090.345154:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013821056:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094090.345447:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:52907:x1870757013821056:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 266us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094090.345457:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 926 00010000:00010000:3.0:1784094090.729527:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094090.841031:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094090.841095:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013821184 00000100:00100000:2.0:1784094090.841107:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013821184 00000100:00100000:2.0:1784094090.841189:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 927 00000100:00100000:2.0:1784094090.841207:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52921:x1870757013821184:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784094090.841229:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094090.841250:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5bf9 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.841321:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.841344:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.841358:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094090.841629:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:2.0:1784094090.841635:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094090.841775:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.841811:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cb908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf9 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.841834:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf9 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.841845:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784094090.841850:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094090.841855:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094090.841921:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52921:x1870757013821184:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 720us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094090.841944:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 927 00000100:00100000:0.0:1784094090.843323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094090.843374:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013821440 00000100:00100000:2.0:1784094090.843381:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013821440 00000100:00100000:2.0:1784094090.843458:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 928 00000100:00100000:2.0:1784094090.843473:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52921:x1870757013821440:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094090.843510:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094090.843534:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cb90f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5bf9 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.843559:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb8ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5be4 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.843571:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fce200) 00010000:00010000:2.0:1784094090.843583:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094090.843605:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.843617:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094090.843628:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784094090.854990:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967654 is committed 00000004:00010000:2.0:1784094090.855003:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000041beaca4 reply state 00000000008f5de9 transno 4294967654 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094090.855017:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094090.855159:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00080000:2.0:1784094090.855272:0:5809:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094090.855298:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52921:x1870757013821440:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 11827us (11974us total) trans 4294967654 rc 0/0 00000100:00100000:2.0:1784094090.855310:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 928 00010000:00010000:3.0:1784094090.855328:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094090.855338:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094090.855346:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094090.855356:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094090.855362:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094090.855368:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094090.855383:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781800) 00010000:00010000:3.0:1784094090.855386:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094090.855390:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094090.855396:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cb916 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094090.875174:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094090.875228:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013821568 00000100:00100000:1.0:1784094090.875245:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013821568 00000100:00100000:1.0:1784094090.875326:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 929 00000100:00100000:1.0:1784094090.875342:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:52925:x1870757013821568:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094090.875374:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094090.875399:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb91d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c00 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.875514:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.875531:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.875545:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.875560:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.875568:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.875574:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876310:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876321:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876329:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094090.876525:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:1.0:1784094090.876531:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094090.876601:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876613:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876618:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876623:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876628:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094090.876631:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876637:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876648:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:1.0:1784094090.876650:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094090.876654:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876660:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876672:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876684:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876692:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876699:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094090.876703:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876710:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876719:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907219c12d00) 00010000:00010000:1.0:1784094090.876723:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094090.876726:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876733:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb92b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876782:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb91d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c00 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876794:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c00 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094090.876800:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784094090.876802:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094090.876804:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784094090.876884:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:52925:x1870757013821568:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1546us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094090.876895:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 929 00000100:00100000:2.0:1784094091.196797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.196835:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013821696 00000100:00100000:1.0:1784094091.196844:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013821696 00000100:00100000:1.0:1784094091.196904:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 930 00000100:00100000:1.0:1784094091.196916:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52944:x1870757013821696:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094091.196937:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094091.196969:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c07 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.197028:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.197039:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.197049:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094091.197220:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:1.0:1784094091.197226:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094091.197315:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.197340:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c07 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.197353:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c07 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.197366:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784094091.197368:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094091.197371:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094091.197437:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:52944:x1870757013821696:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 508us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.197443:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 930 00000100:00100000:0.0:1784094091.198830:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094091.198873:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013821952 00000100:00100000:2.0:1784094091.198881:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013821952 00000100:00100000:2.0:1784094091.198927:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 931 00000100:00100000:2.0:1784094091.198940:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52944:x1870757013821952:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094091.198977:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094091.198995:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cb940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c07 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.199017:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c00 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.199030:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907219c12b00) 00010000:00010000:2.0:1784094091.199044:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094091.199066:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.199078:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.199088:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784094091.208007:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967655 is committed 00000004:00010000:2.0:1784094091.208015:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d0eb8a8c reply state 000000005a5978f1 transno 4294967655 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094091.208029:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094091.208138:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00080000:2.0:1784094091.208229:0:5809:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094091.208249:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:52944:x1870757013821952:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 9312us (9418us total) trans 4294967655 rc 0/0 00000100:00100000:2.0:1784094091.208257:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 931 00010000:00010000:0.0:1784094091.208275:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.208284:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.208291:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.208297:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094091.208302:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.208308:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.208321:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784094091.208325:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094091.208329:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.208334:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cb947 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094091.227466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094091.227537:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013822080 00000100:00100000:3.0:1784094091.227548:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013822080 00000100:00100000:3.0:1784094091.227602:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 932 00000100:00100000:3.0:1784094091.227613:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:52948:x1870757013822080:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784094091.227636:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094091.227656:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb94e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c0e expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.227713:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.227728:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.227744:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.227775:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.227784:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.227791:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228198:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228209:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228217:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094091.228317:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:3.0:1784094091.228322:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094091.228407:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228454:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228463:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228477:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228484:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094091.228488:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228497:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228510:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:3.0:1784094091.228514:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094091.228518:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228525:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cb955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228537:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228544:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228551:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228557:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094091.228561:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228572:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228580:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fce000) 00010000:00010000:3.0:1784094091.228583:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094091.228586:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228593:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cb95c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228621:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cb94e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c0e expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228635:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c0e expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094091.228643:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784094091.228646:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094091.228649:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094091.228705:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:52948:x1870757013822080:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1094us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094091.228714:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 932 00000100:00100000:3.0:1784094091.229660:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.229705:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013822336 00000100:00100000:1.0:1784094091.229712:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013822336 00000100:00100000:1.0:1784094091.229746:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 933 00000100:00100000:1.0:1784094091.229765:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52948:x1870757013822336:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094091.229773:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094091.229781:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb96a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c15 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.229969:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.229978:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.229985:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.229994:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.229999:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.230005:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094091.231035:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:1.0:1784094091.231483:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb97f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231495:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb97f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231505:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb97f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231546:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231555:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231562:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231569:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.231573:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231581:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231595:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784094091.231599:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.231604:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231611:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb971 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094091.231625:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000035574e41 reply state 00000000a4fe6425 transno 4294967656 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094091.231634:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784094091.231662:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb96a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c15 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231680:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb97f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c15 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.231689:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784094091.231692:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094091.231696:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784094091.231763:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:52948:x1870757013822336:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1984us (2089us total) trans 4294967656 rc 0/0 00000100:00100000:1.0:1784094091.231773:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 933 00010000:00010000:1.0:1784094091.232329:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.232338:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.232346:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.232358:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.232362:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.232370:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.232383:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907219c12d00) 00010000:00010000:1.0:1784094091.232387:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.232391:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.232398:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb978 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094091.233028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.233079:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013822592 00000100:00100000:0.0:1784094091.233087:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013822592 00000100:00100000:0.0:1784094091.233141:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 934 00000100:00100000:0.0:1784094091.233153:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:52948:x1870757013822592:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:0.0:1784094091.233192:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094091.233212:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cb97f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c15 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.233228:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907219c12400) 00010000:00010000:0.0:1784094091.233236:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094091.233263:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.233275:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.233285:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094091.233361:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ba598961 reply state 0000000019112edf transno 4294967657 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094091.233370:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094091.233467:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:52948:x1870757013822592:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 315us (438us total) trans 4294967657 rc 0/0 00000100:00100000:0.0:1784094091.233476:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 934 00010000:00010000:2.0:1784094091.233984:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.233996:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.234001:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.234005:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094091.234007:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.234011:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.234018:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907202e6be00) 00010000:00010000:2.0:1784094091.234020:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094091.234023:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.234027:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cb98d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094091.234163:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.234198:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013822720 00000100:00100000:1.0:1784094091.234203:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013822720 00000100:00100000:1.0:1784094091.234234:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 935 00000100:00100000:1.0:1784094091.234243:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:52948:x1870757013822720:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094091.234255:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094091.234267:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c1c expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.234298:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c1c expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.234309:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c1c expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.234333:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784094091.234336:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094091.234339:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784094091.234372:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:52948:x1870757013822720:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 130us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.234380:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 935 00000100:00100000:3.0:1784094091.235138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.235174:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013822848 00000100:00100000:1.0:1784094091.235178:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013822848 00000100:00100000:1.0:1784094091.235207:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 472 00000100:00100000:1.0:1784094091.235212:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013822848:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:1.0:1784094091.235383:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013822848:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 170us (244us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1784094091.235388:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 472 00000100:00100000:3.0:1784094091.236083:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.236126:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013823104 00000100:00100000:0.0:1784094091.236133:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013823104 00000100:00100000:0.0:1784094091.236172:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 96 00000100:00100000:0.0:1784094091.236181:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:52948:x1870757013823104:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:0.0:1784094091.236361:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52948:x1870757013823104:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 180us (276us total) trans 4294967658 rc 0/0 00000100:00100000:0.0:1784094091.236371:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 96 00000100:00100000:2.0:1784094091.241558:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024313600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094091.241612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094091.241655:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313600 00000100:00100000:0.0:1784094091.241661:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313600 00000100:00080000:1.0:1784094091.241693:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094091.241706:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1784094091.241714:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024313600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094091.241736:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094091.241800:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024313600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094091.241808:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1784094091.241844:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024313600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094091.254700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.254764:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013823232 00000100:00100000:1.0:1784094091.254770:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013823232 00000100:00100000:1.0:1784094091.254804:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 936 00000100:00100000:1.0:1784094091.254811:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52952:x1870757013823232:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094091.254827:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094091.254840:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb99b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c23 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.254891:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.254902:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.254910:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.254921:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.254926:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.254936:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255026:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255037:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255045:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094091.255076:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00000004:00200000:1.0:1784094091.255081:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094091.255101:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255113:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255123:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255135:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255143:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255149:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.255154:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255161:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255184:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784094091.255191:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.255197:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255204:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cb9a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255215:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255221:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255228:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255234:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.255238:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255245:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255254:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907219c12d00) 00010000:00010000:1.0:1784094091.255257:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.255261:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255265:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cb9a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255289:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cb99b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c23 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255298:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c23 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.255303:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:1.0:1784094091.255305:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094091.255307:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784094091.255346:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52952:x1870757013823232:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 536us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.255351:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 936 00000100:00100000:3.0:1784094091.256503:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.256549:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013823360 00000100:00100000:0.0:1784094091.256555:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013823360 00000100:00100000:0.0:1784094091.256596:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 473 00000100:00100000:0.0:1784094091.256605:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013823360:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:0.0:1784094091.256616:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094091.256628:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c2a expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784094091.256645:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x6a571d8b, atime: 0x6a571d8b, ctime: 0x6a571d8b, blocks: 0x1 00010000:00010000:0.0:1784094091.256655:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=1252s v=(0 0) 00010000:00010000:0.0:1784094091.256659:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094091.256666:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.256677:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.256686:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784094091.256713:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013823360:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094091.256718:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 473 00000100:00100000:3.0:1784094091.258122:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.258158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013823616 00000100:00100000:0.0:1784094091.258162:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013823616 00000100:00100000:0.0:1784094091.258196:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 937 00000100:00100000:0.0:1784094091.258202:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52952:x1870757013823616:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784094091.258227:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094091.258238:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cb9b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c23 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258251:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cb994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c1c expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258257:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907219c12b00) 00010000:00010000:0.0:1784094091.258262:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094091.258271:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258278:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258285:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258296:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258304:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258312:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258375:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258385:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258393:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094091.258863:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 64 off10112 00000004:00080000:0.0:1784094091.258872:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1252336449111ns, next at 1253336447471ns, rc = 0 00010000:00010000:0.0:1784094091.258912:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258919:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258933:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258939:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258943:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258951:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258966:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094091.258977:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258984:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.258992:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.258999:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094091.258999:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094091.259007:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259009:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259029:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259031:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094091.259036:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259044:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784094091.259048:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094091.259051:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259052:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259063:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cb9cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259068:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff907202e6b600) 00010000:00010000:1.0:1784094091.259072:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784094091.259075:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259077:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259083:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cb9d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259088:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259094:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259098:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094091.259099:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.259101:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094091.259103:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259104:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094091.259111:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259118:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcea00) 00010000:00010000:0.0:1784094091.259120:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094091.259121:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.259125:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cb9be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094091.259133:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008afb2137 reply state 00000000a4c83ddd transno 4294967659 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094091.259138:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094091.259174:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:52952:x1870757013823616:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 971us (1052us total) trans 4294967659 rc 0/0 00000100:00100000:0.0:1784094091.259179:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 937 00010000:00010000:1.0:1784094091.259697:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259705:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259709:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259713:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.259715:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259723:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259730:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907202e6b000) 00010000:00010000:1.0:1784094091.259732:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.259734:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.259740:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cb9c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094091.579467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094091.579527:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013823744 00000100:00100000:2.0:1784094091.579538:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013823744 00000100:00100000:2.0:1784094091.579598:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 938 00000100:00100000:2.0:1784094091.579612:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:52970:x1870757013823744:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784094091.579640:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094091.579660:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb9da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c31 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.579715:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb9e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.579726:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.579736:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094091.579810:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:2.0:1784094091.579813:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094091.579836:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.579856:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb9da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c31 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.579871:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c31 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.579878:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094091.579880:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094091.579883:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094091.579947:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:52970:x1870757013823744:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 337us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094091.579954:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 938 00000100:00100000:3.0:1784094091.581178:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094091.581225:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824000 00000100:00100000:2.0:1784094091.581231:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824000 00000100:00100000:2.0:1784094091.581273:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 939 00000100:00100000:2.0:1784094091.581282:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52970:x1870757013824000:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094091.581312:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094091.581327:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cb9e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c31 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.581345:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cb963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c0e expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.581354:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094091.581363:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094091.581377:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.581384:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.581391:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094091.581610:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005a306b2f reply state 00000000e1cb46eb transno 4294967660 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094091.581618:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094091.581630:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000100:00100000:2.0:1784094091.581676:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52970:x1870757013824000:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 395us (499us total) trans 4294967660 rc 0/0 00000100:00100000:2.0:1784094091.581683:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 939 00010000:00010000:2.0:1784094091.582159:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.582166:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.582171:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.582177:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094091.582183:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.582193:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.582206:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784094091.582209:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094091.582213:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.582220:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cb9e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094091.625859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.625902:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824128 00000100:00100000:0.0:1784094091.625912:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824128 00000100:00100000:0.0:1784094091.625971:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 940 00000100:00100000:0.0:1784094091.625985:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013824128:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094091.626082:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013824128:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094091.626089:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 940 00000100:00100000:3.0:1784094091.626674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.626711:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824256 00000100:00100000:1.0:1784094091.626715:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824256 00000100:00100000:1.0:1784094091.626755:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 474 00000100:00100000:1.0:1784094091.626763:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52982:x1870757013824256:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094091.627011:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:52982:x1870757013824256:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 248us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.627016:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 474 00000100:00100000:1.0:1784094091.627556:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094091.627581:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824384 00000100:00100000:3.0:1784094091.627586:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824384 00000100:00100000:3.0:1784094091.627614:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 475 00000100:00100000:3.0:1784094091.627620:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52982:x1870757013824384:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094091.627805:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52982:x1870757013824384:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 184us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094091.627811:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 475 00000100:00100000:3.0:1784094091.628342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094091.628415:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824512 00000100:00100000:2.0:1784094091.628455:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824512 00000100:00100000:2.0:1784094091.628494:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 941 00000100:00100000:2.0:1784094091.628502:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013824512:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094091.628718:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013824512:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 216us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094091.628726:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 941 00000100:00100000:2.0:1784094091.629722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.629777:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824640 00000100:00100000:1.0:1784094091.629781:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824640 00000100:00100000:1.0:1784094091.629808:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 942 00000100:00100000:1.0:1784094091.629818:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013824640:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094091.629858:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013824640:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 41us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.629863:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 942 00000100:00100000:3.0:1784094091.630411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.630484:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824768 00000100:00100000:0.0:1784094091.630490:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824768 00000100:00100000:0.0:1784094091.630529:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 476 00000100:00100000:0.0:1784094091.630541:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52982:x1870757013824768:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094091.630794:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:52982:x1870757013824768:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 255us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094091.630803:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 476 00000100:00100000:3.0:1784094091.631342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.631382:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013824896 00000100:00100000:1.0:1784094091.631387:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013824896 00000100:00100000:1.0:1784094091.631410:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 477 00000100:00100000:1.0:1784094091.631415:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:52982:x1870757013824896:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094091.631588:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:52982:x1870757013824896:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 172us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.631593:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 477 00000100:00100000:2.0:1784094091.632118:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094091.632150:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825024 00000100:00100000:0.0:1784094091.632156:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825024 00000100:00100000:0.0:1784094091.632186:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 943 00000100:00100000:0.0:1784094091.632192:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013825024:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094091.632448:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:52982:x1870757013825024:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 254us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094091.632455:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 943 00000100:00100000:3.0:1784094091.653233:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094091.653294:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825152 00000100:00100000:2.0:1784094091.653303:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825152 00000100:00100000:2.0:1784094091.653352:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 944 00000100:00100000:2.0:1784094091.653360:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:52986:x1870757013825152:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784094091.653377:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094091.653394:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb9ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c38 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653469:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653481:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653489:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653499:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653504:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653508:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653812:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cba04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653821:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cba04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653829:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cba04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094091.653856:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:2.0:1784094091.653860:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094091.653884:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cba04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653893:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653898:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653903:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653907:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094091.653910:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653915:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653924:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:2.0:1784094091.653927:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094091.653931:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653937:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cb9f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653958:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653966:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653973:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653980:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094091.653983:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653988:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.653994:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff90721a781f00) 00010000:00010000:2.0:1784094091.653996:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094091.653998:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.654002:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cb9fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.654027:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cb9ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c38 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.654037:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cba04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c38 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.654047:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784094091.654048:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094091.654050:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784094091.654100:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:52986:x1870757013825152:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 741us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094091.654105:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 944 00000100:00100000:3.0:1784094091.655221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.655263:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825408 00000100:00100000:1.0:1784094091.655269:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825408 00000100:00100000:1.0:1784094091.655297:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 945 00000100:00100000:1.0:1784094091.655303:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:52986:x1870757013825408:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784094091.655311:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094091.655319:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cba0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c3f expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655376:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655384:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655390:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655399:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655404:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655408:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094091.655785:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:1.0:1784094091.655937:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cba20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655945:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cba20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655951:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cba20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655973:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655978:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655982:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655988:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.655991:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.655998:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656008:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781000) 00010000:00010000:1.0:1784094091.656011:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.656015:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656026:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cba12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094091.656038:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008b438d0a reply state 00000000a66f083e transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094091.656047:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784094091.656070:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cba0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c3f expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656084:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cba20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c3f expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656092:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784094091.656095:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094091.656098:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094091.656138:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+15:52986:x1870757013825408:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 835us (918us total) trans 4294967661 rc 0/0 00000100:00100000:1.0:1784094091.656147:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 945 00010000:00010000:1.0:1784094091.656769:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656777:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656782:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656785:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094091.656788:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656793:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656799:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff907219c12d00) 00010000:00010000:1.0:1784094091.656801:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094091.656803:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.656807:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cba19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094091.659183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.659236:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825536 00000100:00100000:1.0:1784094091.659242:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825536 00000100:00100000:1.0:1784094091.659276:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 478 00000100:00100000:1.0:1784094091.659283:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:52986:x1870757013825536:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784094091.659293:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094091.659305:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c46 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094091.659324:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784094091.659336:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=1252s v=(0 0) 00010000:00010000:1.0:1784094091.659340:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094091.659348:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.659364:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.659376:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784094091.659415:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:52986:x1870757013825536:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 132us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094091.659458:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 478 00000100:00100000:3.0:1784094091.670709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.670787:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825664 00000100:00100000:1.0:1784094091.670798:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825664 00002000:00100000:1.0:1784094091.670852:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff9072379e1f80 x1870757013825664/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:412/0 lens 488/0 e 0 to 0 dl 1784094102 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784094091.670862:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9072379e1f80 with x1870757013825664 ext(0->1048575) 00002000:00010000:1.0:1784094091.670867:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9072379e1f80 00000100:00100000:1.0:1784094091.670893:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 23 00000100:00100000:1.0:1784094091.670901:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013825664:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:1.0:1784094091.678037:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2354:x1870757013825664:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 7127us (7325us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1784094091.678052:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 23 00002000:00100000:1.0:1784094091.678061:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff9072379e1f80 x1870757013825664/t4294967356(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:412/0 lens 488/448 e 0 to 0 dl 1784094102 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784094091.678070:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9072379e1f80 with x1870757013825664 ext(0->1048575) 00002000:00010000:1.0:1784094091.678075:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9072379e1f80 00000100:00100000:0.0:1784094091.679572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094091.679671:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825792 00000100:00100000:2.0:1784094091.679678:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825792 00000100:00100000:2.0:1784094091.679717:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 946 00000100:00100000:2.0:1784094091.679725:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+14:52986:x1870757013825792:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:1.0:1784094091.688521:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967659 is committed 00000004:00080000:1.0:1784094091.688529:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 78 committed 00000001:00080000:1.0:1784094091.688549:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967661 is committed 00000100:00100000:0.0:1784094091.688604:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:52986:x1870757013825792:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 8875us (9029us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094091.688615:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 946 00000100:00100000:2.0:1784094091.688634:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094091.688650:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024313728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784094091.688694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094091.688733:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313728 00000100:00100000:0.0:1784094091.688755:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313728 00000100:00100000:0.0:1784094091.688797:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1784094091.688807:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024313728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784094091.688836:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:0.0:1784094091.688862:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.688884:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.688894:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094091.688900:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094091.688905:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.688944:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.688962:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 6 pid: 6573 timeout: 1352 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094091.688975:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237584000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024313856:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784094091.689021:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072103d3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784094091.689599:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.689632:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013825920 00000100:00100000:1.0:1784094091.689637:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013825920 00000100:00100000:1.0:1784094091.689672:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 480 00000100:00100000:1.0:1784094091.689681:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013825920:12345-192.168.204.57@tcp:16:dd.60003 00000100:00100000:2.0:1784094091.689871:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237584000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024313856:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094091.689896:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094091.690101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094091.690135:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826048 00000100:00100000:1.0:1784094091.690139:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826048 00010000:00010000:1.0:1784094091.690161:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 7 pid: 6573 timeout: 1352 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094091.690186:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 308 00000100:00100000:1.0:1784094091.690194:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013826048:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094091.690203:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094091.690207:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 7 pid: 6573 timeout: 1352 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.690217:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 7 pid: 6573 timeout: 1352 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.690233:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cb9b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c2a expref: 7 pid: 6573 timeout: 1352 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.690243:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094091.690246:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094091.690250:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.690257:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094091.690278:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094091.690302:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094091.690304:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013826048:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 111us (205us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094091.690321:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094091.690321:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 308 00010000:00010000:2.0:1784094091.690334:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.690341:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094091.690692:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094091.690708:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094091.690717:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.690728:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094091.690734:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.690757:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.690775:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.690785:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009db764d8/0x9ce98053214cba35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094091.690806:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094091.690808:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094091.690810:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094091.691181:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024313728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2374us (2484us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1784094091.691189:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000004:00080000:0.0:1784094091.691214:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d3d7100/2, rc 0, transno 4294967357 00000100:00100000:0.0:1784094091.691222:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024313728:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1784094091.699351:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00000100:00100000:3.0:1784094091.699449:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013825920:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 9741us (9820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094091.699462:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 480 00000100:00100000:1.0:1784094091.700810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094091.700853:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826304 00000100:00100000:3.0:1784094091.700861:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826304 00000100:00100000:3.0:1784094091.700917:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 97 00000100:00100000:3.0:1784094091.700929:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:52986:x1870757013826304:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:3.0:1784094091.701268:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:52986:x1870757013826304:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 340us (458us total) trans 4294967662 rc 0/0 00000100:00100000:3.0:1784094091.701278:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 97 00010000:00010000:2.0:1784094091.753593:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094092.107818:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967662 is committed 00000004:00080000:1.0:1784094092.539653:0:88479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1253617228316ns, next at 1253336447471ns, rc = 0 00000004:00080000:1.0:1784094092.539770:0:88479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1253617347237ns, next at 1231969141806ns, rc = 0 00000004:00080000:0.0:1784094092.540612:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 79 committed 00000004:00080000:0.0:1784094092.541257:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00010000:00010000:1.0:1784094092.777577:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094093.034923:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000001:00080000:2.0:1784094093.034936:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00000100:00100000:2.0:1784094093.067583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094093.067622:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826432 00000100:00100000:1.0:1784094093.067631:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826432 00000100:00080000:2.0:1784094093.067671:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094093.067690:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 947 00000100:00100000:1.0:1784094093.067700:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013826432:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094093.067812:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013826432:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094093.067821:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 947 00000100:00100000:1.0:1784094093.068487:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.068523:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826560 00000100:00100000:2.0:1784094093.068528:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826560 00000100:00080000:1.0:1784094093.068564:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094093.068575:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 481 00000100:00100000:2.0:1784094093.068583:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:53178:x1870757013826560:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094093.068943:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:53178:x1870757013826560:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 359us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094093.068953:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 481 00000100:00100000:1.0:1784094093.069489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094093.069513:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826688 00000100:00100000:1.0:1784094093.069517:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826688 00000100:00080000:2.0:1784094093.069533:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094093.069551:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 482 00000100:00100000:1.0:1784094093.069558:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:53178:x1870757013826688:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094093.069814:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:53178:x1870757013826688:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 256us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094093.069827:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 482 00000100:00100000:2.0:1784094093.070344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094093.070384:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826816 00000100:00100000:1.0:1784094093.070390:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826816 00000100:00100000:1.0:1784094093.070465:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 948 00000100:00100000:1.0:1784094093.070475:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013826816:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094093.070822:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013826816:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 347us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094093.070830:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 948 00000100:00100000:3.0:1784094093.071822:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.071862:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013826944 00000100:00100000:2.0:1784094093.071867:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013826944 00000100:00100000:2.0:1784094093.071897:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 949 00000100:00100000:2.0:1784094093.071903:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013826944:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094093.071958:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013826944:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094093.071967:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 949 00000100:00100000:2.0:1784094093.072496:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094093.072524:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827072 00000100:00100000:3.0:1784094093.072531:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827072 00000100:00100000:3.0:1784094093.072570:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 483 00000100:00100000:3.0:1784094093.072581:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:53178:x1870757013827072:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094093.072863:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:53178:x1870757013827072:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 283us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094093.072872:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 483 00000100:00100000:3.0:1784094093.073392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.073462:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827200 00000100:00100000:2.0:1784094093.073466:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827200 00000100:00100000:2.0:1784094093.073492:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 484 00000100:00100000:2.0:1784094093.073499:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:53178:x1870757013827200:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094093.073665:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:53178:x1870757013827200:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 167us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094093.073671:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 484 00000100:00100000:1.0:1784094093.074249:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.074281:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827328 00000100:00100000:2.0:1784094093.074287:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827328 00000100:00100000:2.0:1784094093.074331:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 950 00000100:00100000:2.0:1784094093.074341:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013827328:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094093.074615:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:53178:x1870757013827328:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 277us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094093.074621:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 950 00000100:00100000:1.0:1784094093.095372:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.095434:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827584 00000100:00100000:2.0:1784094093.095444:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827584 00000100:00100000:2.0:1784094093.095490:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 951 00000100:00100000:2.0:1784094093.095500:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:53182:x1870757013827584:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784094093.095545:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094093.095569:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cba20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c3f expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095588:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff907219c12c00) 00010000:00010000:2.0:1784094093.095598:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094093.095616:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095634:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095643:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095655:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095660:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095666:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095959:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095968:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.095976:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094093.096690:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 64 off10112 00000004:00080000:2.0:1784094093.096699:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1254174275941ns, next at 1255174273854ns, rc = 0 00010000:00010000:2.0:1784094093.096785:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096793:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096798:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096803:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096808:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096812:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096827:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094093.096842:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096846:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096851:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096856:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094093.096859:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096865:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096866:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094093.096877:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff90721a781e00) 00010000:00010000:1.0:1784094093.096878:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096880:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094093.096885:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096889:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094093.096893:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cba4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096896:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096907:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096908:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096925:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096930:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096932:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff90721a781e00) 00010000:00010000:2.0:1784094093.096937:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094093.096939:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094093.096942:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096945:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096958:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096959:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cba51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.096985:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784094093.096989:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094093.096993:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094093.096994:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094093.096996:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094093.097000:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094093.097004:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cba3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094093.097017:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bb119cde reply state 0000000091e54f5b transno 4294967663 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094093.097023:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094093.097078:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:53182:x1870757013827584:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1580us (1712us total) trans 4294967663 rc 0/0 00000100:00100000:2.0:1784094093.097084:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 951 00010000:00010000:2.0:1784094093.097677:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.097684:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.097688:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.097691:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094093.097693:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.097698:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.097704:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff90721a781c00) 00010000:00010000:2.0:1784094093.097706:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094093.097708:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.097722:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cba43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094093.688748:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094093.688790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.688865:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827968 00000100:00100000:2.0:1784094093.688875:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827968 00000100:00100000:2.0:1784094093.688948:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:2.0:1784094093.688966:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013827968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094093.689033:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094093.689046:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827712 00000100:00100000:3.0:1784094093.689053:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827712 00000100:00100000:2.0:1784094093.689059:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013827968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094093.689069:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:2.0:1784094093.689106:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013827840 00000100:00100000:2.0:1784094093.689113:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013827840 00000100:00100000:3.0:1784094093.689139:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 808 00000100:00100000:0.0:1784094093.689142:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094093.689159:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 851 00000100:00100000:2.0:1784094093.689171:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013827840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094093.689180:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828096 00000100:00100000:0.0:1784094093.689186:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828096 00000100:00100000:2.0:1784094093.689218:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013827840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094093.689230:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 641 00000100:00100000:2.0:1784094093.689231:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 851 00000100:00100000:0.0:1784094093.689245:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013828096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094093.689254:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013827712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094093.689279:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013828096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094093.689289:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 641 00000100:00100000:3.0:1784094093.689297:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013827712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 146us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094093.689308:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 808 00010000:00010000:0.0:1784094093.801519:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094093.848141:0:88626:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1254925716719ns, next at 1253336447471ns, rc = 0 00000004:00080000:2.0:1784094093.848231:0:88626:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1254925807960ns, next at 1255174273854ns, rc = 0 00000004:00080000:0.0:1784094093.856193:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 80 committed 00000001:00080000:0.0:1784094093.856211:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967663 is committed 00000004:00080000:0.0:1784094093.856217:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 78 committed 00000100:00100000:0.0:1784094093.856348:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024313984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784094093.856409:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094093.856444:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024313984 00000100:00100000:3.0:1784094093.856453:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024313984 00000100:00080000:1.0:1784094093.856485:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094093.856514:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1784094093.856524:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024313984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784094093.856550:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:30 count 1 00010000:00010000:3.0:1784094093.856574:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.856595:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.856604:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1784094093.856609:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094093.856613:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.856639:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.856654:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 5 pid: 8031 timeout: 1354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094093.856667:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024314112:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094093.856737:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1784094093.856957:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 79 committed 00000100:00100000:2.0:1784094093.857941:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024314112:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094093.857965:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094093.858159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094093.858270:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828224 00000100:00100000:0.0:1784094093.858276:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828224 00010000:00010000:0.0:1784094093.858299:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 6 pid: 8031 timeout: 1354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094093.858329:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 309 00000100:00100000:0.0:1784094093.858342:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013828224:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094093.858353:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094093.858359:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 6 pid: 8031 timeout: 1354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094093.858372:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 6 pid: 8031 timeout: 1354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094093.858391:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cce25a/0x9ce98053214cba2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c46 expref: 6 pid: 8031 timeout: 1354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094093.858405:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094093.858409:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094093.858414:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094093.858446:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094093.858467:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094093.858480:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.858498:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094093.858505:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013828224:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 166us (343us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094093.858514:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094093.858526:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 309 00010000:00010000:2.0:1784094093.858529:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094093.858551:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094093.858577:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094093.858583:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.858592:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094093.858651:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.858662:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.858676:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.858684:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea186c95/0x9ce98053214cba58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094093.858714:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094093.858717:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094093.858719:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094093.858958:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024313984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2436us (2550us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1784094093.858966:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000004:00080000:0.0:1784094093.858996:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90710134dc00/2, rc 0, transno 4294967357 00000100:00100000:0.0:1784094093.859014:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024313984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094094.313664:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024314240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094094.313671:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024314368:0@lo:400:kworker.0 00000100:00100000:0.0:1784094094.313731:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024314496:0@lo:400:kworker.0 00000100:00100000:2.0:1784094094.313760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094094.313760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094094.313773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094094.313810:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024314240 00000100:00100000:3.0:1784094094.313819:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024314240 00000100:00100000:0.0:1784094094.313819:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024315008:0@lo:400:kworker.0 00000100:00100000:2.0:1784094094.313830:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024314880:0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.313830:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024314752:0@lo:400:kworker.0 00000100:00100000:0.0:1784094094.313857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094094.313877:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1784094094.313883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094094.313891:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024314240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094094.313891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094094.313914:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024314368 00000100:00100000:0.0:1784094094.313919:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024314368 00000100:00100000:2.0:1784094094.313929:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024314624:0@lo:400:kworker.0 00002000:00000024:3.0:1784094094.313931:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784094094.313943:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024314496 00000100:00100000:1.0:1784094094.313948:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024314496 00000100:00100000:0.0:1784094094.313958:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1784094094.313968:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024314368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094094.313977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094094.313991:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024314880 00000100:00100000:1.0:1784094094.313995:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024314880 00000100:00100000:2.0:1784094094.314023:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024314624 00000100:00100000:2.0:1784094094.314027:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024314624 00000100:00100000:1.0:1784094094.314027:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1784094094.314039:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024314496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094094.314059:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1784094094.314065:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024314880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094094.314108:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024314240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094094.314118:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1784094094.314131:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024314368:12345-0@lo:400:kworker.0 Request processed in 164us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094094.314137:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024314496:12345-0@lo:400:kworker.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094094.314139:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024314880:12345-0@lo:400:kworker.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094094.314146:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1784094094.314152:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1784094094.314157:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1784094094.314164:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1784094094.314184:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024314624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.314184:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315008 00000100:00100000:1.0:1784094094.314188:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315008 00000100:00100000:2.0:1784094094.314206:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024314752 00000100:00100000:2.0:1784094094.314210:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024314752 00000100:00100000:1.0:1784094094.314221:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1784094094.314230:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024314880:0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.314231:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024315008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094094.314240:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024314624:12345-0@lo:400:kworker.0 Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094094.314244:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1784094094.314254:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1784094094.314254:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024314368:0@lo:400:kworker.0 00000100:00100000:2.0:1784094094.314257:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024314752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.314266:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024315008:12345-0@lo:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094094.314273:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00080000:1.0:1784094094.314295:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094094.314297:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024314752:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00080000:1.0:1784094094.314300:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094094.314304:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1784094094.314327:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024314624:0@lo:400:kworker.0 00000100:00100000:0.0:1784094094.314334:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024314496:0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.314337:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:1.0:1784094094.314343:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d3d7100, transno 4294967357 00000100:00100000:0.0:1784094094.314353:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024315008:0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.314355:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024314752:0@lo:400:kworker.0 00000100:00100000:1.0:1784094094.314378:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024314240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784094094.825557:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094095.849743:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094096.361684:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024315136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094096.361771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094096.361835:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315136 00000100:00100000:0.0:1784094096.361848:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315136 00000100:00080000:1.0:1784094096.361893:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094096.361934:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1784094096.361946:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024315136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094096.361988:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094096.362077:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024315136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094096.362087:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1784094096.362089:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024315136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094096.873525:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094097.897654:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094098.422321:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00000100:00100000:3.0:1784094098.810891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094098.810944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094098.810984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094098.811003:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828480 00000100:00100000:1.0:1784094098.811012:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828480 00000100:00100000:3.0:1784094098.811023:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094098.811086:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828736 00000100:00100000:2.0:1784094098.811091:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828736 00000100:00100000:1.0:1784094098.811738:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 855 00000100:00100000:1.0:1784094098.811749:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013828480:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094098.811826:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013828480:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094098.811834:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 855 00000100:00100000:1.0:1784094098.811857:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828608 00000100:00100000:1.0:1784094098.811860:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828608 00000100:00080000:3.0:1784094098.813286:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094098.813291:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094098.813294:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094098.813308:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 644 00000100:00100000:1.0:1784094098.813331:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013828608:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094098.813369:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013828608:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094098.813376:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 644 00000100:00100000:2.0:1784094098.816887:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:2.0:1784094098.816904:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013828736:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094098.816980:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013828736:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (5994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094098.816989:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:0.0:1784094098.821743:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828352 00000100:00100000:0.0:1784094098.821758:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828352 00000100:00100000:0.0:1784094098.821837:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 810 00000100:00100000:0.0:1784094098.821848:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013828352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094098.821924:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013828352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (10978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094098.821932:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 810 00010000:00010000:1.0:1784094098.921625:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094099.433691:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094099.433752:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024315392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094099.433821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094099.433847:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024315264:0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.433890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094099.433929:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315264 00000100:00100000:2.0:1784094099.433935:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315264 00000100:00100000:2.0:1784094099.433988:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1784094099.433996:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024315264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.434040:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024315264:12345-0@lo:400:kworker.0 Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094099.434046:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1784094099.434085:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024315264:0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.434136:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315392 00000100:00100000:2.0:1784094099.434140:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315392 00000100:00100000:2.0:1784094099.434170:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1784094099.434175:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024315392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094099.434199:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094099.434482:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024315392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 305us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094099.434489:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1784094099.434493:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:0.0:1784094099.434500:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90710134dc00, transno 4294967357 00000100:00100000:0.0:1784094099.434518:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024315392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094099.434529:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094099.434535:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024315520:0@lo:400:kworker.0 00000100:00100000:0.0:1784094099.434565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784094099.434585:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094099.434613:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315520 00000100:00100000:2.0:1784094099.434616:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315520 00000100:00100000:2.0:1784094099.434644:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1784094099.434651:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024315520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.434688:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024315520:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094099.434694:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1784094099.434725:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024315648:0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.434752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094099.434786:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315648 00000100:00100000:2.0:1784094099.434789:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315648 00000100:00100000:2.0:1784094099.434824:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1784094099.434833:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024315648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.434870:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024315648:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094099.434877:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:2.0:1784094099.434891:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094099.434911:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024315648:0@lo:400:kworker.0 00000100:00100000:0.0:1784094099.434972:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024315520:0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.435041:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094099.435086:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094099.435094:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024315904:0@lo:400:kworker.0 00000100:00100000:3.0:1784094099.435118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094099.435140:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315904 00000100:00100000:3.0:1784094099.435143:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315904 00000100:00100000:3.0:1784094099.435167:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1784094099.435172:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024315904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094099.435200:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024315904:12345-0@lo:400:kworker.0 Request processed in 27us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094099.435205:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00080000:3.0:1784094099.435217:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094099.435230:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024315904:0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.435312:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024315776:0@lo:400:kworker.0 00000100:00100000:2.0:1784094099.435336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094099.435468:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024315776 00000100:00100000:3.0:1784094099.435472:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024315776 00000100:00100000:3.0:1784094099.435607:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1784094099.435614:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024315776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094099.435645:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024315776:12345-0@lo:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094099.435655:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1784094099.435677:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024315776:0@lo:400:kworker.0 00000100:00080000:2.0:1784094099.435756:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094099.950226:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094100.969629:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094101.481862:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024316032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094101.481941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094101.482193:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316032 00000100:00100000:1.0:1784094101.482204:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316032 00000100:00100000:1.0:1784094101.482291:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1784094101.482302:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024316032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094101.482360:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784094101.482454:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094101.482934:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024316032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 632us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094101.482942:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1784094101.485006:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024316032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094101.993739:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094103.018227:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094103.929287:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094103.929339:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094103.929374:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094103.929410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094103.929469:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828864 00000100:00100000:3.0:1784094103.929480:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828864 00000100:00100000:3.0:1784094103.929543:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 812 00000100:00100000:3.0:1784094103.929556:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013828864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094103.929561:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829248 00000100:00100000:0.0:1784094103.929567:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829248 00000100:00100000:0.0:1784094103.929612:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829120 00000100:00100000:0.0:1784094103.929616:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829120 00000100:00100000:3.0:1784094103.929634:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013828864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094103.929643:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 812 00000100:00100000:0.0:1784094103.929647:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 647 00000100:00100000:0.0:1784094103.929658:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013829248:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094103.929695:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013829248:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094103.929703:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 647 00000100:00100000:0.0:1784094103.929722:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:0.0:1784094103.929731:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013829120:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094103.929760:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013829120:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094103.929766:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00080000:0.0:1784094103.930112:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094103.930117:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094103.930172:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013828992 00000100:00100000:2.0:1784094103.930176:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013828992 00000100:00100000:2.0:1784094103.930220:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 859 00000100:00100000:2.0:1784094103.930226:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013828992:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094103.931114:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094103.931189:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013828992:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 961us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094103.931197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 859 00010000:00010000:3.0:1784094104.041673:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094104.553720:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024316160:0@lo:400:kworker.0 00000100:00100000:3.0:1784094104.553792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094104.553914:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316160 00000100:00100000:0.0:1784094104.553922:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316160 00000100:00100000:0.0:1784094104.553971:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1784094104.553981:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024316160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094104.554182:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024316672:0@lo:400:kworker.0 00000100:00100000:3.0:1784094104.554211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094104.554261:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024316160:12345-0@lo:400:kworker.0 Request processed in 282us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094104.554269:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1784094104.554318:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024316288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094104.554344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094104.554387:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316288 00000100:00100000:0.0:1784094104.554391:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316288 00000100:00100000:0.0:1784094104.554443:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1784094104.554450:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024316288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094104.554478:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094104.554530:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024316288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094104.554537:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1784094104.554556:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024316544:0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.554581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094104.554602:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094104.554607:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024316416:0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.554629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784094104.554654:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094104.554685:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024316288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094104.554723:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316672 00000100:00100000:0.0:1784094104.554727:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316672 00000100:00100000:0.0:1784094104.554756:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1784094104.554763:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024316672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.554796:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024316672:12345-0@lo:400:kworker.0 Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094104.554802:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00080000:0.0:1784094104.554819:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094104.554834:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316544 00000100:00100000:0.0:1784094104.554838:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316544 00000100:00100000:0.0:1784094104.554861:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316416 00000100:00100000:0.0:1784094104.554863:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316416 00000100:00100000:0.0:1784094104.554877:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1784094104.554883:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024316544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.554912:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024316544:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094104.554918:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1784094104.554927:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1784094104.554932:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024316416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.554955:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024316416:12345-0@lo:400:kworker.0 Request processed in 23us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094104.554961:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00080000:0.0:1784094104.554973:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094104.554989:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024316416:0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.554998:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024316544:0@lo:400:kworker.0 00000100:00100000:3.0:1784094104.555104:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024316160:0@lo:400:kworker.0 00000100:00100000:3.0:1784094104.555121:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024316672:0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.555417:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024316800:0@lo:400:kworker.0 00000100:00100000:0.0:1784094104.555471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094104.555597:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316800 00000100:00100000:3.0:1784094104.555602:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316800 00000100:00100000:3.0:1784094104.555645:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1784094104.555653:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024316800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784094104.555711:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094104.555821:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024316800:12345-0@lo:400:kworker.0 Request processed in 168us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094104.555828:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1784094104.555875:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024316800:0@lo:400:kworker.0 00010000:00010000:0.0:1784094105.065624:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094106.090627:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094106.601749:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094106.601771:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024316928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094106.601835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094106.602016:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024316928 00000100:00100000:2.0:1784094106.602024:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024316928 00000100:00100000:2.0:1784094106.602088:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1784094106.602097:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024316928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094106.602130:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094106.602175:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024316928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094106.602182:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00080000:3.0:1784094106.602246:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094106.602322:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024316928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094107.113633:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094108.137785:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094109.053823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094109.053934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094109.053970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094109.054003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094109.054033:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829632 00000100:00100000:3.0:1784094109.054043:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829632 00000100:00100000:3.0:1784094109.054105:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829760 00000100:00100000:3.0:1784094109.054109:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829760 00000100:00100000:3.0:1784094109.054130:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:3.0:1784094109.054138:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013829632:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094109.054202:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013829632:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094109.054209:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:3.0:1784094109.054238:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 651 00000100:00100000:3.0:1784094109.054245:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013829760:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094109.054268:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013829760:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094109.054274:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 651 00000100:00080000:3.0:1784094109.054372:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094109.054376:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094109.055476:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829504 00000100:00100000:2.0:1784094109.055493:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829504 00000100:00100000:2.0:1784094109.055586:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 863 00000100:00100000:2.0:1784094109.055596:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013829504:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094109.055674:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013829504:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094109.055682:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 863 00000100:00080000:2.0:1784094109.056585:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094109.056622:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829376 00000100:00100000:1.0:1784094109.056636:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829376 00000100:00100000:1.0:1784094109.056715:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 814 00000100:00100000:1.0:1784094109.056725:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013829376:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094109.056796:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013829376:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094109.056804:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 814 00010000:00010000:1.0:1784094109.161902:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094109.673870:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094109.673892:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024317056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094109.673953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094109.675364:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024317440:0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.675398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094109.675456:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094109.675463:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024317568:0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.675489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094109.675514:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317440 00000100:00100000:1.0:1784094109.675520:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317440 00000100:00100000:1.0:1784094109.675565:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1784094109.675573:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024317440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.675617:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024317440:12345-0@lo:400:kworker.0 Request processed in 45us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094109.675623:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1784094109.675642:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317568 00000100:00100000:1.0:1784094109.675644:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317568 00000100:00100000:1.0:1784094109.675668:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1784094109.675673:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024317568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.675697:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024317568:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094109.675702:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1784094109.675734:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024317568:0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.675743:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024317440:0@lo:400:kworker.0 00000100:00100000:0.0:1784094109.675810:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024317312:0@lo:400:kworker.0 00000100:00100000:0.0:1784094109.675835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094109.675860:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784094109.675865:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024317184:0@lo:400:kworker.0 00000100:00100000:0.0:1784094109.675888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094109.675907:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024317696:0@lo:400:kworker.0 00000100:00100000:0.0:1784094109.675925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094109.675945:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317184 00000100:00100000:0.0:1784094109.675948:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317184 00000100:00100000:0.0:1784094109.675969:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1784094109.675975:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024317184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094109.676004:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024317184:12345-0@lo:400:kworker.0 Request processed in 29us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094109.676009:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1784094109.676036:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024317184:0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.676094:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317312 00000100:00100000:1.0:1784094109.676097:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317312 00000100:00100000:1.0:1784094109.676123:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317696 00000100:00100000:1.0:1784094109.676125:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317696 00000100:00100000:1.0:1784094109.676143:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1784094109.676148:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024317312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.676180:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024317312:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094109.676185:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1784094109.676196:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1784094109.676202:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024317696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784094109.676300:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094109.676305:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094109.676344:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024317312:0@lo:400:kworker.0 00000100:00100000:1.0:1784094109.676419:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024317696:12345-0@lo:400:kworker.0 Request processed in 217us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094109.676442:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1784094109.676602:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024317696:0@lo:400:kworker.0 00000100:00100000:3.0:1784094109.677295:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317056 00000100:00100000:3.0:1784094109.677299:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317056 00000100:00100000:3.0:1784094109.677380:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1784094109.677387:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024317056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094109.677439:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094109.677489:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024317056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094109.677496:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1784094109.679319:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024317056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784094109.680304:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784094110.185724:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094110.518322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094110.518920:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013829888 00000100:00100000:1.0:1784094110.518930:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013829888 00000100:00100000:1.0:1784094110.518975:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 952 00000100:00100000:1.0:1784094110.518984:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013829888:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094110.519977:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013829888:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 991us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094110.519986:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 952 00000100:00100000:1.0:1784094110.535492:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094110.535525:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830016 00000100:00100000:1.0:1784094110.535535:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830016 00000100:00100000:1.0:1784094110.536106:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 486 00000100:00100000:1.0:1784094110.536117:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830016:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094110.537259:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830016:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 1143us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094110.537269:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 486 00000100:00100000:2.0:1784094110.549196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094110.549247:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830144 00000100:00100000:2.0:1784094110.549257:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830144 00000100:00100000:2.0:1784094110.549307:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 487 00000100:00100000:2.0:1784094110.549319:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830144:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094110.549757:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830144:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 439us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094110.549765:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 487 00000100:00100000:1.0:1784094110.553013:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094110.556625:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830272 00000100:00100000:3.0:1784094110.556642:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830272 00000100:00100000:3.0:1784094110.556732:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 953 00000100:00100000:3.0:1784094110.556744:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013830272:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094110.557287:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013830272:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 544us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094110.557295:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 953 00000100:00100000:2.0:1784094110.568827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094110.570043:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830400 00000100:00100000:1.0:1784094110.570057:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830400 00000100:00100000:1.0:1784094110.570121:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 954 00000100:00100000:1.0:1784094110.570131:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013830400:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094110.570332:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013830400:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 190us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094110.570347:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 954 00000100:00100000:2.0:1784094110.584241:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094110.584323:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830528 00000100:00100000:1.0:1784094110.584332:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830528 00000100:00100000:1.0:1784094110.584443:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 488 00000100:00100000:1.0:1784094110.584455:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830528:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094110.584921:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830528:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 467us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094110.584930:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 488 00000100:00100000:1.0:1784094110.589832:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094110.589942:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830656 00000100:00100000:3.0:1784094110.589951:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830656 00000100:00100000:3.0:1784094110.589994:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 489 00000100:00100000:3.0:1784094110.590003:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830656:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094110.590313:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:53481:x1870757013830656:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 309us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094110.590321:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 489 00000100:00100000:1.0:1784094110.597508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094110.597747:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830784 00000100:00100000:0.0:1784094110.597757:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830784 00000100:00100000:0.0:1784094110.597811:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 955 00000100:00100000:0.0:1784094110.597820:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013830784:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094110.598272:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:53481:x1870757013830784:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 443us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094110.598281:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 955 00000100:00100000:3.0:1784094110.621531:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094110.621581:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013830912 00000100:00100000:3.0:1784094110.621594:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013830912 00000100:00100000:3.0:1784094110.621685:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 956 00000100:00100000:3.0:1784094110.621699:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:53482:x1870757013830912:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094110.621725:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094110.621751:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c4d expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.621832:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cba66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.621850:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cba66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.621876:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cba66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094110.622121:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00000004:00200000:3.0:1784094110.622126:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094110.622220:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cba66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.622250:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c4d expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.622268:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cba66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c4d expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.622278:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781000) 00010000:00010000:3.0:1784094110.622281:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094110.622285:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784094110.622357:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:53482:x1870757013830912:12345-192.168.204.57@tcp:101:rm.0 Request processed in 662us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094110.622366:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 956 00000100:00100000:3.0:1784094110.626307:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094110.626347:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013831168 00000100:00100000:3.0:1784094110.626357:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013831168 00000100:00100000:3.0:1784094110.626454:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 957 00000100:00100000:3.0:1784094110.626467:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:53482:x1870757013831168:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094110.626494:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094110.626520:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c54 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094110.626868:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00010000:3.0:1784094110.627168:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c54 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.627184:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:3.0:1784094110.627187:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784094110.627192:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c54 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.627204:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094110.627279:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:53482:x1870757013831168:12345-192.168.204.57@tcp:101:rm.0 Request processed in 815us (981us total) trans 4294967664 rc 301/301 00000100:00100000:3.0:1784094110.627289:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 957 00000100:00100000:2.0:1784094110.642543:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094110.643219:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013831296 00000100:00100000:1.0:1784094110.643228:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013831296 00000100:00100000:1.0:1784094110.643279:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 98 00000100:00100000:1.0:1784094110.643289:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:53482:x1870757013831296:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784094110.650926:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:53482:x1870757013831296:12345-192.168.204.57@tcp:37:rm.0 Request processed in 7627us (8389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094110.650941:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 98 00000100:00100000:2.0:1784094110.657548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094110.657593:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013831552 00000100:00100000:2.0:1784094110.657602:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013831552 00000100:00100000:2.0:1784094110.657658:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 99 00000100:00100000:2.0:1784094110.657668:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:53482:x1870757013831552:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784094110.658077:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:53482:x1870757013831552:12345-192.168.204.57@tcp:35:rm.0 Request processed in 409us (540us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1784094110.658086:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 99 00000100:00100000:1.0:1784094110.668576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094110.677672:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013831808 00000100:00100000:3.0:1784094110.677697:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013831808 00000100:00100000:3.0:1784094110.677810:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 958 00000100:00100000:3.0:1784094110.677825:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:53482:x1870757013831808:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094110.677900:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784094110.677937:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cba66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c4d expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.677961:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cba04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c38 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.677981:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff90721a781000) 00010000:00010000:3.0:1784094110.678001:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cb725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5b82 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.678011:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:3.0:1784094110.678019:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094110.678046:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.678062:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.678074:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.678087:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.678095:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.678101:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.679736:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.679750:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.679760:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094110.687992:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 7680 00010000:00010000:3.0:1784094110.688063:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688077:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688086:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688093:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094110.688098:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688108:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688128:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094110.688132:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094110.688137:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688149:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cba89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688180:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688186:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688192:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688197:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094110.688200:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688206:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688213:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784094110.688216:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094110.688219:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.688225:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cba7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094110.688242:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000001be0eab8 reply state 00000000167fee29 transno 4294967666 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094110.688253:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094110.688359:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:53482:x1870757013831808:12345-192.168.204.57@tcp:36:rm.0 Request processed in 10532us (19785us total) trans 4294967666 rc 0/0 00000100:00100000:3.0:1784094110.688370:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 958 00010000:00010000:3.0:1784094110.694322:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.694342:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.694352:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.694362:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094110.694368:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.694377:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.694409:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff907204fcec00) 00010000:00010000:3.0:1784094110.696537:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094110.696554:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094110.696564:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cba82 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094111.211777:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094111.722966:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024317824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094111.723030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094111.723158:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317824 00000100:00100000:1.0:1784094111.723166:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317824 00000100:00100000:1.0:1784094111.723227:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1784094111.723236:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024317824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094111.723269:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094111.723313:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024317824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094111.723320:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:2.0:1784094111.723411:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094111.723469:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024317824:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784094112.158708:0:88943:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed0293810 20000000:00000080:0.0:1784094112.158725:0:88943:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b31c00 uarg=0000000000000000 00010000:00010000:0.0:1784094112.164680:0:88943:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094112.164701:0:88943:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094112.164759:0:88943:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094112.164778:0:88943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094112.164794:0:88943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cb710 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094112.164804:0:88943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094112.164838:0:88943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cb710 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094112.164854:0:88943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cb710 expref: 18 pid: 5770 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094112.164867:0:88943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237586300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88943:1870757024317952:0@lo:104: 00000100:00100000:0.0:1784094112.164926:0:88943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094112.164985:0:88943:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784094112.165255:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024317952 00000100:00100000:2.0:1784094112.165261:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024317952 00000100:00100000:2.0:1784094112.165304:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784094112.165313:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:88943:x1870757024317952:12345-0@lo:104: 00010000:00010000:2.0:1784094112.165325:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094112.165465:0:88943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237586300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88943:1870757024317952:0@lo:104: 00010000:00010000:1.0:1784094112.165483:0:88943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094112.168284:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094112.168297:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:88943:x1870757024317952:12345-0@lo:104: Request processed in 2984us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094112.168308:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00010000:3.0:1784094112.172580:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094112.172591:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.172602:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094112.172607:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.172618:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094112.172625:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094112.172632:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094112.172722:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.172729:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094112.172751:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.172759:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40400/0x9ce98053214cb710 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cb717 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.172778:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094112.172780:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094112.172782:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094112.172797:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024318080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094112.172852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094112.172912:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318080 00000100:00100000:3.0:1784094112.172919:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318080 00010000:00010000:3.0:1784094112.172946:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb710 expref: 19 pid: 5770 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094112.172977:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784094112.172985:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024318080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094112.172998:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094112.173003:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cb710 expref: 19 pid: 5770 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173015:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cb710 expref: 19 pid: 5770 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173030:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214cb717 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cb710 expref: 19 pid: 5770 timeout: 1423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173044:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173053:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173066:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173074:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173081:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173088:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173093:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094112.173098:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173105:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173118:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173127:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094112.173156:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024318080:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094112.173283:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1784094112.173321:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024318080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094112.173527:0:88943:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173537:0:88943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094112.173543:0:88943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214cba90 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094112.233547:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094113.190649:0:88991:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1d11c570 20000000:00000080:3.0:1784094113.190667:0:88991:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a5e800 uarg=0000000000000000 00010000:00010000:3.0:1784094113.192068:0:88991:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094113.192084:0:88991:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094113.192103:0:88991:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094113.192121:0:88991:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192138:0:88991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192256:0:88991:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192265:0:88991:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192272:0:88991:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192279:0:88991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192286:0:88991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094113.192290:0:88991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192298:0:88991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192312:0:88991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192320:0:88991:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.192327:0:88991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214cba97 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.259258:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094113.788857:0:89039:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdb74ceb0 20000000:00000080:3.0:1784094113.788874:0:89039:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a5e800 uarg=0000000000000000 00010000:00010000:3.0:1784094113.789074:0:89039:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094113.789088:0:89039:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094113.789104:0:89039:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094113.789122:0:89039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789152:0:89039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789164:0:89039:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789171:0:89039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789179:0:89039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789186:0:89039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789192:0:89039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094113.789197:0:89039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789205:0:89039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789217:0:89039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789230:0:89039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094113.789349:0:89039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214cba9e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094113.899576:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094113.899584:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094113.899589:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094113.899638:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094113.899651:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094113.899663:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094113.899689:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024318208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094113.899756:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094113.899805:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318208 00000100:00100000:1.0:1784094113.899810:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e14b480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094113.899813:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318208 00000100:00100000:2.0:1784094113.899871:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1784094113.899880:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024318208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094113.899893:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094113.899907:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbaa5 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094113.899927:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094113.899937:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094113.899945:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784094113.899985:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024318208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094113.899992:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1784094113.900035:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024318208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094113.900049:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094113.900059:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094113.900078:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094113.900083:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094113.900090:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094114.174080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094114.174123:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094114.174282:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013831936 00000100:00100000:3.0:1784094114.174292:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013831936 00000100:00100000:3.0:1784094114.174358:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 817 00000100:00100000:3.0:1784094114.174369:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013831936:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094114.174471:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013831936:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094114.174479:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 817 00000100:00100000:2.0:1784094114.181459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094114.181509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094114.181551:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832320 00000100:00100000:2.0:1784094114.181560:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832320 00000100:00100000:2.0:1784094114.181614:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832192 00000100:00100000:2.0:1784094114.181617:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832192 00000100:00100000:2.0:1784094114.181642:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 653 00000100:00100000:2.0:1784094114.181652:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013832320:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094114.181718:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013832320:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094114.181727:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 653 00000100:00100000:2.0:1784094114.181746:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:2.0:1784094114.181755:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013832192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094114.181784:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013832192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 32us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094114.181790:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00080000:2.0:1784094114.181807:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094114.181811:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094114.182100:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832064 00000100:00100000:0.0:1784094114.182105:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832064 00000100:00100000:0.0:1784094114.182156:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 867 00000100:00100000:0.0:1784094114.182164:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013832064:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094114.182210:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013832064:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (8086us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.182216:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 867 00000100:00080000:2.0:1784094114.182300:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094114.282587:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094114.335546:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967665 is committed 00000001:00080000:0.0:1784094114.335562:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967666 is committed 00000100:00100000:0.0:1784094114.793696:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024318720:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.793768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094114.793827:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784094114.793835:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024318336:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.793865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094114.793891:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024318848:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.793918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094114.793946:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024318464:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.793969:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094114.793989:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024318976:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.794010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094114.794029:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094114.794034:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024318592:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.794053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094114.794085:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318720 00000100:00100000:0.0:1784094114.794091:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318720 00000100:00100000:2.0:1784094114.794293:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024319104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094114.794338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094114.794407:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319104 00000100:00100000:1.0:1784094114.794412:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319104 00000100:00100000:1.0:1784094114.794490:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1784094114.794501:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024319104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094114.794536:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094114.794584:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024319104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094114.794592:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1784094114.794685:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024319104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094114.795220:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318976 00000100:00100000:0.0:1784094114.795225:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318976 00000100:00100000:0.0:1784094114.795250:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1784094114.795256:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024318720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795295:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024318720:12345-0@lo:400:kworker.0 Request processed in 39us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.795301:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1784094114.795324:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1784094114.795329:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024318976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795354:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024318976:12345-0@lo:400:kworker.0 Request processed in 25us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.795360:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1784094114.795376:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318336 00000100:00100000:0.0:1784094114.795379:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318336 00000100:00100000:0.0:1784094114.795400:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1784094114.795405:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024318336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795448:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024318336:12345-0@lo:400:kworker.0 Request processed in 43us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.795454:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1784094114.795476:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318848 00000100:00100000:0.0:1784094114.795479:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318848 00000100:00100000:0.0:1784094114.795503:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318464 00000100:00100000:0.0:1784094114.795505:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318464 00000100:00100000:0.0:1784094114.795521:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024318592 00000100:00100000:0.0:1784094114.795524:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024318592 00000100:00100000:0.0:1784094114.795539:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1784094114.795545:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024318848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795575:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024318848:12345-0@lo:400:kworker.0 Request processed in 31us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.795581:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1784094114.795592:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1784094114.795597:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024318464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795625:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024318464:12345-0@lo:400:kworker.0 Request processed in 28us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.795630:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1784094114.795642:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1784094114.795648:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024318592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795675:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024318592:12345-0@lo:400:kworker.0 Request processed in 28us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094114.795681:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00080000:0.0:1784094114.795708:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094114.795712:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094114.795714:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094114.795739:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024318592:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795749:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024318464:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795756:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024318976:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795779:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237584000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024318336:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795788:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024318848:0@lo:400:kworker.0 00000100:00100000:0.0:1784094114.795795:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024318720:0@lo:400:kworker.0 00010000:00010000:1.0:1784094115.314559:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094116.330080:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094116.849214:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094116.849235:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024319232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094116.849313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094116.850580:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319232 00000100:00100000:0.0:1784094116.850589:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319232 00000100:00100000:0.0:1784094116.850648:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1784094116.850657:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024319232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094116.850690:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784094116.850880:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094116.850988:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024319232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094116.850996:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1784094116.852695:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024319232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094117.357708:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094117.377136:0:89236:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9ec0cbb0 20000000:00000080:3.0:1784094117.377153:0:89236:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a5d800 uarg=0000000000000000 00010000:00010000:3.0:1784094117.377755:0:89236:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094117.377770:0:89236:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094117.377789:0:89236:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094117.377807:0:89236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094117.377823:0:89236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094117.377832:0:89236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094117.377871:0:89236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094117.377884:0:89236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 18 pid: 5772 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094117.377899:0:89236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89236:1870757024319360:0@lo:104: 00000100:00100000:3.0:1784094117.377968:0:89236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094117.378066:0:89236:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66300 going to sleep for 11 seconds 00000100:00100000:1.0:1784094117.378220:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319360 00000100:00100000:1.0:1784094117.378228:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319360 00000100:00100000:1.0:1784094117.378326:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784094117.378335:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:89236:x1870757024319360:12345-0@lo:104: 00010000:00010000:1.0:1784094117.378347:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094117.378574:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094117.378582:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:89236:x1870757024319360:12345-0@lo:104: Request processed in 247us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094117.378590:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1784094117.378713:0:89236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89236:1870757024319360:0@lo:104: 00010000:00010000:3.0:1784094117.378733:0:89236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.378769:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094117.378776:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.378784:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094117.378789:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.378797:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094117.378804:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094117.378810:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094117.378877:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.378884:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094117.378910:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.378918:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cbaa5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbaac expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.378933:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094117.378935:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094117.378937:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094117.378986:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024319488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094117.379020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094117.379100:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319488 00000100:00100000:2.0:1784094117.379105:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319488 00010000:00010000:2.0:1784094117.379140:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 19 pid: 5772 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094117.379173:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1784094117.379179:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024319488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094117.379190:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094117.379195:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 19 pid: 5772 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379205:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 19 pid: 5772 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379216:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214cbaac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbaa5 expref: 19 pid: 5772 timeout: 1428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379229:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379236:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379249:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379268:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379275:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379281:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379291:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094117.379295:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379303:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379316:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379325:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094117.379353:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024319488:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094117.379360:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784094117.379447:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024319488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094117.379516:0:89236:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379524:0:89236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094117.379530:0:89236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214cbab3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094118.381595:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094118.825582:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094118.825602:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094118.825608:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094118.825658:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094118.825671:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094118.825683:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094118.825720:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024319616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094118.825795:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094118.825874:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66780 going to sleep for 11 seconds 00000100:00100000:0.0:1784094118.828241:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319616 00000100:00100000:0.0:1784094118.828254:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319616 00000100:00100000:0.0:1784094118.828323:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1784094118.828332:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024319616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094118.828357:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094118.828375:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbaba expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094118.828404:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbaba expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094118.828416:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbaba expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094118.828460:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784094118.828551:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024319616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094118.828558:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:3.0:1784094118.828607:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024319616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094118.828627:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094118.828637:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094118.828659:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094118.828665:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094118.828671:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094119.288938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094119.288988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094119.289035:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094119.289065:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832576 00000100:00100000:0.0:1784094119.289075:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832576 00000100:00100000:2.0:1784094119.289080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094119.289112:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832832 00000100:00100000:2.0:1784094119.289117:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832832 00000100:00100000:0.0:1784094119.289148:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 871 00000100:00100000:2.0:1784094119.289156:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832704 00000100:00100000:2.0:1784094119.289162:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832704 00000100:00100000:0.0:1784094119.289163:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013832576:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094119.289193:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 657 00000100:00100000:2.0:1784094119.289204:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013832832:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094119.289313:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832448 00000100:00100000:3.0:1784094119.289318:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832448 00000100:00100000:1.0:1784094119.289332:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 658 00000100:00100000:1.0:1784094119.289344:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013832704:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094119.289355:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 820 00000100:00100000:3.0:1784094119.289365:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013832448:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094119.289395:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013832576:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094119.289405:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 871 00000100:00100000:2.0:1784094119.292763:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013832832:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 3484us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094119.292780:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 657 00000100:00080000:2.0:1784094119.292830:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094119.292835:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094119.292838:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094119.294806:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013832448:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 5433us (5760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094119.294821:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 820 00000100:00100000:1.0:1784094119.298057:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013832704:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 8703us (8965us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094119.298071:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 658 00010000:00010000:1.0:1784094119.402504:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094119.913809:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094119.915376:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024319744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094119.915464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094119.915640:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319744 00000100:00100000:1.0:1784094119.915648:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319744 00000100:00100000:1.0:1784094119.915709:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1784094119.915719:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024319744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094119.915768:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094119.915820:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024319744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094119.915828:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00080000:3.0:1784094119.916562:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094119.916607:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024319744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094119.922554:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024319872:0@lo:400:kworker.0 00000100:00100000:2.0:1784094119.922554:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024320000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.925621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094119.925750:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024320384:0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.925788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094119.925820:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094119.925827:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024320256:0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.925851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094119.925885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320384 00000100:00100000:3.0:1784094119.925893:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320384 00000100:00100000:3.0:1784094119.925951:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1784094119.925961:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024320384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.926017:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024320384:12345-0@lo:400:kworker.0 Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094119.926026:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1784094119.926052:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320256 00000100:00100000:3.0:1784094119.926056:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320256 00000100:00100000:3.0:1784094119.926094:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1784094119.926102:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024320256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.926134:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024320256:12345-0@lo:400:kworker.0 Request processed in 34us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094119.926141:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00080000:3.0:1784094119.926162:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094119.926166:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094119.926194:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024320256:0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.926216:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024320384:0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.928794:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024320128:0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.928862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094119.928920:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320128 00000100:00100000:3.0:1784094119.928927:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320128 00000100:00100000:3.0:1784094119.928977:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:3.0:1784094119.928986:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024320128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.929037:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024320128:12345-0@lo:400:kworker.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094119.929044:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00080000:3.0:1784094119.929070:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094119.929097:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024320128:0@lo:400:kworker.0 00000100:00100000:1.0:1784094119.930554:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024319872 00000100:00100000:1.0:1784094119.930564:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024319872 00000100:00100000:1.0:1784094119.930607:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1784094119.930616:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094119.930684:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024319872:12345-0@lo:400:kworker.0 Request processed in 69us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094119.930691:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1784094119.930742:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024319872:0@lo:400:kworker.0 00000100:00100000:2.0:1784094119.935392:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094119.936573:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320000 00000100:00100000:3.0:1784094119.936584:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320000 00000100:00100000:3.0:1784094119.936635:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1784094119.936645:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024320000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094119.936724:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024320000:12345-0@lo:400:kworker.0 Request processed in 81us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094119.936733:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1784094119.936802:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024320000:0@lo:400:kworker.0 00010000:00010000:3.0:1784094120.427056:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094121.449693:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094121.962675:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024320512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094121.962758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094121.962904:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320512 00000100:00100000:0.0:1784094121.962913:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320512 00000100:00100000:0.0:1784094121.962995:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1784094121.963005:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024320512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784094121.963041:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784094121.963045:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094121.963103:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024320512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094121.963121:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1784094121.963156:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024320512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094122.474627:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094123.497526:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094124.412719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094124.412766:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094124.412804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094124.412845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094124.412876:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833216 00000100:00100000:0.0:1784094124.412886:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833216 00000100:00100000:0.0:1784094124.412952:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833344 00000100:00100000:0.0:1784094124.412955:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833344 00000100:00100000:0.0:1784094124.412978:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 660 00000100:00100000:0.0:1784094124.412988:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833216:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094124.413076:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833216:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094124.413083:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 660 00000100:00100000:0.0:1784094124.413105:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 661 00000100:00100000:0.0:1784094124.413111:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833344:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094124.413148:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833344:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094124.413154:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 661 00000100:00100000:1.0:1784094124.413351:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833088 00000100:00100000:1.0:1784094124.413356:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833088 00000100:00100000:1.0:1784094124.413394:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 875 00000100:00100000:1.0:1784094124.413402:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833088:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094124.413473:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833088:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094124.413480:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 875 00000100:00080000:1.0:1784094124.413498:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094124.413502:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094124.413505:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094124.414491:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013832960 00000100:00100000:3.0:1784094124.414500:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013832960 00000100:00100000:3.0:1784094124.414598:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 822 00000100:00100000:3.0:1784094124.414608:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013832960:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094124.414665:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013832960:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 58us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094124.414672:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 822 00010000:00010000:3.0:1784094124.522527:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094125.037164:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024320640:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094125.037282:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024321152:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094125.037339:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094125.037345:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024321024:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094125.037401:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024320768:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037456:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094125.037476:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024321280:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037498:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094125.037519:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094125.037525:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024320896:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094125.037579:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321152 00000100:00100000:3.0:1784094125.037586:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321152 00000100:00100000:3.0:1784094125.037644:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320768 00000100:00100000:3.0:1784094125.037647:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320768 00000100:00100000:3.0:1784094125.037667:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320896 00000100:00100000:3.0:1784094125.037669:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320896 00000100:00100000:3.0:1784094125.037688:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1784094125.037696:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024321152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037749:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024321152:12345-0@lo:400:kworker.0 Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094125.037757:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1784094125.037773:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1784094125.037781:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024320768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037814:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024320768:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094125.037820:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1784094125.037832:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1784094125.037839:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024320896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037868:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024320896:12345-0@lo:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094125.037874:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1784094125.037893:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321024 00000100:00100000:3.0:1784094125.037896:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321024 00000100:00100000:3.0:1784094125.037922:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321280 00000100:00100000:3.0:1784094125.037924:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321280 00000100:00100000:3.0:1784094125.037945:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1784094125.037952:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024321024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.037982:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024321024:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094125.037988:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1784094125.038000:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1784094125.038006:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024321280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.038033:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024321280:12345-0@lo:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094125.038038:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1784094125.038089:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024320896:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.038099:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024320768:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.038126:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024321280:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.038156:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024321024:0@lo:400:kworker.0 00000100:00100000:3.0:1784094125.038165:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024321152:0@lo:400:kworker.0 00000100:00100000:2.0:1784094125.040128:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024320640 00000100:00100000:2.0:1784094125.040156:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024320640 00000100:00100000:2.0:1784094125.040214:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1784094125.040223:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024320640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094125.040309:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024320640:12345-0@lo:400:kworker.0 Request processed in 85us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094125.040316:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:3.0:1784094125.040333:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024320640:0@lo:400:kworker.0 00000100:00100000:2.0:1784094125.040357:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024321408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094125.040389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784094125.040950:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094125.040955:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094125.040959:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094125.040975:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321408 00000100:00100000:1.0:1784094125.040979:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321408 00000100:00100000:1.0:1784094125.041018:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1784094125.041027:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024321408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094125.041059:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094125.041102:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024321408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094125.041242:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1784094125.041280:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024321408:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1784094125.129382:0:89579:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 21: test nodemap mapped_trusted_noadmin fileops ========================================================== 01:42:04 (1784094124) 00010000:00010000:2.0:1784094125.545705:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1784094126.040731:0:89627:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1784094126.050408:0:89627:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1784094126.578404:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094126.866582:0:89675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff451d2b0 20000000:00000080:0.0:1784094126.866601:0:89675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101391c00 uarg=0000000000000000 10000000:01000000:0.0:1784094126.867326:0:89675:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094126.867346:0:89675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.867364:0:89675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbaba expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.867373:0:89675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.867410:0:89675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbaba expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.868615:0:89675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbaba expref: 18 pid: 5772 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094126.868636:0:89675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89675:1870757024321536:0@lo:104: 00000100:00100000:0.0:1784094126.868769:0:89675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094126.868892:0:89675:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b935e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784094126.870829:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321536 00000100:00100000:2.0:1784094126.870844:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321536 00000100:00100000:2.0:1784094126.870966:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784094126.870978:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:89675:x1870757024321536:12345-0@lo:104: 00010000:00010000:2.0:1784094126.870995:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094126.871100:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094126.871108:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:89675:x1870757024321536:12345-0@lo:104: Request processed in 132us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094126.871115:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00010000:3.0:1784094126.871173:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094126.871180:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871189:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094126.871194:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871203:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094126.871211:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094126.871217:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094126.871255:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871262:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094126.871282:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871290:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbaba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbac1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871311:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094126.871313:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094126.871315:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094126.871337:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024321664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094126.871374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094126.871445:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321664 00000100:00100000:3.0:1784094126.871449:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321664 00010000:00010000:3.0:1784094126.871469:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbaba expref: 19 pid: 5772 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094126.871493:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1784094126.871500:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024321664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094126.871511:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094126.871517:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbaba expref: 19 pid: 5772 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871529:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbaba expref: 19 pid: 5772 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871548:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871557:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871573:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871580:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871588:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871595:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871601:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094126.871605:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871613:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871622:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094126.871634:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094126.871784:0:89675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214cbac1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbaba expref: 19 pid: 5772 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094126.871796:0:89675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89675:1870757024321536:0@lo:104: 00010000:00010000:0.0:1784094126.871817:0:89675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.871826:0:89675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.871832:0:89675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094126.871838:0:89675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214cbac8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094126.876328:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024321664:12345-0@lo:103:ldlm_bl.0 Request processed in 4818us (4943us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094126.876343:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1784094126.878206:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024321664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094127.082627:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094127.082651:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024321792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094127.082723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094127.082773:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321792 00000100:00100000:1.0:1784094127.082781:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321792 00000100:00080000:0.0:1784094127.082817:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094127.082842:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1784094127.082853:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024321792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094127.082891:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094127.082955:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024321792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094127.082962:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1784094127.083467:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024321792:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784094127.586923:0:89723:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0fa3cc50 20000000:00000080:0.0:1784094127.586941:0:89723:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101392400 uarg=0000000000000000 10000000:01000000:0.0:1784094127.587296:0:89723:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094127.587317:0:89723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587335:0:89723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587347:0:89723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587354:0:89723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587362:0:89723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587387:0:89723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587393:0:89723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094127.587397:0:89723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587406:0:89723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587452:0:89723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587462:0:89723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094127.587468:0:89723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214cbacf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094127.594636:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094128.510367:0:89771:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffbef9520 20000000:00000080:2.0:1784094128.510384:0:89771:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df3800 uarg=0000000000000000 10000000:01000000:2.0:1784094128.510705:0:89771:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094128.510726:0:89771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510741:0:89771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510753:0:89771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510760:0:89771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510768:0:89771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510776:0:89771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510783:0:89771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094128.510788:0:89771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510807:0:89771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510968:0:89771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510977:0:89771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.510984:0:89771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41200/0x9ce98053214cbad6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094128.623369:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094128.681501:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094128.681508:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094128.681576:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094128.681620:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.681632:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.681651:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094128.681676:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024321920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094128.681743:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094128.681788:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8480 going to sleep for 11 seconds 00000100:00100000:3.0:1784094128.681809:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024321920 00000100:00100000:3.0:1784094128.681816:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024321920 00000100:00100000:3.0:1784094128.681865:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1784094128.681874:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024321920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094128.681886:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094128.681899:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbadd expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.681918:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbadd expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.681929:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbadd expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.681939:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784094128.681975:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024321920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094128.681983:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1784094128.682029:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024321920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094128.682057:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.682067:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094128.682088:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094128.682092:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094128.682100:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784094129.286289:0:89819:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3c4f1750 20000000:00000080:2.0:1784094129.286309:0:89819:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df0400 uarg=0000000000000000 10000000:01000000:2.0:1784094129.287001:0:89819:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094129.287025:0:89819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.287055:0:89819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbadd expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.287065:0:89819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.287117:0:89819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbadd expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.287134:0:89819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbadd expref: 18 pid: 5772 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094129.287152:0:89819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89819:1870757024322048:0@lo:104: 00000100:00100000:2.0:1784094129.287232:0:89819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094129.287326:0:89819:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208887600 going to sleep for 11 seconds 00000100:00100000:3.0:1784094129.287369:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322048 00000100:00100000:3.0:1784094129.287378:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322048 00000100:00100000:3.0:1784094129.287607:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1784094129.287619:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:89819:x1870757024322048:12345-0@lo:104: 00010000:00010000:3.0:1784094129.287633:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094129.287700:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094129.287706:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:89819:x1870757024322048:12345-0@lo:104: Request processed in 90us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094129.287713:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00010000:1.0:1784094129.287762:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094129.287770:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.287778:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094129.287783:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.287793:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094129.287806:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094129.287812:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094129.287855:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.287861:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094129.287885:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.287892:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214cbadd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbae4 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.287917:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094129.287919:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094129.287922:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094129.287930:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094129.287941:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024322176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094129.287977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094129.288012:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322176 00000100:00100000:1.0:1784094129.288016:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322176 00010000:00010000:1.0:1784094129.288046:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbadd expref: 19 pid: 5772 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094129.288067:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784094129.288073:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024322176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094129.288084:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094129.288090:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbadd expref: 19 pid: 5772 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288100:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbadd expref: 19 pid: 5772 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288116:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288125:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288154:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288161:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288170:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288176:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288182:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094129.288186:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288195:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288203:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.288214:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094129.288237:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024322176:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094129.288244:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784094129.288353:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024322176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094129.288611:0:89819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214cbae4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbadd expref: 18 pid: 5772 timeout: 1440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094129.288621:0:89819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89819:1870757024322048:0@lo:104: 00010000:00010000:2.0:1784094129.288634:0:89819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.288644:0:89819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.288650:0:89819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094129.288657:0:89819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214cbaeb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094129.532557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094129.532629:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833472 00000100:00100000:1.0:1784094129.532642:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833472 00000100:00100000:1.0:1784094129.532705:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 825 00000100:00100000:1.0:1784094129.532717:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013833472:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094129.532792:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013833472:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094129.532800:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 825 00000100:00100000:2.0:1784094129.532962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094129.533660:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833600 00000100:00100000:3.0:1784094129.533666:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833600 00000100:00100000:3.0:1784094129.533735:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 879 00000100:00100000:3.0:1784094129.533743:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833600:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094129.533781:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013833600:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094129.533790:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 879 00000100:00100000:1.0:1784094129.534711:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094129.534748:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094129.534771:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833856 00000100:00100000:1.0:1784094129.534776:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833856 00000100:00100000:1.0:1784094129.534803:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833728 00000100:00100000:1.0:1784094129.534805:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833728 00000100:00100000:1.0:1784094129.534823:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 664 00000100:00100000:1.0:1784094129.534830:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013833856:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094129.535183:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094129.535188:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094129.535191:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094129.535599:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 665 00000100:00100000:2.0:1784094129.535609:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013833728:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094129.535662:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013833728:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 55us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094129.535669:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 665 00000100:00100000:1.0:1784094129.536693:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013833856:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1861us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094129.536702:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 664 00010000:00010000:2.0:1784094129.641640:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094129.979152:0:89869:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee8560c80 20000000:00000080:1.0:1784094129.979167:0:89869:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101bbd400 uarg=0000000000000000 10000000:01000000:1.0:1784094129.979775:0:89869:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094129.979794:0:89869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979810:0:89869:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979822:0:89869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979893:0:89869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979902:0:89869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979910:0:89869:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979917:0:89869:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094129.979922:0:89869:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979932:0:89869:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979962:0:89869:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979970:0:89869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094129.979983:0:89869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12c00/0x9ce98053214cbaf2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094130.153608:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024322688:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.153675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.153729:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784094130.153736:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024322304:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.153764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.153788:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024322816:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.153815:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.153840:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024322432:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.153864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.153882:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024322944:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.153903:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.153920:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094130.153925:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024322560:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.153946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.153976:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322688 00000100:00100000:0.0:1784094130.153982:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322688 00000100:00100000:0.0:1784094130.154043:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322944 00000100:00100000:0.0:1784094130.154047:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322944 00000100:00100000:0.0:1784094130.154072:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1784094130.154082:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024322688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154132:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024322688:12345-0@lo:400:kworker.0 Request processed in 52us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.154139:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1784094130.154155:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1784094130.154161:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154189:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024322944:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.154195:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1784094130.154321:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322304 00000100:00100000:0.0:1784094130.154324:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322304 00000100:00100000:0.0:1784094130.154350:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1784094130.154357:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024322304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154393:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024322304:12345-0@lo:400:kworker.0 Request processed in 36us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.154399:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1784094130.154455:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322816 00000100:00100000:0.0:1784094130.154459:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322816 00000100:00100000:0.0:1784094130.154497:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322432 00000100:00100000:0.0:1784094130.154501:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322432 00000100:00100000:0.0:1784094130.154519:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024322560 00000100:00100000:0.0:1784094130.154521:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024322560 00000100:00100000:0.0:1784094130.154537:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1784094130.154544:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024322816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154575:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024322816:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.154582:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1784094130.154594:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1784094130.154599:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024322432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154627:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024322432:12345-0@lo:400:kworker.0 Request processed in 28us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.154633:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1784094130.154644:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1784094130.154650:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024322560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154677:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024322560:12345-0@lo:400:kworker.0 Request processed in 28us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.154683:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00080000:0.0:1784094130.154708:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094130.154713:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094130.154715:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094130.154755:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024322560:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154769:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024322432:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154779:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024322944:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154805:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024322304:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154815:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024322816:0@lo:400:kworker.0 00000100:00100000:0.0:1784094130.154823:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024322688:0@lo:400:kworker.0 00000100:00100000:3.0:1784094130.162518:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024323072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094130.162592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094130.162646:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323072 00000100:00100000:0.0:1784094130.162655:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323072 00000100:00100000:0.0:1784094130.162704:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1784094130.162714:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024323072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094130.162753:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57737216 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094130.162803:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024323072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094130.162811:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1784094130.165179:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024323072:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1784094130.656282:0:89917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd85aa4ab0 20000000:00000080:3.0:1784094130.656312:0:89917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210eee800 uarg=0000000000000000 10000000:01000000:3.0:1784094130.656789:0:89917:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094130.656874:0:89917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656893:0:89917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656904:0:89917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656911:0:89917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656917:0:89917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656923:0:89917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656930:0:89917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094130.656934:0:89917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.656944:0:89917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.658759:0:89917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.658769:0:89917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.658775:0:89917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cbaf9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094130.667164:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094131.113511:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094131.113523:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094131.113529:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094131.113577:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094131.113589:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094131.113600:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094131.113625:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024323200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094131.113692:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094131.113805:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1000 going to sleep for 11 seconds 00000100:00100000:1.0:1784094131.113967:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323200 00000100:00100000:1.0:1784094131.113975:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323200 00000100:00100000:1.0:1784094131.114129:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1784094131.114139:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024323200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094131.114152:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094131.114166:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbb00 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094131.114188:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094131.114199:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094131.114207:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784094131.114282:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024323200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094131.114289:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1784094131.114414:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024323200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094131.114521:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094131.114530:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094131.114547:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094131.114553:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094131.114560:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094131.692050:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094132.201556:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024323328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094132.201624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094132.201748:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323328 00000100:00100000:2.0:1784094132.201802:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323328 00000100:00080000:0.0:1784094132.201843:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094132.201892:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1784094132.201901:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024323328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094132.201932:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094132.201972:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024323328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094132.201999:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1784094132.202023:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024323328:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1784094132.356812:0:90064:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff01d88190 20000000:00000080:3.0:1784094132.356830:0:90064:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e213c00 uarg=0000000000000000 10000000:01000000:3.0:1784094132.357037:0:90064:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094132.357057:0:90064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.357075:0:90064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.357085:0:90064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.357123:0:90064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.357137:0:90064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 18 pid: 5772 timeout: 1443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094132.357174:0:90064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90064:1870757024323456:0@lo:104: 00000100:00100000:3.0:1784094132.357236:0:90064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094132.357280:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323456 00000100:00100000:3.0:1784094132.357284:0:90064:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208d993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094132.357289:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323456 00000100:00100000:2.0:1784094132.357340:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784094132.357347:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:90064:x1870757024323456:12345-0@lo:104: 00010000:00010000:2.0:1784094132.357358:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094132.357403:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094132.357407:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:90064:x1870757024323456:12345-0@lo:104: Request processed in 62us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094132.357413:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1784094132.357487:0:90064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90064:1870757024323456:0@lo:104: 00010000:00010000:3.0:1784094132.357505:0:90064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.358038:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094132.358046:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.358055:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094132.358059:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.358074:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094132.358081:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094132.358088:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094132.358119:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.358127:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094132.358158:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.358166:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cbb00 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb07 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094132.358171:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024323584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094132.358183:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094132.358187:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094132.358189:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094132.358207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094132.358244:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323584 00000100:00100000:3.0:1784094132.358249:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323584 00010000:00010000:3.0:1784094132.358269:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 19 pid: 5772 timeout: 1443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094132.358523:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784094132.358532:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024323584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094132.358543:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094132.358548:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 19 pid: 5772 timeout: 1443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360050:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 19 pid: 5772 timeout: 1443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360070:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12600/0x9ce98053214cbb07 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbb00 expref: 19 pid: 5772 timeout: 1443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360086:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360094:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360112:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360120:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360127:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360135:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.360141:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094132.360146:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.361251:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.361281:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094132.361295:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094132.361356:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024323584:12345-0@lo:103:ldlm_bl.0 Request processed in 2824us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094132.361366:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1784094132.361520:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024323584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094132.362985:0:90064:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094132.362997:0:90064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094132.363004:0:90064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214cbb0e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094132.713605:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094132.719256:0:90112:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4c15ee20 20000000:00000080:1.0:1784094132.719273:0:90112:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df4000 uarg=0000000000000000 10000000:01000000:1.0:1784094132.719468:0:90112:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094132.719485:0:90112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719498:0:90112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719506:0:90112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719511:0:90112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719516:0:90112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719521:0:90112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719525:0:90112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094132.719528:0:90112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719533:0:90112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719541:0:90112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719545:0:90112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094132.719549:0:90112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214cbb15 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094133.737645:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094133.993524:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094133.993533:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094133.993537:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094133.993604:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094133.993619:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094133.993633:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094133.993664:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024323712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094133.993747:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094133.993833:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722d9816c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094133.993837:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323712 00000100:00100000:0.0:1784094133.993849:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323712 00000100:00100000:0.0:1784094133.993912:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1784094133.993925:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024323712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094133.993954:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094133.993970:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbb1c expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094133.993998:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094133.994011:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094133.994022:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784094133.994072:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024323712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094133.994081:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1784094133.994109:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024323712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094133.994134:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094133.994144:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094133.994166:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094133.994173:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094133.994181:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784094134.165882:0:90307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff91b73f30 20000000:00000080:3.0:1784094134.165898:0:90307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e213800 uarg=0000000000000000 00010000:00010000:3.0:1784094134.166110:0:90307:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094134.166123:0:90307:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094134.166133:0:90307:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094134.166149:0:90307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.166166:0:90307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.166175:0:90307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.166208:0:90307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.166220:0:90307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 18 pid: 5770 timeout: 1445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094134.166233:0:90307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90307:1870757024323840:0@lo:104: 00000100:00100000:3.0:1784094134.166292:0:90307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094134.166338:0:90307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072374f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094134.166350:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784094134.166363:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323840 00000100:00100000:1.0:1784094134.166369:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323840 00000100:00100000:1.0:1784094134.166438:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784094134.166449:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071019dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:90307:x1870757024323840:12345-0@lo:104: 00010000:00010000:1.0:1784094134.166462:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094134.166524:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094134.166531:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071019dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:90307:x1870757024323840:12345-0@lo:104: Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094134.166538:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00010000:2.0:1784094134.166549:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094134.166556:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094134.166558:0:90307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90307:1870757024323840:0@lo:104: 00010000:00010000:2.0:1784094134.166570:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094134.166575:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.166586:0:90307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094134.166586:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094134.166607:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094134.166616:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094134.166649:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094134.166656:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094134.166684:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094134.166687:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024323968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094134.166699:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbb1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb23 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094134.166718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784094134.166718:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094134.166722:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094134.166725:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094134.166754:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024323968 00000100:00100000:0.0:1784094134.166759:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024323968 00010000:00010000:0.0:1784094134.166782:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 19 pid: 5770 timeout: 1445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094134.166819:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1784094134.166828:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024323968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094134.166837:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094134.166842:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 19 pid: 5770 timeout: 1445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166852:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 19 pid: 5770 timeout: 1445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166863:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214cbb23 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbb1c expref: 19 pid: 5770 timeout: 1445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166875:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166883:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166895:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166901:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166908:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166914:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166918:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094134.166922:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.166929:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.167000:0:90307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.167001:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094134.167022:0:90307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 2/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094134.167024:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094134.167035:0:90307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68400/0x9ce98053214cbb2a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094134.167067:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024323968:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094134.167075:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1784094134.167087:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024323968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094134.652388:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094134.652884:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094134.652978:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834112 00000100:00100000:0.0:1784094134.652989:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834112 00000100:00100000:0.0:1784094134.653076:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 883 00000100:00100000:0.0:1784094134.653087:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013834112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094134.653174:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013834112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094134.653182:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 883 00000100:00080000:2.0:1784094134.653476:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094134.654058:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013833984 00000100:00100000:3.0:1784094134.654064:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013833984 00000100:00100000:3.0:1784094134.654223:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 829 00000100:00100000:3.0:1784094134.654234:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013833984:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094134.654336:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013833984:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 104us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094134.654344:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 829 00000100:00100000:2.0:1784094134.655566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094134.655642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094134.655771:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834240 00000100:00100000:1.0:1784094134.655777:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834240 00000100:00100000:1.0:1784094134.655829:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834368 00000100:00100000:1.0:1784094134.655832:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834368 00000100:00100000:1.0:1784094134.655856:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 490 00000100:00100000:1.0:1784094134.655863:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013834240:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:1.0:1784094134.655884:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214ca8bc 00000100:00080000:1.0:1784094134.655892:0:6574:0:(import.c:65:import_set_state_nolock()) ffff907102044800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784094134.655952:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967357 00000100:00080000:2.0:1784094134.656192:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094134.656196:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094134.656254:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 491 00000100:00100000:3.0:1784094134.656263:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013834368:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:3.0:1784094134.656277:0:8031:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214ca1bc 00000100:00080000:3.0:1784094134.656282:0:8031:0:(import.c:65:import_set_state_nolock()) ffff907103951800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784094134.656313:0:8031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967357 00000100:00100000:3.0:1784094134.656535:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013834368:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 272us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094134.656544:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 491 00010000:00010000:2.0:1784094134.656762:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094134.657390:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013834240:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 1525us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094134.657399:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 490 00010000:00010000:1.0:1784094134.657447:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094134.761947:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094135.279006:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024324096:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279079:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094135.279123:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024324608:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279151:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094135.279175:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094135.279180:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024324480:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094135.279226:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024324224:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279249:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094135.279264:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024324736:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094135.279295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094135.279299:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024324352:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279316:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094135.279343:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324096 00000100:00100000:1.0:1784094135.279350:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324096 00000100:00100000:1.0:1784094135.279390:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1784094135.279398:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279456:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024324096:12345-0@lo:400:kworker.0 Request processed in 59us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094135.279463:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1784094135.279846:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324608 00000100:00100000:1.0:1784094135.279851:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324608 00000100:00100000:1.0:1784094135.279895:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324224 00000100:00100000:1.0:1784094135.279899:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324224 00000100:00100000:1.0:1784094135.279915:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324352 00000100:00100000:1.0:1784094135.279929:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324352 00000100:00100000:1.0:1784094135.279946:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1784094135.279952:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.279986:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024324608:12345-0@lo:400:kworker.0 Request processed in 34us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094135.279992:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1784094135.280004:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1784094135.280009:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280034:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024324224:12345-0@lo:400:kworker.0 Request processed in 25us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094135.280040:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1784094135.280049:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1784094135.280055:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280076:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024324352:12345-0@lo:400:kworker.0 Request processed in 22us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094135.280081:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1784094135.280097:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324480 00000100:00100000:1.0:1784094135.280101:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324480 00000100:00100000:1.0:1784094135.280124:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324736 00000100:00100000:1.0:1784094135.280128:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324736 00000100:00100000:1.0:1784094135.280146:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1784094135.280153:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024324480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280182:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024324480:12345-0@lo:400:kworker.0 Request processed in 30us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094135.280188:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1784094135.280197:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1784094135.280202:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024324736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280222:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024324736:12345-0@lo:400:kworker.0 Request processed in 20us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094135.280228:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1784094135.280285:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024324352:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280294:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237587800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024324224:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280304:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024324736:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280332:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024324480:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280340:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024324096:0@lo:400:kworker.0 00000100:00100000:1.0:1784094135.280349:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024324608:0@lo:400:kworker.0 00000100:00100000:0.0:1784094135.280635:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094135.280645:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024324864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094135.280676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094135.280708:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324864 00000100:00100000:0.0:1784094135.280712:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324864 00000100:00100000:0.0:1784094135.280752:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1784094135.280760:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024324864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094135.280790:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094135.280827:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024324864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094135.280832:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1784094135.280862:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024324864:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784094135.280978:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094135.280984:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094135.280987:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784094135.785593:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094135.913494:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094135.913502:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094135.913507:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094135.913552:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094135.913565:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094135.913577:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094135.913604:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024324992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094135.913671:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094135.913814:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024324992 00000100:00100000:2.0:1784094135.913822:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024324992 00000100:00100000:2.0:1784094135.913876:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1784094135.913885:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024324992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094135.913898:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094135.913923:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbb31 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094135.913947:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094135.913963:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094135.913973:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094135.914006:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024324992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094135.914013:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1784094135.914241:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210d48240 going to sleep for 11 seconds 00000100:00100000:3.0:1784094135.914263:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024324992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094135.914276:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094135.914286:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094135.914303:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094135.914307:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094135.914315:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094136.252816:0:90504:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda068ed00 20000000:00000080:1.0:1784094136.252835:0:90504:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df7400 uarg=0000000000000000 00010000:00010000:1.0:1784094136.253353:0:90504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094136.253370:0:90504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094136.253384:0:90504:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094136.253403:0:90504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.253595:0:90504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.253607:0:90504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.253646:0:90504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.253660:0:90504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 18 pid: 5772 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094136.253677:0:90504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90504:1870757024325120:0@lo:104: 00000100:00100000:1.0:1784094136.253741:0:90504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094136.253853:0:90504:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209100c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784094136.253946:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325120 00000100:00100000:2.0:1784094136.253954:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325120 00000100:00100000:2.0:1784094136.253997:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784094136.254006:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:90504:x1870757024325120:12345-0@lo:104: 00010000:00010000:2.0:1784094136.254019:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094136.254130:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094136.254137:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:90504:x1870757024325120:12345-0@lo:104: Request processed in 132us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094136.254145:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00010000:0.0:1784094136.254199:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094136.254205:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.254214:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094136.254217:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.254227:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094136.254234:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094136.254239:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094136.254275:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.254282:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094136.254312:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.254319:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbb31 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb38 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.254334:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094136.254336:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094136.254338:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094136.254345:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094136.254356:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024325248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094136.254386:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094136.254471:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325248 00000100:00100000:3.0:1784094136.254476:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325248 00010000:00010000:3.0:1784094136.254498:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 19 pid: 5772 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094136.254528:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784094136.254536:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024325248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094136.254549:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094136.254554:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 19 pid: 5772 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254565:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 19 pid: 5772 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254580:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254589:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254602:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254610:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254618:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254624:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254630:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094136.254634:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254641:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254654:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.254655:0:90504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214cbb38 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbb31 expref: 19 pid: 5772 timeout: 1447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094136.254663:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094136.254666:0:90504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90504:1870757024325120:0@lo:104: 00010000:00010000:1.0:1784094136.254682:0:90504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.254690:0:90504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094136.254697:0:90504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094136.254701:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024325248:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (314us total) trans 0 rc 0/0 00010000:00010000:1.0:1784094136.254704:0:90504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214cbb3f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094136.254709:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1784094136.254937:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024325248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094136.813786:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094136.840194:0:90553:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7f1e7710 20000000:00000080:0.0:1784094136.840209:0:90553:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101391c00 uarg=0000000000000000 00010000:00010000:0.0:1784094136.840651:0:90553:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094136.840667:0:90553:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094136.840680:0:90553:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094136.840697:0:90553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840712:0:90553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840722:0:90553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840729:0:90553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840737:0:90553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840745:0:90553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840752:0:90553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094136.840756:0:90553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840766:0:90553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840779:0:90553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840787:0:90553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094136.840799:0:90553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214cbb46 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094137.323114:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094137.323136:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024325376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094137.323302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094137.323360:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325376 00000100:00100000:0.0:1784094137.323370:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325376 00000100:00100000:0.0:1784094137.323454:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1784094137.323464:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024325376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094137.323501:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094137.323548:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024325376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094137.323556:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:2.0:1784094137.323646:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094137.323678:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024325376:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784094137.833559:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094137.833565:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094137.833570:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094137.833615:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094137.833627:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094137.833638:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094137.833662:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024325504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094137.833739:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094137.833802:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a9be840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094137.833895:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325504 00000100:00100000:1.0:1784094137.833903:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325504 00000100:00100000:1.0:1784094137.833947:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1784094137.833955:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024325504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094137.833968:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094137.833981:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbb4d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094137.834003:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094137.834013:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094137.834029:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784094137.834135:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024325504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094137.834142:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00010000:00010000:2.0:1784094137.834350:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094137.834401:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024325504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094137.834416:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094137.834450:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094137.834475:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094137.834480:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094137.834487:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094138.857974:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784094139.462684:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:1.0:1784094139.462693:0:7469:0:(genops.c:906:class_export_put()) final put ffff907103950000/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:1.0:1784094139.462728:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff907103950000/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0001 00000020:00000080:1.0:1784094139.462771:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907103951800 for lustre-OST0001 00000001:00100000:1.0:1784094139.466127:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:1.0:1784094139.466135:0:6598:0:(genops.c:906:class_export_put()) final put ffff907102045000/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:1.0:1784094139.466161:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff907102045000/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0000 00000020:00000080:1.0:1784094139.466194:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907102044800 for lustre-OST0000 00000100:00100000:0.0:1784094139.769152:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094139.769192:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094139.769247:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834496 00000100:00100000:3.0:1784094139.769256:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834496 00000100:00100000:3.0:1784094139.769309:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 833 00000100:00100000:3.0:1784094139.769318:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013834496:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094139.769385:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013834496:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 67us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094139.769393:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 833 00000100:00100000:1.0:1784094139.769525:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834624 00000100:00100000:1.0:1784094139.769530:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834624 00000100:00100000:1.0:1784094139.769586:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 887 00000100:00100000:1.0:1784094139.769594:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013834624:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094139.769639:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013834624:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 47us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094139.769651:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 887 00000100:00080000:3.0:1784094139.770012:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094139.884557:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094140.395260:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024325760:0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.395278:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024326016:0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.395338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094140.395346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094140.395404:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784094140.395411:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024325888:0@lo:400:kworker.0 00000100:00100000:1.0:1784094140.395448:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326016 00000100:00100000:1.0:1784094140.395457:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326016 00000100:00100000:3.0:1784094140.395462:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094140.395490:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024326400:0@lo:400:kworker.0 00000100:00100000:1.0:1784094140.395515:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325888 00000100:00100000:3.0:1784094140.395518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094140.395521:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325888 00000100:00100000:1.0:1784094140.395557:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1784094140.395567:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326400 00000100:00100000:1.0:1784094140.395569:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024326016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.395572:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326400 00000100:00100000:3.0:1784094140.395612:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1784094140.395622:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024326400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094140.395641:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024326016:12345-0@lo:400:kworker.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094140.395649:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1784094140.395670:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1784094140.395678:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024326400:12345-0@lo:400:kworker.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094140.395679:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024325888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.395693:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1784094140.395726:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024325888:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094140.395733:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325760 00000100:00100000:1.0:1784094140.395734:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1784094140.395740:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325760 00000100:00080000:1.0:1784094140.395763:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094140.395769:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094140.395771:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1784094140.395779:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024325760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094140.395812:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024325888:0@lo:400:kworker.0 00000100:00100000:0.0:1784094140.395953:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024325632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094140.396014:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024325760:12345-0@lo:400:kworker.0 Request processed in 234us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094140.396021:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:1.0:1784094140.397226:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024326400:0@lo:400:kworker.0 00000100:00100000:1.0:1784094140.397239:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024326016:0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.398239:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024325760:0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.398256:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024326272:0@lo:400:kworker.0 00000100:00100000:3.0:1784094140.398295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094140.398400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094140.398406:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326272 00000100:00100000:1.0:1784094140.398413:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326272 00000100:00100000:0.0:1784094140.398453:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024326144:0@lo:400:kworker.0 00000100:00100000:2.0:1784094140.398457:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024325632 00000100:00100000:2.0:1784094140.398463:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024325632 00000100:00100000:0.0:1784094140.398481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094140.398507:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1784094140.398516:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024325632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094140.398529:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326144 00000100:00100000:0.0:1784094140.398534:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326144 00002000:00000024:2.0:1784094140.398549:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094140.398574:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1784094140.398584:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024326144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094140.398597:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024325632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094140.398605:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1784094140.398629:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024326144:12345-0@lo:400:kworker.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094140.398643:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024325632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094140.398657:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1784094140.398659:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024326144:0@lo:400:kworker.0 00000100:00080000:0.0:1784094140.398693:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094140.398757:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094140.398796:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1784094140.398804:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024326272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094140.398863:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024326272:12345-0@lo:400:kworker.0 Request processed in 61us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094140.398871:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:3.0:1784094140.398896:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024326272:0@lo:400:kworker.0 00010000:00010000:1.0:1784094140.905686:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094141.930663:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094142.246221:0:90846:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffaa8360b0 20000000:00000080:2.0:1784094142.246236:0:90846:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df0c00 uarg=0000000000000000 00010000:00010000:2.0:1784094142.246880:0:90846:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094142.246896:0:90846:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094142.246909:0:90846:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094142.246926:0:90846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094142.246943:0:90846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094142.246953:0:90846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094142.246990:0:90846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094142.247005:0:90846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 18 pid: 5771 timeout: 1453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094142.247020:0:90846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90846:1870757024326528:0@lo:104: 00000100:00100000:2.0:1784094142.247076:0:90846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094142.247175:0:90846:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2faa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784094142.247220:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326528 00000100:00100000:1.0:1784094142.247227:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326528 00000100:00100000:1.0:1784094142.247300:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784094142.247310:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:90846:x1870757024326528:12345-0@lo:104: 00010000:00010000:1.0:1784094142.247681:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094142.247848:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094142.247856:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:90846:x1870757024326528:12345-0@lo:104: Request processed in 547us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094142.247865:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00010000:0.0:1784094142.247914:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094142.247921:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.247931:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094142.247936:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.247946:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094142.247956:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094142.247963:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094142.247992:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.247999:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094142.248018:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248026:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cbb4d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb54 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248050:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094142.248053:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094142.248055:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094142.248073:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024326656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094142.248103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094142.248142:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326656 00000100:00100000:0.0:1784094142.248146:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326656 00010000:00010000:0.0:1784094142.248165:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 19 pid: 5771 timeout: 1453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094142.248185:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784094142.248191:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024326656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094142.248201:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094142.248207:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 19 pid: 5771 timeout: 1453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248234:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 19 pid: 5771 timeout: 1453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248249:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248258:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248270:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248277:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248284:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248291:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248296:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094142.248300:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248308:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248316:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.248325:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094142.248351:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024326656:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094142.248358:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1784094142.248389:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024326656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094142.248844:0:90846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12600/0x9ce98053214cbb54 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbb4d expref: 18 pid: 5771 timeout: 1453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094142.248856:0:90846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90846:1870757024326528:0@lo:104: 00010000:00010000:3.0:1784094142.248870:0:90846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.248879:0:90846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.248887:0:90846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.248896:0:90846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cbb5b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094142.441848:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024326784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094142.441915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094142.442008:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326784 00000100:00100000:1.0:1784094142.442016:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326784 00000100:00100000:1.0:1784094142.442072:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1784094142.442081:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024326784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094142.442115:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094142.442170:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024326784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094142.442178:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1784094142.442231:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024326784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094142.442322:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1784094142.819901:0:90894:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc08e87e90 20000000:00000080:3.0:1784094142.819918:0:90894:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101bbc400 uarg=0000000000000000 00010000:00010000:3.0:1784094142.820214:0:90894:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094142.820228:0:90894:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094142.820241:0:90894:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094142.820261:0:90894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820276:0:90894:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820286:0:90894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820293:0:90894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820301:0:90894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820307:0:90894:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820373:0:90894:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094142.820582:0:90894:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820599:0:90894:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820629:0:90894:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820637:0:90894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094142.820643:0:90894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214cbb62 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094142.953522:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094143.977785:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094144.233509:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094144.233515:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094144.233519:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094144.233560:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.233569:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.233577:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.233596:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024326912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094144.235127:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094144.235185:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093af180 going to sleep for 11 seconds 00000100:00100000:1.0:1784094144.235242:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024326912 00000100:00100000:1.0:1784094144.235251:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024326912 00000100:00100000:1.0:1784094144.235302:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1784094144.235312:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024326912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094144.235326:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094144.235342:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbb69 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.235366:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.235378:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.235387:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784094144.235486:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024326912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094144.235493:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1784094144.235557:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024326912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094144.235574:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.235583:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094144.235605:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094144.235610:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.235616:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.346825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094144.346921:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834752 00000100:00100000:1.0:1784094144.346930:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834752 00000100:00100000:1.0:1784094144.347001:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 959 00000100:00100000:1.0:1784094144.347011:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:54710:x1870757013834752:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094144.347033:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094144.347057:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbb77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c5b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.347116:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbb7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.347130:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.347142:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094144.347348:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784094144.347352:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000100:00080000:0.0:1784094144.347440:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1784094144.347599:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbb7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.347623:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbb77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c5b expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.347639:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbb7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c5b expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.347653:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094144.347656:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094144.347659:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784094144.348584:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:54710:x1870757013834752:12345-192.168.204.57@tcp:101:rm.0 Request processed in 1572us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094144.348592:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 959 00000100:00100000:3.0:1784094144.352555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094144.352636:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013834880 00000100:00100000:1.0:1784094144.352645:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013834880 00000100:00100000:1.0:1784094144.352723:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 960 00000100:00100000:1.0:1784094144.352734:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:54710:x1870757013834880:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094144.352770:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094144.352791:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c62 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.352850:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.352864:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.352875:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.352889:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.352897:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.352908:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353150:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353159:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353167:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353173:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094144.353178:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353185:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353197:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094144.353200:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094144.353204:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353210:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbb8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353222:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353228:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353234:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353239:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094144.353241:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353246:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353252:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12a00) 00010000:00010000:1.0:1784094144.353254:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094144.353257:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353261:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbb93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353289:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c62 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353297:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094144.353300:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094144.353303:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c62 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.353310:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784094144.353371:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:54710:x1870757013834880:12345-192.168.204.57@tcp:101:rm.0 Request processed in 640us (824us total) trans 0 rc 301/301 00000100:00100000:1.0:1784094144.353381:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 960 00000100:00100000:0.0:1784094144.373627:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094144.373683:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094144.373856:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013835008 00000100:00100000:1.0:1784094144.373857:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013835264 00000100:00100000:2.0:1784094144.373866:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013835008 00000100:00100000:1.0:1784094144.373871:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013835264 00000100:00100000:2.0:1784094144.373954:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 961 00000100:00100000:1.0:1784094144.373964:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 962 00000100:00100000:1.0:1784094144.373984:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:54714:x1870757013835264:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:1.0:1784094144.374043:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094144.374072:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbb7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c5b expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.374089:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094144.374099:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094144.374139:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013835008:12345-192.168.204.57@tcp:41:mkdir.0 00000004:00000024:2.0:1784094144.374174:0:8381:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784094144.374346:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013835008:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 380us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094144.374356:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 961 00010000:00010000:1.0:1784094144.376197:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.376223:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.376237:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.376249:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.376256:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.376262:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094144.377336:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00010000:00010000:1.0:1784094144.377353:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.377362:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.377370:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.377377:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094144.377382:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.377390:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.377405:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094144.377408:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094144.377414:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.377451:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbb9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094144.377474:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000020e4637 reply state 0000000095a6459e transno 4294967667 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094144.377483:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094144.377578:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:54714:x1870757013835264:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 3603us (3891us total) trans 4294967667 rc 0/0 00000100:00100000:1.0:1784094144.377587:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 962 00010000:00010000:2.0:1784094144.379049:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.379061:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.379065:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.379068:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094144.379071:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.379076:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.379086:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12500) 00010000:00010000:2.0:1784094144.379089:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094144.379091:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.379095:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbba1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094144.401164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094144.401406:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013835392 00000100:00100000:1.0:1784094144.401416:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013835392 00000100:00100000:1.0:1784094144.401526:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 963 00000100:00100000:1.0:1784094144.401537:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:54718:x1870757013835392:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:1.0:1784094144.401571:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094144.401595:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c69 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.402185:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbbaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.402201:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbbaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.402279:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbbaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094144.402343:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094144.402348:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094144.402376:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbbaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.402400:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cbba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c69 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.402417:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbbaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c69 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.402504:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12a00) 00010000:00010000:0.0:1784094144.402508:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094144.402511:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784094144.402581:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:54718:x1870757013835392:12345-192.168.204.57@tcp:101:chown.0 Request processed in 1045us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094144.402589:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 963 00000100:00100000:0.0:1784094144.405154:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094144.405281:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013835520 00000100:00100000:1.0:1784094144.405290:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013835520 00000100:00100000:1.0:1784094144.405347:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 964 00000100:00100000:1.0:1784094144.405358:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:54718:x1870757013835520:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:1.0:1784094144.405379:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094144.405397:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c70 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405473:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405486:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405493:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405503:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405507:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405515:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405592:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbbcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405648:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbbcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405654:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbbcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094144.405683:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:1.0:1784094144.405685:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094144.405700:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbbcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405708:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405712:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405717:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405720:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094144.405723:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405727:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405739:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094144.405742:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094144.405755:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405763:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbbbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405776:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405783:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405789:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405794:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094144.405797:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405803:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405811:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12900) 00010000:00010000:1.0:1784094144.405814:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094144.405816:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405821:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbbc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405846:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c70 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405855:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbbcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c70 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.405860:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094144.405861:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094144.405863:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094144.405913:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:54718:x1870757013835520:12345-192.168.204.57@tcp:101:chown.0 Request processed in 559us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094144.405917:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 964 00000100:00100000:1.0:1784094144.407664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094144.407843:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013835776 00000100:00100000:0.0:1784094144.407851:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013835776 00000100:00100000:0.0:1784094144.407937:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 965 00000100:00100000:0.0:1784094144.407947:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:54718:x1870757013835776:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:0.0:1784094144.407998:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094144.408018:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cbbcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c70 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.408033:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12000) 00010000:00010000:0.0:1784094144.408042:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094144.408062:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.408071:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.408080:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094144.408298:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e2fba98b reply state 0000000012d32fba transno 4294967668 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.408307:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094144.408319:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000100:00100000:0.0:1784094144.408399:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:54718:x1870757013835776:12345-192.168.204.57@tcp:36:chown.0 Request processed in 444us (791us total) trans 4294967668 rc 0/0 00000100:00100000:0.0:1784094144.408406:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 965 00010000:00010000:1.0:1784094144.410559:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.410573:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.410581:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.410588:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094144.410593:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.410613:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.410632:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6b800) 00010000:00010000:1.0:1784094144.410635:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094144.410639:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.410645:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cbbd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094144.787952:0:91092:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdcb3acaa0 20000000:00000080:1.0:1784094144.787968:0:91092:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019dd800 uarg=0000000000000000 00010000:00010000:1.0:1784094144.788168:0:91092:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094144.788197:0:91092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094144.788201:0:91092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094144.788211:0:91092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbbaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c69 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.788231:0:91092:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094144.788244:0:91092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094144.788256:0:91092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.788270:0:91092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.788279:0:91092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.788313:0:91092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.788330:0:91092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 18 pid: 5771 timeout: 1455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094144.788346:0:91092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91092:1870757024327040:0@lo:104: 00000100:00100000:1.0:1784094144.788400:0:91092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094144.788529:0:91092:0:(client.c:2702:ptlrpc_set_wait()) set ffff907202ae60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094144.788574:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327040 00000100:00100000:3.0:1784094144.788580:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327040 00000100:00100000:3.0:1784094144.788621:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1784094144.788630:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:91092:x1870757024327040:12345-0@lo:104: 00010000:00010000:3.0:1784094144.788642:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094144.788735:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094144.788750:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:91092:x1870757024327040:12345-0@lo:104: Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094144.788758:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00010000:2.0:1784094144.788777:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094144.788786:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.788796:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094144.788800:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.788810:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094144.788819:0:91092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91092:1870757024327040:0@lo:104: 10000000:00010000:2.0:1784094144.788820:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094144.788832:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094144.788841:0:91092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.788864:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.788872:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784094144.788923:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024327168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094144.788949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094144.788995:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327168 00000100:00100000:0.0:1784094144.789000:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327168 00010000:00010000:0.0:1784094144.789021:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 19 pid: 5771 timeout: 1455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094144.789065:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.789066:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00010000:00010000:2.0:1784094144.789077:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cbb69 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbb70 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.789078:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024327168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094144.789088:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094144.789094:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 19 pid: 5771 timeout: 1455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789105:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 19 pid: 5771 timeout: 1455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789116:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12e00/0x9ce98053214cbb70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbb69 expref: 19 pid: 5771 timeout: 1455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789128:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789136:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789148:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789155:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789162:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789168:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789184:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094144.789189:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789196:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789208:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094144.789216:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094144.789231:0:91092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094144.789241:0:91092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.789254:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024327168:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (302us total) trans 0 rc 0/0 00010000:00010000:1.0:1784094144.789262:0:91092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12200/0x9ce98053214cbbd9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094144.789272:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:2.0:1784094144.789288:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094144.789293:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094144.789296:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094144.789688:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024327168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094144.888068:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094144.888149:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013835904 00000100:00100000:3.0:1784094144.888160:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013835904 00000100:00100000:2.0:1784094144.888516:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 836 00000100:00100000:2.0:1784094144.888530:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013835904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094144.888596:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013835904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094144.888604:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 836 00010000:00010000:0.0:1784094145.001526:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094145.027518:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000020:00000080:1.0:1784094145.143679:0:91143:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd15961580 20000000:00000080:1.0:1784094145.143694:0:91143:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df4000 uarg=0000000000000000 00010000:00010000:1.0:1784094145.144106:0:91143:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094145.144120:0:91143:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094145.144132:0:91143:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094145.144149:0:91143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144165:0:91143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144176:0:91143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144184:0:91143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144191:0:91143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144198:0:91143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144205:0:91143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094145.144209:0:91143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144217:0:91143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144229:0:91143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144237:0:91143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094145.144244:0:91143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13800/0x9ce98053214cbbe0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094145.513737:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024327296:0@lo:400:kworker.0 00000100:00100000:0.0:1784094145.513811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094145.513851:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024327680:0@lo:400:kworker.0 00000100:00100000:0.0:1784094145.513873:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024327808:0@lo:400:kworker.0 00000100:00100000:3.0:1784094145.513891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094145.513910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094145.513933:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094145.513936:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024327424:0@lo:400:kworker.0 00000100:00100000:3.0:1784094145.513943:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024327552:0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.513983:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094145.513989:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327296 00000100:00100000:3.0:1784094145.513995:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327680 00000100:00100000:3.0:1784094145.514003:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327680 00000100:00100000:0.0:1784094145.514005:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327296 00000100:00100000:2.0:1784094145.514010:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024327936:0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.514038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094145.514058:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1784094145.514064:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327936 00000100:00100000:3.0:1784094145.514070:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327936 00000100:00100000:0.0:1784094145.514070:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024327296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094145.514108:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1784094145.514112:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327808 00000100:00100000:3.0:1784094145.514117:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024327680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.514117:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327808 00000100:00100000:0.0:1784094145.514125:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024327296:12345-0@lo:400:kworker.0 Request processed in 58us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094145.514133:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1784094145.514147:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327424 00000100:00100000:2.0:1784094145.514150:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327424 00000100:00100000:2.0:1784094145.514166:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1784094145.514173:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024327808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094145.514183:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1784094145.514190:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024327424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.514207:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024327808:12345-0@lo:400:kworker.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094145.514213:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1784094145.514216:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024327424:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094145.514221:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1784094145.514232:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00080000:0.0:1784094145.514235:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094145.514238:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024327936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094145.514239:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094145.514251:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094145.514269:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024327936:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094145.514274:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1784094145.514283:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024327808:0@lo:400:kworker.0 00000100:00100000:0.0:1784094145.514293:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024327296:0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.514296:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024328064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094145.515409:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024327680:12345-0@lo:400:kworker.0 Request processed in 1290us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094145.515436:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1784094145.516154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094145.516359:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024327424:0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.516370:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024327936:0@lo:400:kworker.0 00000100:00100000:2.0:1784094145.516394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094145.516439:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024327680:0@lo:400:kworker.0 00000100:00100000:3.0:1784094145.516463:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024327552 00000100:00100000:3.0:1784094145.516471:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024327552 00000100:00100000:3.0:1784094145.516524:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1784094145.516535:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024327552:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784094145.516572:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094145.516584:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024327552:12345-0@lo:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094145.516592:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1784094145.516637:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024327552:0@lo:400:kworker.0 00000100:00100000:0.0:1784094145.518012:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328064 00000100:00100000:0.0:1784094145.518020:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328064 00000100:00100000:0.0:1784094145.518077:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1784094145.518087:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024328064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094145.518119:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094145.518182:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024328064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094145.518189:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1784094145.518228:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024328064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784094146.029521:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094146.646560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094146.646633:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836032 00000100:00100000:1.0:1784094146.646643:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836032 00000100:00100000:1.0:1784094146.646745:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 15 00000100:00080000:2.0:1784094146.646746:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094146.646758:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:5558:x1870757013836032:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094146.646773:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094146.646777:0:11171:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbbaf) 00010000:00010000:1.0:1784094146.646779:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094146.646837:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:5558:x1870757013836032:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 83us (284us total) trans 0 rc 116/116 00000100:00100000:1.0:1784094146.646845:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 15 10000000:01000000:3.0:1784094146.729664:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094146.729670:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094146.729675:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094146.729737:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094146.729748:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094146.729759:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094146.729785:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024328192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094146.729852:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094146.729907:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784094146.730060:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328192 00000100:00100000:2.0:1784094146.730080:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328192 00000100:00100000:2.0:1784094146.730130:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1784094146.730141:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024328192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094146.730154:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094146.730167:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbbe7 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094146.730411:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094146.730442:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094146.730457:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784094146.730655:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024328192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 516us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094146.730662:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1784094146.730841:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024328192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094146.730855:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094146.730864:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094146.730883:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094146.730888:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094146.730895:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094147.052785:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094147.495061:0:91387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe65d752a0 20000000:00000080:1.0:1784094147.495075:0:91387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019de400 uarg=0000000000000000 00010000:00010000:1.0:1784094147.495279:0:91387:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094147.495292:0:91387:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094147.495302:0:91387:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094147.495316:0:91387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094147.495328:0:91387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094147.495334:0:91387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094147.495361:0:91387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094147.495371:0:91387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 18 pid: 5772 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094147.495382:0:91387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91387:1870757024328320:0@lo:104: 00000100:00100000:1.0:1784094147.495452:0:91387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094147.495539:0:91387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094147.495575:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328320 00000100:00100000:3.0:1784094147.495580:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328320 00000100:00100000:3.0:1784094147.495614:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784094147.495621:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:91387:x1870757024328320:12345-0@lo:104: 00010000:00010000:3.0:1784094147.495631:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094147.495727:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094147.495735:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:91387:x1870757024328320:12345-0@lo:104: Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094147.495742:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00010000:0.0:1784094147.495752:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094147.495759:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.495766:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094147.495770:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.495778:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094147.495789:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094147.495794:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1784094147.495802:0:91387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91387:1870757024328320:0@lo:104: 00010000:00010000:1.0:1784094147.495816:0:91387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.495882:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.495889:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094147.496002:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496010:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68000/0x9ce98053214cbbe7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbbee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094147.496022:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024328448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094147.496024:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094147.496025:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094147.496027:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094147.496051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094147.496143:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328448 00000100:00100000:0.0:1784094147.496147:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328448 00010000:00010000:0.0:1784094147.496167:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 19 pid: 5772 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094147.496381:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784094147.496389:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024328448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094147.496399:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094147.496404:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 19 pid: 5772 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496415:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 19 pid: 5772 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496456:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214cbbee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbbe7 expref: 19 pid: 5772 timeout: 1458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496469:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496477:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496490:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496497:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496504:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496510:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496516:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094147.496520:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496527:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496539:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094147.496554:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094147.496580:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024328448:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094147.496587:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1784094147.497753:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024328448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094147.497791:0:91387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094147.497810:0:91387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094147.497817:0:91387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12e00/0x9ce98053214cbbf5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094147.561674:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094147.562838:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024328576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094147.562906:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094147.563099:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328576 00000100:00100000:1.0:1784094147.563107:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328576 00000100:00100000:1.0:1784094147.563173:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1784094147.563183:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024328576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094147.563227:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094147.563277:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024328576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094147.563284:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1784094147.563326:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024328576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094147.563728:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094148.074608:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094148.585490:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094148.585498:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094148.585503:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094148.585544:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094148.585555:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094148.585568:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094148.585593:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024328704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094148.585655:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094148.585719:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093afe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784094148.585727:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328704 00000100:00100000:0.0:1784094148.585735:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328704 00000100:00100000:0.0:1784094148.585797:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1784094148.585807:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024328704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094148.585820:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094148.585835:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbbfc expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094148.585857:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094148.585869:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094148.585878:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094148.585929:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024328704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094148.585937:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1784094148.587418:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024328704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094148.587457:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094148.587467:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094148.587487:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094148.587492:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094148.587500:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094149.049123:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094149.049171:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836160 00000100:00100000:0.0:1784094149.049181:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836160 00000100:00080000:1.0:1784094149.049230:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094149.049263:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 966 00000100:00100000:0.0:1784094149.049277:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:54895:x1870757013836160:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094149.049303:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094149.049801:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbc0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c77 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094149.049861:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cbc11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094149.049875:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cbc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094149.049888:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cbc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094149.050283:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094149.050288:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094149.050379:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cbc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094149.050406:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbc0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c77 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094149.050437:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cbc11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c77 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094149.050448:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094149.050451:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094149.050455:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094149.050510:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:54895:x1870757013836160:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 1237us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094149.050518:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 966 00000100:00100000:2.0:1784094149.052739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094149.052823:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836288 00000100:00100000:1.0:1784094149.052833:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836288 00000100:00100000:1.0:1784094149.052921:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 967 00000100:00100000:1.0:1784094149.052933:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:54895:x1870757013836288:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094149.052949:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094149.052973:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbc18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c7e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053023:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053040:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053050:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053064:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053072:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053085:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053465:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbc2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053475:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbc2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053484:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbc2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094149.053589:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1784094149.053594:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094149.053706:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbc2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053721:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053730:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053737:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053743:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094149.053747:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053754:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053765:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:1.0:1784094149.053769:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094149.053773:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053780:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbc1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053789:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053795:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053801:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053806:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094149.053810:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053816:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053824:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12300) 00010000:00010000:1.0:1784094149.053826:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094149.053829:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053836:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbc26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053863:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbc18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c7e expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053876:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbc2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c7e expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.053883:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094149.053885:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094149.053888:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784094149.053944:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:54895:x1870757013836288:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 1013us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094149.053952:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 967 00000100:00100000:0.0:1784094149.055799:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094149.055887:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836544 00000100:00100000:2.0:1784094149.055893:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836544 00000100:00100000:2.0:1784094149.055955:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 968 00000100:00100000:2.0:1784094149.055965:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:54895:x1870757013836544:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094149.055999:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094149.056016:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbc2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c7e expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.056029:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12a00) 00010000:00010000:2.0:1784094149.056036:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094149.056055:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.056064:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.056073:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094149.080541:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000007abaf5ea reply state 00000000447bfab4 transno 4294967669 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094149.080566:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094149.080722:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000001:00080000:0.0:1784094149.080833:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967669 is committed 00010000:00080000:2.0:1784094149.080877:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094149.080896:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:54895:x1870757013836544:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 24929us (25095us total) trans 4294967669 rc 0/0 00000100:00100000:2.0:1784094149.080905:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 968 00010000:00010000:2.0:1784094149.080938:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.080947:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.080954:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.080961:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094149.080965:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.080973:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.080988:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784094149.080991:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094149.080995:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.081002:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cbc34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.097721:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094149.627530:0:91584:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3c2f1ad0 20000000:00000080:1.0:1784094149.627545:0:91584:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df5c00 uarg=0000000000000000 00010000:00010000:1.0:1784094149.628303:0:91584:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094149.628335:0:91584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:1.0:1784094149.628340:0:91584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094149.628350:0:91584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cbc11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c77 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.628373:0:91584:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094149.628389:0:91584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094149.628403:0:91584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.628741:0:91584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.628757:0:91584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.628794:0:91584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.628808:0:91584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 18 pid: 5770 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094149.628822:0:91584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91584:1870757024328832:0@lo:104: 00000100:00100000:1.0:1784094149.628877:0:91584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094149.628968:0:91584:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af5180 going to sleep for 11 seconds 00000100:00100000:2.0:1784094149.629152:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328832 00000100:00100000:2.0:1784094149.629160:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328832 00000100:00100000:2.0:1784094149.629207:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784094149.629216:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:91584:x1870757024328832:12345-0@lo:104: 00010000:00010000:2.0:1784094149.629228:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629315:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094149.629321:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:91584:x1870757024328832:12345-0@lo:104: Request processed in 107us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094149.629329:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00010000:2.0:1784094149.629349:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094149.629354:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629362:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094149.629366:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629375:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094149.629383:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094149.629388:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094149.629438:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629446:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094149.629467:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629474:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cbbfc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbc03 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629486:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094149.629488:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094149.629490:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094149.629506:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024328960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094149.629534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094149.629563:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024328960 00000100:00100000:2.0:1784094149.629566:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024328960 00010000:00010000:2.0:1784094149.629582:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 19 pid: 5770 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094149.629604:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784094149.629610:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024328960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094149.629631:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094149.629636:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 19 pid: 5770 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629657:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 19 pid: 5770 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629670:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629678:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629696:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629703:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629710:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629716:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629722:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094149.629725:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629733:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629742:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094149.629751:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094149.629779:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024328960:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094149.629787:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1784094149.629821:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024328960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094149.630015:0:91584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214cbc03 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbbfc expref: 18 pid: 5770 timeout: 1460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094149.630025:0:91584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91584:1870757024328832:0@lo:104: 00010000:00010000:1.0:1784094149.630038:0:91584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.630052:0:91584:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.630059:0:91584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094149.630065:0:91584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214cbc3b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094150.009678:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094150.009725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094150.009807:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836672 00000100:00100000:2.0:1784094150.009816:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836672 00000100:00100000:2.0:1784094150.009981:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 840 00000100:00100000:2.0:1784094150.009993:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013836672:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094150.010063:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013836672:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094150.010071:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 840 00000100:00100000:0.0:1784094150.011146:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836800 00000100:00100000:0.0:1784094150.011153:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836800 00000100:00100000:0.0:1784094150.011196:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 894 00000100:00100000:0.0:1784094150.011215:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013836800:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094150.011254:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013836800:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094150.011261:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 894 00010000:00010000:1.0:1784094150.121796:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094150.633712:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024329088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094150.633729:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024329216:0@lo:400:kworker.0 00000100:00100000:2.0:1784094150.633784:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024329344:0@lo:400:kworker.0 00000100:00100000:0.0:1784094150.633876:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024329472:0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.635719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094150.635778:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024329728:0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.635813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094150.635850:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094150.635857:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024329600:0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.635881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094150.636748:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329216 00000100:00100000:1.0:1784094150.636756:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329216 00000100:00100000:1.0:1784094150.636804:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1784094150.636814:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024329216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.636871:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024329216:12345-0@lo:400:kworker.0 Request processed in 59us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094150.636879:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1784094150.637350:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329728 00000100:00100000:1.0:1784094150.637354:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329728 00000100:00100000:1.0:1784094150.637391:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1784094150.637399:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024329728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.637450:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024329728:12345-0@lo:400:kworker.0 Request processed in 53us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094150.637457:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1784094150.637477:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329600 00000100:00100000:1.0:1784094150.637480:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329600 00000100:00100000:1.0:1784094150.637508:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1784094150.637515:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024329600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.637545:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024329600:12345-0@lo:400:kworker.0 Request processed in 31us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094150.637552:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00080000:1.0:1784094150.637569:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094150.637573:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094150.637620:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024329600:0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.637645:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024329728:0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.637654:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024329216:0@lo:400:kworker.0 00000100:00100000:3.0:1784094150.640243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094150.640638:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094150.640686:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024329856:0@lo:400:kworker.0 00000100:00100000:2.0:1784094150.640724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094150.640779:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329344 00000100:00100000:2.0:1784094150.640785:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329344 00000100:00100000:2.0:1784094150.640831:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1784094150.640840:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024329344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094150.640896:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024329344:12345-0@lo:400:kworker.0 Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094150.640903:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1784094150.640925:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329856 00000100:00100000:2.0:1784094150.640928:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329856 00000100:00100000:2.0:1784094150.640956:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1784094150.640962:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024329856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094150.641009:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024329344:0@lo:400:kworker.0 00000100:00100000:2.0:1784094150.641690:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024329856:12345-0@lo:400:kworker.0 Request processed in 726us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094150.641698:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784094150.642397:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094150.642461:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329472 00000100:00100000:2.0:1784094150.642468:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329472 00000100:00080000:0.0:1784094150.642485:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094150.642492:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094150.642509:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1784094150.642519:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024329856:0@lo:400:kworker.0 00000100:00100000:2.0:1784094150.642521:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024329472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094150.642576:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024329472:12345-0@lo:400:kworker.0 Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094150.642583:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1784094150.642728:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024329472:0@lo:400:kworker.0 00000100:00100000:1.0:1784094150.644195:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329088 00000100:00100000:1.0:1784094150.644203:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329088 00000100:00100000:1.0:1784094150.644365:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1784094150.644376:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024329088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094150.644406:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094150.644491:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024329088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (4251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094150.644502:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1784094150.644549:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024329088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784094151.145558:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784094151.209970:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094151.209977:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094151.209982:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094151.210024:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210035:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210047:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094151.210074:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024329984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094151.210175:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094151.210230:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720cbeb780 going to sleep for 11 seconds 00000100:00100000:2.0:1784094151.210250:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024329984 00000100:00100000:2.0:1784094151.210256:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024329984 00000100:00100000:2.0:1784094151.210306:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1784094151.210315:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024329984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094151.210329:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094151.210342:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbc42 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210366:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210381:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210391:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094151.210453:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024329984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094151.210461:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1784094151.210517:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024329984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094151.210531:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210540:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094151.210558:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094151.210563:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.210571:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094151.309049:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094151.309086:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013836928 00000100:00100000:3.0:1784094151.309095:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013836928 00000100:00080000:0.0:1784094151.309156:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094151.309158:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 969 00000100:00100000:3.0:1784094151.309172:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:54971:x1870757013836928:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094151.309192:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094151.309214:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cbc50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c85 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.309279:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.309293:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.309304:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.309320:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.309327:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.309334:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310239:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbc65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310250:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310258:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094151.310338:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1784094151.310343:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094151.310422:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310455:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310463:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310470:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310476:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094151.310480:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310488:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310556:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784094151.310559:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094151.310563:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310570:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbc57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310585:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310591:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310597:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310602:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094151.310605:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310611:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310629:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fce300) 00010000:00010000:3.0:1784094151.310632:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094151.310635:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310640:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbc5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310671:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cbc50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c85 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310686:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c85 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.310771:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784094151.310774:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094151.310776:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784094151.310901:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:54971:x1870757013836928:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1731us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094151.310908:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 969 00000100:00100000:2.0:1784094151.313306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094151.313339:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013837184 00000100:00100000:2.0:1784094151.313348:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013837184 00000100:00100000:2.0:1784094151.313401:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 970 00000100:00100000:2.0:1784094151.313410:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:54971:x1870757013837184:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784094151.313477:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094151.313496:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbc6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c8c expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.313813:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.313827:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.313839:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.313853:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.313861:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.313868:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094151.314711:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:2.0:1784094151.314985:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbc81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.314996:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbc81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315004:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbc81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315039:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315050:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315056:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315063:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094151.315067:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315075:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315087:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fce900) 00010000:00010000:2.0:1784094151.315090:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094151.315095:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315102:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbc73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094151.315114:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a6dca8e5 reply state 00000000789fcf87 transno 4294967670 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094151.315123:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094151.315150:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbc6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c8c expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315165:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbc81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c8c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.315193:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784094151.315196:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094151.315198:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094151.315270:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:54971:x1870757013837184:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1860us (1969us total) trans 4294967670 rc 0/0 00000100:00100000:2.0:1784094151.315278:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 970 00010000:00010000:1.0:1784094151.318381:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094151.318383:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:1.0:1784094151.318396:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.318405:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.318412:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094151.318417:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094151.318419:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013837440 00000100:00100000:2.0:1784094151.318450:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013837440 00010000:00010000:1.0:1784094151.318466:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.318483:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff90721a781d00) 00010000:00010000:1.0:1784094151.318487:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094151.318492:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.318499:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cbc7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094151.318503:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 971 00000100:00100000:2.0:1784094151.318519:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:54971:x1870757013837440:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:2.0:1784094151.318568:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094151.318586:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbc81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c8c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.318600:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784094151.318607:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094151.318655:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.318668:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.318678:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094151.318809:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000003511d9b7 reply state 0000000090c0def5 transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094151.318820:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094151.318920:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:54971:x1870757013837440:12345-192.168.204.57@tcp:36:touch.0 Request processed in 404us (543us total) trans 4294967671 rc 0/0 00000100:00100000:2.0:1784094151.318928:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 971 00010000:00010000:3.0:1784094151.320847:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.320861:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.320869:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.320877:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094151.320881:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.320889:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.320905:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff90721a781500) 00010000:00010000:3.0:1784094151.320909:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094151.320913:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.320919:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbc8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094151.322056:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094151.322189:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013837568 00000100:00100000:0.0:1784094151.322198:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013837568 00000100:00100000:0.0:1784094151.322369:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 972 00000100:00100000:0.0:1784094151.322380:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:54971:x1870757013837568:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094151.322400:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094151.322596:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbc96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c93 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.323096:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbc96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c93 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.323113:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbc96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c93 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094151.323137:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:1.0:1784094151.323141:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094151.323144:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77800, rc 0) 00000100:00100000:1.0:1784094151.323226:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:54971:x1870757013837568:12345-192.168.204.57@tcp:101:touch.0 Request processed in 848us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094151.323234:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 972 00000100:00100000:0.0:1784094151.324911:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094151.325695:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013837696 00000100:00100000:3.0:1784094151.325704:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013837696 00000100:00100000:3.0:1784094151.325739:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 492 00000100:00100000:3.0:1784094151.325747:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2351:x1870757013837696:12345-192.168.204.57@tcp:8:touch.0 00010000:00080000:3.0:1784094151.325776:0:53396:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 1312 last 0 00000020:00000080:3.0:1784094151.325804:0:53396:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214cbc9d 00002000:00100000:3.0:1784094151.325817:0:53396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff90723dc11000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 10223616 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784094151.325850:0:53396:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784094151.326061:0:53396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784094151.326085:0:53396:0:(import.c:65:import_set_state_nolock()) ffff90723dc14000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784094151.326132:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013837696:12345-192.168.204.57@tcp:8:touch.0 Request processed in 385us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094151.326137:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 492 00000100:00100000:3.0:1784094151.327669:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094151.328793:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013837824 00000100:00100000:1.0:1784094151.328804:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013837824 00000100:00080000:2.0:1784094151.328884:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094151.328890:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 493 00000100:00100000:1.0:1784094151.328900:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:0:x1870757013837824:12345-192.168.204.57@tcp:2:touch.0 00000001:00080000:3.0:1784094151.354676:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00000001:00100000:3.0:1784094151.354695:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000100:00100000:2.0:1784094151.354806:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:0:x1870757013837824:12345-192.168.204.57@tcp:2:touch.0 Request processed in 25901us (27134us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1784094151.354817:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 493 00000100:00100000:2.0:1784094151.356878:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094151.356962:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013838080 00000100:00100000:0.0:1784094151.356970:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013838080 00000100:00100000:0.0:1784094151.357016:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 100 00000100:00100000:0.0:1784094151.357024:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:54971:x1870757013838080:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:0.0:1784094151.357327:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:54971:x1870757013838080:12345-192.168.204.57@tcp:35:touch.0 Request processed in 302us (452us total) trans 4294967672 rc 0/0 00000100:00100000:0.0:1784094151.357333:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 100 00000100:00100000:0.0:1784094151.408955:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094151.409044:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013838208 00000100:00100000:2.0:1784094151.409053:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013838208 00000100:00100000:2.0:1784094151.409144:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 973 00000100:00100000:2.0:1784094151.409154:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:54975:x1870757013838208:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094151.409178:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094151.409196:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbca4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5c9a expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409255:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409269:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409280:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409295:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409308:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409325:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409412:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409464:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409472:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094151.409502:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00000004:00200000:2.0:1784094151.409506:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094151.409537:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409549:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409556:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409562:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409568:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409577:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094151.409580:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409587:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409598:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fce900) 00010000:00010000:2.0:1784094151.409601:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094151.409605:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409610:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbcab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409633:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409638:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409643:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409647:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094151.409649:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409654:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409663:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff90721a781800) 00010000:00010000:2.0:1784094151.409665:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094151.409667:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409815:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbcb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409848:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbca4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c9a expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409862:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c9a expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.409870:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:2.0:1784094151.409872:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094151.409875:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784094151.409935:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:54975:x1870757013838208:12345-192.168.204.57@tcp:101:rm.0 Request processed in 781us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094151.409943:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 973 00000100:00100000:3.0:1784094151.412833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094151.412957:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013838336 00000100:00100000:2.0:1784094151.412966:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013838336 00000100:00100000:2.0:1784094151.413018:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 494 00000100:00100000:2.0:1784094151.413029:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013838336:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094151.413046:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094151.413065:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ca1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094151.413094:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x6a571dc7, atime: 0x6a571dc7, ctime: 0x6a571dc7, blocks: 0x1 00010000:00010000:2.0:1784094151.413111:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=1312s v=(0 0) 00010000:00010000:2.0:1784094151.413115:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094151.413124:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.413142:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 6 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.413154:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094151.413205:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013838336:12345-192.168.204.57@tcp:101:rm.0 Request processed in 178us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094151.413213:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 494 00000100:00100000:3.0:1784094151.417176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094151.417270:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013838592 00000100:00100000:0.0:1784094151.417280:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013838592 00000100:00100000:0.0:1784094151.417331:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 974 00000100:00100000:0.0:1784094151.417342:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:54975:x1870757013838592:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094151.417389:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094151.417413:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cbcb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c9a expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417473:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbc96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c93 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417483:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784094151.417504:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094151.417594:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417608:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417628:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417649:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417657:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417664:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417831:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417840:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.417848:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094151.418334:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 64 off10176 00000004:00080000:0.0:1784094151.418344:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1312495921000ns, next at 1313495918590ns, rc = 0 00010000:00010000:0.0:1784094151.418397:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.418407:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.418414:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.418440:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.418452:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.418457:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419000:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094151.419023:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419031:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419037:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419044:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094151.419048:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419054:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419062:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784094151.419065:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094151.419068:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419073:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbcd5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419088:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419094:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419099:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419104:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094151.419107:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419113:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419119:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fce900) 00010000:00010000:0.0:1784094151.419121:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094151.419123:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094151.419128:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbcc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094151.419136:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000081798d59 reply state 000000009a01249c transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094151.419144:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094151.419222:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:54975:x1870757013838592:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1880us (2051us total) trans 4294967673 rc 0/0 00000100:00100000:0.0:1784094151.419229:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 974 00010000:00010000:3.0:1784094151.419787:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094151.419793:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.419800:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094151.419803:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.419811:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.419820:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff907202e6b100) 00010000:00010000:3.0:1784094151.419823:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784094151.419826:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.419831:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbcdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094151.419845:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094151.419846:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094151.419848:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094151.422522:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.422544:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.422550:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.422556:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094151.422560:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.422567:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.422580:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907202e6b900) 00010000:00010000:2.0:1784094151.422583:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094151.422587:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094151.422593:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbcce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094152.169608:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094152.482649:0:91830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeee023ed0 20000000:00000080:1.0:1784094152.482666:0:91830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df7400 uarg=0000000000000000 00010000:00010000:1.0:1784094152.482986:0:91830:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094152.483019:0:91830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fce900) 00010000:00010000:1.0:1784094152.483022:0:91830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094152.483034:0:91830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbc65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5c85 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.483055:0:91830:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094152.483069:0:91830:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094152.483083:0:91830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.483095:0:91830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.483107:0:91830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.483143:0:91830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.483156:0:91830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 18 pid: 5771 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094152.483171:0:91830:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91830:1870757024330112:0@lo:104: 00000100:00100000:1.0:1784094152.483230:0:91830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094152.483276:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024330112 00000100:00100000:3.0:1784094152.483283:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024330112 00000100:00100000:1.0:1784094152.483285:0:91830:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094152.483366:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784094152.483374:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:91830:x1870757024330112:12345-0@lo:104: 00010000:00010000:3.0:1784094152.483388:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094152.483500:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094152.483505:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:91830:x1870757024330112:12345-0@lo:104: Request processed in 133us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094152.483510:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00010000:0.0:1784094152.483722:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094152.483740:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.483753:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094152.483757:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.483766:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094152.483785:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094152.483791:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094152.483820:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.483826:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094152.483845:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.483852:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40600/0x9ce98053214cbc42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbc49 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.483867:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094152.483869:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094152.483871:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094152.484103:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024330240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094152.484132:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094152.484235:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024330240 00000100:00100000:0.0:1784094152.484240:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024330240 00000100:00100000:1.0:1784094152.484268:0:91830:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91830:1870757024330112:0@lo:104: 00010000:00010000:0.0:1784094152.484283:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 19 pid: 5771 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.484285:0:91830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094152.484310:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1784094152.484318:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024330240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094152.484330:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094152.484336:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 19 pid: 5771 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484346:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 19 pid: 5771 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484358:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40400/0x9ce98053214cbc49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbc42 expref: 19 pid: 5771 timeout: 1463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484371:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484378:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484390:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484398:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484405:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484412:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484416:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094152.484492:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484501:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484514:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094152.484523:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094152.484600:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024330240:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094152.484607:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784094152.484700:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024330240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094152.484851:0:91830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.484858:0:91830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094152.484864:0:91830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214cbce3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094152.682123:0:7044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1313759698875ns, next at 1314759696278ns, rc = 0 00000100:00100000:0.0:1784094152.682243:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024330368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094152.682302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094152.682506:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024330368 00000100:00100000:3.0:1784094152.682515:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024330368 00000100:00100000:3.0:1784094152.682602:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1784094152.682617:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024330368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784094152.682639:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784094152.682640:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094152.682704:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024330368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094152.682711:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1784094152.682805:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024330368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094153.193692:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784094154.025480:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094154.025488:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094154.025493:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094154.025536:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.025549:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.025561:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.025598:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024330496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094154.025672:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094154.025729:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024330496 00000100:00100000:0.0:1784094154.025737:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024330496 00000100:00100000:2.0:1784094154.025739:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66300 going to sleep for 11 seconds 00000100:00100000:0.0:1784094154.025809:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1784094154.025823:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024330496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094154.025837:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094154.025852:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbcea expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094154.025889:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbcea expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094154.025902:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbcea expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094154.025912:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784094154.025977:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024330496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094154.025987:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1784094154.026051:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024330496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094154.026073:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094154.026084:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094154.026304:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094154.026311:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094154.026319:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.167882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094154.167972:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013838720 00000100:00100000:1.0:1784094154.167982:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013838720 00000100:00100000:1.0:1784094154.168060:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 975 00000100:00100000:1.0:1784094154.168072:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:55063:x1870757013838720:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094154.168099:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094154.168181:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbcf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ca8 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784094154.168402:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094154.168588:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbcff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.168602:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbcff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.168616:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbcff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094154.168677:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1784094154.168682:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094154.168712:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbcff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.168740:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cbcf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca8 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.168772:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbcff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca8 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.168783:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094154.168787:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094154.168792:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784094154.168955:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:55063:x1870757013838720:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 884us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094154.168965:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 975 00000100:00100000:3.0:1784094154.171883:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094154.172053:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013838976 00000100:00100000:2.0:1784094154.172062:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013838976 00000100:00100000:2.0:1784094154.172112:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 976 00000100:00100000:2.0:1784094154.172122:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:55063:x1870757013838976:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094154.172163:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094154.172200:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cbcff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca8 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.172217:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbc65) 00010000:00010000:2.0:1784094154.172221:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12900) 00010000:00010000:2.0:1784094154.172231:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094154.172256:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.172269:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.172280:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784094154.201306:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967673 is committed 00000004:00080000:0.0:1784094154.201316:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 81 committed 00000001:00080000:0.0:1784094154.201342:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000004:00080000:0.0:1784094154.201347:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 82 committed 00000004:00010000:2.0:1784094154.201556:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000be700011 reply state 000000008af4f60f transno 4294967674 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.201584:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094154.201722:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00080000:2.0:1784094154.201850:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784094154.201877:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55063:x1870757013838976:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 29751us (29992us total) trans 4294967674 rc 0/0 00000100:00100000:2.0:1784094154.201886:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 976 00010000:00010000:1.0:1784094154.202031:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.202041:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.202050:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.202057:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094154.202062:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.202069:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.202084:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781400) 00010000:00010000:1.0:1784094154.202087:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094154.202091:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.202098:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbd06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094154.202120:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094154.202145:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024330624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784094154.202195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094154.202363:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024330624 00000100:00100000:2.0:1784094154.202370:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024330624 00000100:00100000:2.0:1784094154.202441:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1784094154.202450:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024330624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784094154.202523:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:2.0:1784094154.202553:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.202586:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 5 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.202595:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1784094154.202599:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094154.202604:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.202637:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 5 pid: 6572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.202653:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 5 pid: 6572 timeout: 1415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.202667:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024330752:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094154.202708:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a5b1000 going to sleep for 11 seconds 00000100:00080000:1.0:1784094154.202760:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094154.204443:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094154.204707:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013839104 00000100:00100000:1.0:1784094154.204714:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013839104 00010000:00010000:1.0:1784094154.204756:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 6 pid: 6572 timeout: 1415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784094154.204758:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094154.204797:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 322 00000100:00100000:1.0:1784094154.204806:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013839104:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094154.204818:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094154.204825:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 6 pid: 6572 timeout: 1415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.204840:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 6 pid: 6572 timeout: 1415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.204861:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094154.204866:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094154.204887:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.204897:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.204915:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094154.204948:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013839104:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 143us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094154.204956:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 322 00010000:00010000:2.0:1784094154.205917:0:53396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214cbcc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ca1 expref: 5 pid: 6572 timeout: 1415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.205934:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024330752:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094154.205952:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.205963:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.205971:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.205982:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.205990:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.206008:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094154.206077:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094154.206085:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.206096:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094154.206101:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.206112:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.206126:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.206134:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dcb7a17/0x9ce98053214cbd0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.206159:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094154.206161:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094154.206163:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094154.206970:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024330624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4520us (4772us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1784094154.206979:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000004:00080000:1.0:1784094154.207028:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907210e24380/2, rc 0, transno 4294967359 00000100:00100000:1.0:1784094154.207036:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024330624:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784094154.217593:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094154.628513:0:92027:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdda879300 20000000:00000080:2.0:1784094154.628529:0:92027:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237552800 uarg=0000000000000000 00010000:00010000:2.0:1784094154.628992:0:92027:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094154.629007:0:92027:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094154.629019:0:92027:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094154.629037:0:92027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.629057:0:92027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbcea expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.629066:0:92027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.629103:0:92027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbcea expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.629117:0:92027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbcea expref: 18 pid: 5772 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.629131:0:92027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92027:1870757024330880:0@lo:104: 00000100:00100000:2.0:1784094154.629194:0:92027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094154.629292:0:92027:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210d48240 going to sleep for 11 seconds 00000100:00100000:0.0:1784094154.629340:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784094154.629353:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024330880 00000100:00100000:0.0:1784094154.629359:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024330880 00000100:00100000:0.0:1784094154.629530:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1784094154.629540:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101df7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:92027:x1870757024330880:12345-0@lo:104: 00010000:00010000:0.0:1784094154.629561:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094154.629635:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094154.629641:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101df7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:92027:x1870757024330880:12345-0@lo:104: Request processed in 103us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094154.629648:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:3.0:1784094154.629661:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094154.629668:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.629676:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094154.629679:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.629685:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094154.629690:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094154.629694:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094154.629721:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.629727:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784094154.629737:0:92027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92027:1870757024330880:0@lo:104: 00010000:00010000:1.0:1784094154.629758:0:92027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.629770:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094154.629779:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cbcea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbcf1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094154.629784:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024331008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094154.629800:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094154.629804:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094154.629806:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094154.629819:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094154.629975:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331008 00000100:00100000:1.0:1784094154.629980:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331008 00010000:00010000:1.0:1784094154.630000:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbcea expref: 19 pid: 5772 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094154.630026:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1784094154.630033:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024331008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094154.630044:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094154.630055:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbcea expref: 19 pid: 5772 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630066:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbcea expref: 19 pid: 5772 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630079:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214cbcf1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbcea expref: 19 pid: 5772 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630090:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630099:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630113:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630125:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630133:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630139:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630145:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094154.630149:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630156:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630172:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.630183:0:92027:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094154.630186:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094154.630194:0:92027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094154.630201:0:92027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40800/0x9ce98053214cbd14 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094154.630232:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024331008:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094154.630240:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784094154.630393:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024331008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094155.131447:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094155.131501:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013839360 00000100:00100000:2.0:1784094155.131507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094155.131512:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013839360 00000100:00100000:3.0:1784094155.131585:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 898 00000100:00100000:3.0:1784094155.131597:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013839360:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094155.131682:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013839360:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.131689:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 898 00000100:00100000:1.0:1784094155.131740:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013839232 00000100:00100000:1.0:1784094155.131744:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013839232 00000100:00100000:1.0:1784094155.131781:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 844 00000100:00100000:1.0:1784094155.131789:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013839232:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094155.131819:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013839232:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094155.131829:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 844 00010000:00010000:0.0:1784094155.242519:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094155.757190:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024331520:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094155.757332:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784094155.757348:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024331136:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757380:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094155.757405:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024331648:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757461:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094155.757493:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331520 00000100:00100000:3.0:1784094155.757499:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331520 00000100:00100000:3.0:1784094155.757559:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1784094155.757570:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024331520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757620:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024331520:12345-0@lo:400:kworker.0 Request processed in 52us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.757627:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1784094155.757651:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331136 00000100:00100000:3.0:1784094155.757655:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331136 00000100:00100000:3.0:1784094155.757678:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1784094155.757684:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024331136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757712:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024331136:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.757718:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1784094155.757766:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024331136:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757780:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024331520:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757820:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024331392:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094155.757864:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784094155.757870:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024331264:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094155.757908:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024331776:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.757928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094155.757953:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331648 00000100:00100000:3.0:1784094155.757956:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331648 00000100:00100000:3.0:1784094155.757987:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331392 00000100:00100000:3.0:1784094155.757990:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331392 00000100:00100000:3.0:1784094155.758008:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331264 00000100:00100000:3.0:1784094155.758011:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331264 00000100:00100000:3.0:1784094155.758024:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1784094155.758030:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024331648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758065:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024331648:12345-0@lo:400:kworker.0 Request processed in 34us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.758072:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1784094155.758084:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1784094155.758090:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024331392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758121:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024331392:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.758126:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1784094155.758136:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1784094155.758142:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024331264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758167:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024331264:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.758173:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1784094155.758192:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331776 00000100:00100000:3.0:1784094155.758194:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331776 00000100:00100000:3.0:1784094155.758215:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1784094155.758221:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024331776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758249:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024331776:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094155.758255:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00080000:3.0:1784094155.758269:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094155.758274:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094155.758298:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024331264:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758308:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024331776:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758316:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024331392:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758338:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024331648:0@lo:400:kworker.0 00000100:00100000:3.0:1784094155.758761:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024331904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094155.758791:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094155.758860:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024331904 00000100:00100000:1.0:1784094155.758865:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024331904 00000100:00100000:1.0:1784094155.758905:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1784094155.758914:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024331904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094155.758943:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094155.758985:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024331904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094155.758991:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1784094155.759039:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024331904:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1784094156.074760:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094156.074768:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094156.074775:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094156.074821:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.074833:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.074846:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094156.074875:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024332032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094156.074946:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094156.074997:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332032 00000100:00100000:0.0:1784094156.075000:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784094156.075005:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332032 00000100:00100000:1.0:1784094156.075048:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1784094156.075058:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024332032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094156.075070:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094156.075084:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbd1b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094156.075107:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094156.075117:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094156.075126:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784094156.075170:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024332032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094156.075223:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1784094156.075330:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024332032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094156.075408:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.075418:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094156.075456:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094156.075462:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.075469:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094156.101617:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094156.101707:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013839488 00000100:00100000:3.0:1784094156.101716:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013839488 00000100:00100000:3.0:1784094156.101811:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 977 00000100:00100000:3.0:1784094156.101822:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55139:x1870757013839488:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094156.101842:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094156.101864:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cbd29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5caf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.101925:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.101938:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.101951:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.101963:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.101970:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.101976:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.102461:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbd3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784094156.102563:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094156.102650:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbd3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.102665:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbd3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094156.102824:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:2.0:1784094156.102830:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094156.102915:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbd3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102930:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102937:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102943:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102950:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094156.102954:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102962:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102976:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784094156.102979:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.102984:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.102990:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbd30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103001:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103007:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103013:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103018:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094156.103021:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103027:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103036:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fce200) 00010000:00010000:2.0:1784094156.103038:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.103042:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103047:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbd37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103081:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cbd29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5caf expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103097:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbd3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5caf expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.103103:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094156.103106:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094156.103108:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:2.0:1784094156.103170:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013839488:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1350us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094156.103182:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 977 00000100:00100000:2.0:1784094156.105697:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094156.105753:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013839744 00000100:00100000:3.0:1784094156.105762:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013839744 00000100:00100000:3.0:1784094156.105820:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 978 00000100:00100000:3.0:1784094156.105832:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013839744:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094156.105853:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094156.105872:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbd45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cb6 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106309:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106323:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106343:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106359:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106366:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106373:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094156.106786:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:3.0:1784094156.106807:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106815:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106821:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106828:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094156.106832:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106840:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106852:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094156.106856:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094156.106861:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106867:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbd4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106878:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106884:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106890:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106900:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094156.106902:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106908:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106915:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907204fce800) 00010000:00010000:3.0:1784094156.106918:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094156.106920:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106927:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbd53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106960:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbd45 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cb6 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106971:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094156.106973:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094156.106977:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbd45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cb6 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.106987:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094156.107051:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013839744:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1221us (1362us total) trans 0 rc 301/301 00000100:00100000:3.0:1784094156.107060:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 978 00000100:00100000:3.0:1784094156.112269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094156.113837:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013839872 00000100:00100000:1.0:1784094156.113850:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013839872 00000100:00100000:2.0:1784094156.113925:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 979 00000100:00100000:2.0:1784094156.113937:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013839872:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784094156.113954:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094156.113971:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbd5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cbd expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114024:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114034:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114042:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114052:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114057:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114061:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114212:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114217:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114222:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114227:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094156.114230:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114234:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114243:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094156.114245:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.114248:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114252:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbd61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114258:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114261:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114265:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114268:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094156.114270:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114276:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114280:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff90721a781e00) 00010000:00010000:2.0:1784094156.114281:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.114283:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114286:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbd68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114306:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbd5a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cbd expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114312:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094156.114313:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.114315:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbd5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cbd expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.114321:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784094156.114372:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013839872:12345-192.168.204.57@tcp:101:touch.0 Request processed in 438us (2112us total) trans 0 rc 301/301 00000100:00100000:2.0:1784094156.114377:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 979 00000100:00100000:2.0:1784094156.116119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094156.116146:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840000 00000100:00100000:3.0:1784094156.116154:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840000 00000100:00100000:3.0:1784094156.116188:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 980 00000100:00100000:3.0:1784094156.116195:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013840000:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094156.116209:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094156.116221:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cbd6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cc4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.116316:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.116329:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.116340:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.116355:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.116363:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.116369:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116651:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116662:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116671:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116678:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094156.116683:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116691:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116703:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094156.116707:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.116711:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116718:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbd76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116728:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116734:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116739:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116745:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094156.116748:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116758:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116765:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907204fcea00) 00010000:00010000:2.0:1784094156.116768:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.116771:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116776:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbd7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116803:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cbd6f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cc4 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116812:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094156.116815:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094156.116818:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cbd6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cc4 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.116827:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:2.0:1784094156.116873:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55139:x1870757013840000:12345-192.168.204.57@tcp:101:touch.0 Request processed in 678us (757us total) trans 0 rc 301/301 00000100:00100000:2.0:1784094156.116881:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 980 00010000:00010000:3.0:1784094156.267736:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094156.794154:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000020:00000080:2.0:1784094156.911327:0:92272:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffe909390 20000000:00000080:2.0:1784094156.911344:0:92272:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237550800 uarg=0000000000000000 00010000:00010000:2.0:1784094156.911609:0:92272:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784094156.911645:0:92272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094156.911650:0:92272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094156.911661:0:92272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbd3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5caf expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.911682:0:92272:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784094156.911699:0:92272:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094156.911713:0:92272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.911726:0:92272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.911735:0:92272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.911770:0:92272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.911783:0:92272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 18 pid: 5772 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094156.911796:0:92272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92272:1870757024332160:0@lo:104: 00000100:00100000:2.0:1784094156.911849:0:92272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094156.911898:0:92272:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a9bec00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094156.911916:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332160 00000100:00100000:3.0:1784094156.911924:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332160 00000100:00100000:3.0:1784094156.911968:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784094156.911978:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:92272:x1870757024332160:12345-0@lo:104: 00010000:00010000:3.0:1784094156.911992:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094156.912058:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094156.912065:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:92272:x1870757024332160:12345-0@lo:104: Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094156.912073:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784094156.912077:0:92272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92272:1870757024332160:0@lo:104: 00010000:00010000:2.0:1784094156.912099:0:92272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912100:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094156.912110:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912119:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094156.912123:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912131:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094156.912138:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094156.912143:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094156.912175:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912182:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094156.912212:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912218:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cbd1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbd22 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912232:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094156.912233:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094156.912235:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094156.912243:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094156.912261:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024332288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094156.912300:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094156.912344:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332288 00000100:00100000:0.0:1784094156.912349:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332288 00010000:00010000:0.0:1784094156.912369:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 19 pid: 5772 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094156.912394:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1784094156.912400:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024332288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094156.912411:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094156.912416:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 19 pid: 5772 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912455:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 19 pid: 5772 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912468:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12800/0x9ce98053214cbd22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbd1b expref: 19 pid: 5772 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912479:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912487:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912500:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912525:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912532:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912539:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912544:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094156.912548:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912555:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912571:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094156.912580:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094156.912600:0:92272:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094156.912607:0:92272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094156.912622:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024332288:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (327us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094156.912624:0:92272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214cbd84 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094156.912636:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1784094156.913147:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024332288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094157.290558:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094157.803690:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024332416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094157.803754:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094157.804566:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332416 00000100:00100000:0.0:1784094157.804575:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332416 00000100:00100000:0.0:1784094157.804629:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1784094157.804639:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024332416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094157.804686:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094157.804736:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024332416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094157.804745:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:0.0:1784094157.804767:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094157.804793:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:0.0:1784094157.804798:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907210e24380, transno 4294967359 00000100:00100000:0.0:1784094157.804825:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024332416:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784094158.057828:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094158.057835:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094158.057840:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094158.057890:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.057903:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.057915:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094158.057957:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024332544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094158.058032:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094158.058095:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b79ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094158.058099:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332544 00000100:00100000:1.0:1784094158.058109:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332544 00000100:00100000:1.0:1784094158.058161:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1784094158.058171:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024332544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094158.058183:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094158.058197:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbd8b expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094158.058219:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094158.058229:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094158.058238:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094158.058280:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024332544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094158.058286:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1784094158.058465:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024332544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094158.058484:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.058504:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094158.058528:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094158.058533:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.058540:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094158.222865:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094158.223191:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840128 00000100:00100000:3.0:1784094158.223201:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840128 00000100:00080000:0.0:1784094158.223256:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094158.223269:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 981 00000100:00100000:3.0:1784094158.223280:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55225:x1870757013840128:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094158.223299:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094158.223321:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cbd99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ccb expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.223388:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbda0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.223402:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.223415:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094158.223643:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1784094158.223648:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094158.223725:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbda0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.223755:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cbd99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ccb expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.223774:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbda0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ccb expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.223783:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784094158.223785:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094158.223790:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784094158.223849:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55225:x1870757013840128:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 570us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094158.223857:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 981 00000100:00100000:3.0:1784094158.225897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094158.225945:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840384 00000100:00100000:2.0:1784094158.225955:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840384 00000100:00100000:2.0:1784094158.225999:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 982 00000100:00100000:2.0:1784094158.226014:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55225:x1870757013840384:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094158.226069:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094158.226094:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbda0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ccb expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.226109:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbd3e) 00010000:00010000:2.0:1784094158.226113:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcee00) 00010000:00010000:2.0:1784094158.226122:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094158.226147:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.226158:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.226167:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094158.226610:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000eed304b8 reply state 000000006118850e transno 4294967675 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094158.226620:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094158.226705:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000100:00100000:2.0:1784094158.226785:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:55225:x1870757013840384:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 777us (894us total) trans 4294967675 rc 0/0 00000100:00100000:2.0:1784094158.226793:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 982 00010000:00010000:3.0:1784094158.229171:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.229192:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.229208:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.229214:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094158.229219:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.229226:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.229244:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781500) 00010000:00010000:3.0:1784094158.229248:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094158.229252:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.229258:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbda7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.313973:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094158.588622:0:92468:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd4de6e30 20000000:00000080:2.0:1784094158.588639:0:92468:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237553000 uarg=0000000000000000 00010000:00010000:2.0:1784094158.588985:0:92468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094158.588999:0:92468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094158.589010:0:92468:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094158.589028:0:92468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589044:0:92468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589052:0:92468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589090:0:92468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589104:0:92468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 18 pid: 5770 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094158.589118:0:92468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92468:1870757024332672:0@lo:104: 00000100:00100000:2.0:1784094158.589181:0:92468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094158.589229:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332672 00000100:00100000:0.0:1784094158.589237:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332672 00000100:00100000:2.0:1784094158.589242:0:92468:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b955cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094158.589301:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1784094158.589312:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:92468:x1870757024332672:12345-0@lo:104: 00010000:00010000:0.0:1784094158.589325:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589382:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094158.589389:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:92468:x1870757024332672:12345-0@lo:104: Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094158.589397:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784094158.589405:0:92468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92468:1870757024332672:0@lo:104: 00010000:00010000:3.0:1784094158.589488:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094158.589495:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.589504:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094158.589508:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.589516:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094158.589523:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094158.589528:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094158.589566:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.589573:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094158.589594:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.589606:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbd8b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbd92 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094158.589620:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094158.589621:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094158.589623:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094158.589631:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094158.589641:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024332800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094158.589671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094158.589718:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332800 00000100:00100000:0.0:1784094158.589723:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332800 00010000:00010000:0.0:1784094158.589740:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 19 pid: 5770 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094158.589769:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1784094158.589776:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024332800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094158.589786:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094158.589790:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 19 pid: 5770 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589801:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 19 pid: 5770 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589814:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214cbd92 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbd8b expref: 19 pid: 5770 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589827:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589836:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589847:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589854:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589872:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589880:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589885:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094158.589889:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589901:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589911:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094158.589927:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094158.589936:0:92468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589947:0:92468:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589953:0:92468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094158.589958:0:92468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214cbdae lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094158.589965:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024332800:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094158.589974:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1784094158.590486:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024332800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094159.337601:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094159.352093:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967675 is committed 00000100:00100000:3.0:1784094159.940587:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094159.940745:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840512 00000100:00100000:2.0:1784094159.940755:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840512 00000100:00100000:2.0:1784094159.940842:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 983 00000100:00100000:2.0:1784094159.940851:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013840512:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094159.940955:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013840512:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 105us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094159.940962:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 983 00000100:00100000:2.0:1784094159.942819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094159.942894:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840640 00000100:00100000:3.0:1784094159.942901:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840640 00000100:00100000:3.0:1784094159.942979:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 496 00000100:00100000:3.0:1784094159.942987:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013840640:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784094159.943275:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094159.943357:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013840640:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 362us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094159.943364:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 496 00000100:00100000:0.0:1784094159.946990:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094159.947073:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840768 00000100:00100000:3.0:1784094159.947083:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840768 00000100:00100000:3.0:1784094159.947137:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 497 00000100:00100000:3.0:1784094159.947143:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870757013840768:12345-192.168.204.57@tcp:8:lfs.0 00010000:00080000:3.0:1784094159.947167:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 1321 last 0 00000020:00000080:3.0:1784094159.947192:0:6572:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214cbdb5 00002000:00100000:3.0:1784094159.947202:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff90723dc12000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 17039360 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784094159.947221:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784094159.947694:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784094159.947723:0:6572:0:(import.c:65:import_set_state_nolock()) ffff90723dc12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784094159.947843:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013840768:12345-192.168.204.57@tcp:8:lfs.0 Request processed in 697us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094159.947852:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 497 00000100:00100000:0.0:1784094159.951519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094159.951872:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013840896 00000100:00100000:3.0:1784094159.951882:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013840896 00000100:00080000:0.0:1784094159.951937:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094159.951947:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 498 00000100:00100000:3.0:1784094159.951957:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:55310:x1870757013840896:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094159.952291:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:55310:x1870757013840896:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 335us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094159.952298:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 498 00000100:00100000:2.0:1784094159.957882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094159.957934:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841024 00000100:00100000:3.0:1784094159.957944:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841024 00000100:00100000:3.0:1784094159.958003:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 984 00000100:00100000:3.0:1784094159.958013:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841024:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094159.958566:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841024:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 552us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094159.958574:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 984 00000100:00100000:0.0:1784094159.960708:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094159.960922:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841152 00000100:00100000:2.0:1784094159.960931:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841152 00000100:00100000:2.0:1784094159.960986:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 985 00000100:00100000:2.0:1784094159.960995:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841152:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094159.961089:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841152:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 95us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094159.961096:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 985 00000100:00100000:0.0:1784094159.962281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094159.962394:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841280 00000100:00100000:3.0:1784094159.962400:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841280 00000100:00100000:3.0:1784094159.962617:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:3.0:1784094159.962627:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841280:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094159.962955:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841280:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 329us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094159.962963:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 499 00000100:00100000:3.0:1784094159.963986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094159.964297:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841408 00000100:00100000:2.0:1784094159.964305:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841408 00000100:00100000:2.0:1784094159.964345:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 500 00000100:00100000:2.0:1784094159.964355:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55310:x1870757013841408:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094159.964670:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55310:x1870757013841408:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 316us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094159.964678:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 500 00000100:00100000:2.0:1784094159.967740:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094159.967856:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841536 00000100:00100000:0.0:1784094159.967866:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841536 00000100:00100000:0.0:1784094159.967963:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 986 00000100:00100000:0.0:1784094159.967975:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841536:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094159.968474:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55310:x1870757013841536:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 500us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094159.968482:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 986 10000000:01000000:3.0:1784094159.978219:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094159.978227:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094159.978233:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094159.978283:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094159.978297:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094159.978308:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094159.978332:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024332928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094159.978399:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094159.978544:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b79c840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094159.978850:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024332928 00000100:00100000:1.0:1784094159.978857:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024332928 00000100:00100000:1.0:1784094159.979013:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1784094159.979023:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024332928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094159.979037:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094159.979050:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbdbc expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094159.979072:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094159.979081:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094159.979091:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094159.979138:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024332928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094159.979145:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1784094159.979223:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024332928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094159.979242:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094159.979250:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094159.979267:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094159.979271:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094159.979283:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094160.003387:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094160.003527:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841664 00000100:00100000:3.0:1784094160.003537:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841664 00000100:00100000:3.0:1784094160.003616:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 987 00000100:00100000:3.0:1784094160.003627:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55314:x1870757013841664:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784094160.003647:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094160.003717:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbdca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cd2 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.003783:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.003797:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.003809:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.003835:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.003843:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.003850:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004280:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbddf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004290:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004297:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094160.004370:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:3.0:1784094160.004375:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094160.004518:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004532:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004539:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784094160.004545:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094160.004547:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004556:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094160.004561:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004569:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004583:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784094160.004587:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094160.004592:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004599:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbdd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004612:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004618:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004625:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004629:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094160.004632:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004638:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004645:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fcee00) 00010000:00010000:3.0:1784094160.004647:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094160.004650:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004655:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbdd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004683:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbdca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cd2 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004703:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cd2 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094160.004710:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094160.004712:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094160.004714:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784094160.004767:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55314:x1870757013841664:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1142us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094160.004775:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 987 00000100:00100000:3.0:1784094160.007805:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094160.008019:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013841920 00000100:00100000:2.0:1784094160.008028:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013841920 00000100:00100000:2.0:1784094160.008199:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 988 00000100:00100000:2.0:1784094160.008211:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55314:x1870757013841920:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094160.008229:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094160.008247:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbde6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cd9 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.008736:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.008855:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.008869:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.008887:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.008894:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.008900:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094160.009906:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:2.0:1784094160.010340:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbdfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010352:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010361:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbdfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010397:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010404:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010411:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010417:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094160.010491:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010504:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010515:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094160.010518:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094160.010523:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010528:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbded lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094160.010542:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000043891a34 reply state 00000000a855ba7f transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094160.010551:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094160.010582:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cbde6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cd9 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010596:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbdfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cd9 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094160.010602:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784094160.010604:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094160.010606:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784094160.010687:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:55314:x1870757013841920:12345-192.168.204.57@tcp:101:dd.0 Request processed in 2478us (2889us total) trans 4294967676 rc 0/0 00000100:00100000:2.0:1784094160.010695:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 988 00010000:00010000:1.0:1784094160.012359:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094160.012372:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094160.012379:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094160.012385:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094160.012389:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094160.012397:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094160.012409:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff90721a781e00) 00010000:00010000:1.0:1784094160.012412:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094160.012417:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094160.012584:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbdf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094160.015020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094160.015088:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842048 00000100:00100000:0.0:1784094160.015098:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842048 00000100:00100000:0.0:1784094160.015153:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 501 00000100:00100000:0.0:1784094160.015163:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:55314:x1870757013842048:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:0.0:1784094160.015191:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094160.015214:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ce0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784094160.015245:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784094160.015266:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=1321s v=(0 0) 00010000:00010000:0.0:1784094160.015272:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094160.015282:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 7 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094160.015301:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 7 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094160.015314:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784094160.015368:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:55314:x1870757013842048:12345-192.168.204.57@tcp:101:dd.0 Request processed in 203us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094160.015375:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 501 00000100:00100000:2.0:1784094160.025591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094160.026243:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842176 00000100:00100000:3.0:1784094160.026255:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842176 00002000:00100000:3.0:1784094160.026319:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff9071026bf100 x1870757013842176/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:481/0 lens 488/0 e 0 to 0 dl 1784094171 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784094160.026331:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9071026bf100 with x1870757013842176 ext(0->1048575) 00002000:00010000:3.0:1784094160.026337:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9071026bf100 00000100:00100000:3.0:1784094160.026378:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 24 00000100:00100000:3.0:1784094160.026388:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013842176:12345-192.168.204.57@tcp:4:dd.0 00000001:00100000:0.0:1784094160.058372:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000100:00100000:2.0:1784094160.062250:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013842176:12345-192.168.204.57@tcp:4:dd.0 Request processed in 35855us (36659us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1784094160.062267:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 24 00002000:00100000:2.0:1784094160.062277:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff9071026bf100 x1870757013842176/t4294967358(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:481/0 lens 488/448 e 0 to 0 dl 1784094171 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784094160.062284:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9071026bf100 with x1870757013842176 ext(0->1048575) 00002000:00010000:2.0:1784094160.062289:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9071026bf100 00000100:00100000:2.0:1784094160.064817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094160.064912:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842304 00000100:00100000:0.0:1784094160.064980:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842304 00000100:00100000:0.0:1784094160.065091:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 989 00000100:00100000:0.0:1784094160.065102:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:55314:x1870757013842304:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:2.0:1784094160.088212:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967676 is committed 00000100:00100000:0.0:1784094160.088351:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:55314:x1870757013842304:12345-192.168.204.57@tcp:44:dd.0 Request processed in 23245us (23534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094160.088363:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 989 00000100:00100000:2.0:1784094160.089752:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094160.089805:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842432 00000100:00100000:3.0:1784094160.089815:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842432 00000100:00100000:3.0:1784094160.089865:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 502 00000100:00100000:3.0:1784094160.089875:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013842432:12345-192.168.204.57@tcp:16:dd.0 00000001:00080000:0.0:1784094160.113686:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967358 is committed 00000100:00100000:2.0:1784094160.113837:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013842432:12345-192.168.204.57@tcp:16:dd.0 Request processed in 23958us (24084us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094160.113848:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 502 00000100:00100000:3.0:1784094160.118645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094160.118862:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842688 00000100:00100000:1.0:1784094160.118872:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842688 00000100:00100000:1.0:1784094160.118928:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 101 00000100:00100000:1.0:1784094160.118940:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:55314:x1870757013842688:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:1.0:1784094160.119366:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:55314:x1870757013842688:12345-192.168.204.57@tcp:35:dd.0 Request processed in 428us (727us total) trans 4294967677 rc 0/0 00000100:00100000:1.0:1784094160.119375:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 101 00000100:00100000:0.0:1784094160.249713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094160.249765:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094160.249805:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094160.249835:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842816 00000100:00100000:0.0:1784094160.249842:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094160.249847:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842816 00000100:00100000:0.0:1784094160.249891:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843072 00000100:00100000:0.0:1784094160.249896:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843072 00000100:00100000:1.0:1784094160.249907:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 849 00000100:00100000:1.0:1784094160.249920:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013842816:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094160.249937:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843200 00000100:00100000:2.0:1784094160.249943:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843200 00000100:00100000:3.0:1784094160.249972:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013842944 00000100:00100000:3.0:1784094160.249979:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013842944 00000100:00100000:2.0:1784094160.249979:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 678 00000100:00100000:2.0:1784094160.249992:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013843072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094160.249999:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013842816:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094160.250009:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 849 00000100:00100000:3.0:1784094160.250021:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:3.0:1784094160.250032:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013842944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094160.250052:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013843072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094160.250060:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 678 00000100:00100000:3.0:1784094160.250076:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013842944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094160.250083:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 679 00000100:00100000:3.0:1784094160.250088:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:2.0:1784094160.250095:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013843200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094160.250128:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013843200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094160.250135:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 679 00010000:00010000:1.0:1784094160.362249:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784094160.804068:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967677 is committed 00000100:00100000:3.0:1784094160.874559:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024333056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094160.874665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094160.874872:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024333312:0@lo:400:kworker.0 00000100:00100000:3.0:1784094160.874902:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024333184:0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.874909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094160.874946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094160.874949:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024333568:0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.874980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094160.875000:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094160.875006:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024333440:0@lo:400:kworker.0 00000100:00100000:1.0:1784094160.875023:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333056 00000100:00100000:1.0:1784094160.875032:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333056 00000100:00100000:0.0:1784094160.875033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094160.875101:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1784094160.875112:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024333056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094160.875136:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784094160.875184:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024333056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094160.875192:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1784094160.876613:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333312 00000100:00100000:3.0:1784094160.876622:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333312 00000100:00100000:3.0:1784094160.876661:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333184 00000100:00100000:3.0:1784094160.876665:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333184 00000100:00100000:3.0:1784094160.876685:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333568 00000100:00100000:3.0:1784094160.876688:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333568 00000100:00100000:3.0:1784094160.876708:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:3.0:1784094160.876716:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024333312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094160.876781:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024333312:12345-0@lo:400:kworker.0 Request processed in 65us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094160.876788:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:3.0:1784094160.876804:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1784094160.876811:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024333184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094160.876847:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024333184:12345-0@lo:400:kworker.0 Request processed in 37us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094160.876853:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1784094160.876866:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:3.0:1784094160.876873:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024333568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094160.876903:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024333568:12345-0@lo:400:kworker.0 Request processed in 31us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094160.876909:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:3.0:1784094160.876953:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024333184:0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.877559:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333440 00000100:00100000:0.0:1784094160.877565:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333440 00000100:00100000:0.0:1784094160.877602:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1784094160.877610:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024333440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.877652:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024333440:12345-0@lo:400:kworker.0 Request processed in 44us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094160.877658:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00080000:0.0:1784094160.877674:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094160.877678:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094160.877680:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094160.877716:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024333312:0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.877741:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024333440:0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.877750:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024333568:0@lo:400:kworker.0 00000100:00100000:0.0:1784094160.877765:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024333056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784094161.387885:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784094161.469164:0:92714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1322546738930ns, next at 1314759696278ns, rc = 0 00000004:00080000:3.0:1784094161.469591:0:92714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1322547167883ns, next at 1255174273854ns, rc = 0 00000004:00080000:1.0:1784094161.475002:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 80 committed 00000004:00080000:1.0:1784094161.475026:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 83 committed 00000100:00100000:0.0:1784094162.293999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.294253:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843328 00000100:00100000:3.0:1784094162.294272:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843328 00000100:00080000:0.0:1784094162.294338:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094162.294342:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 990 00000100:00100000:3.0:1784094162.294365:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013843328:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094162.294505:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013843328:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 154us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094162.294513:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 990 00000100:00100000:1.0:1784094162.298160:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.298240:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843456 00000100:00100000:3.0:1784094162.298250:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843456 00000100:00100000:3.0:1784094162.298321:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:3.0:1784094162.298331:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55506:x1870757013843456:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784094162.298483:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094162.298959:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55506:x1870757013843456:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 628us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094162.298968:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 503 00000100:00100000:0.0:1784094162.303690:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.305665:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843584 00000100:00100000:3.0:1784094162.305680:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843584 00000100:00080000:0.0:1784094162.305860:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094162.306882:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 504 00000100:00100000:2.0:1784094162.306899:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55506:x1870757013843584:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094162.307269:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:55506:x1870757013843584:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 374us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094162.307277:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 504 00000100:00100000:0.0:1784094162.311531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.312278:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843712 00000100:00100000:3.0:1784094162.312288:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843712 00000100:00100000:3.0:1784094162.312343:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 991 00000100:00100000:3.0:1784094162.312353:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013843712:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094162.312718:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013843712:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 365us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094162.312725:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 991 00000100:00100000:1.0:1784094162.318196:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.318266:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843840 00000100:00100000:3.0:1784094162.318276:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843840 00000100:00100000:3.0:1784094162.318330:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 992 00000100:00100000:3.0:1784094162.318340:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013843840:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094162.318463:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013843840:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094162.318470:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 992 00000100:00100000:2.0:1784094162.319890:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.319927:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013843968 00000100:00100000:3.0:1784094162.319935:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013843968 00000100:00100000:3.0:1784094162.319981:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 505 00000100:00100000:3.0:1784094162.319990:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55506:x1870757013843968:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094162.320369:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55506:x1870757013843968:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 378us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094162.320376:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 505 00000100:00100000:3.0:1784094162.322682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094162.322830:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844096 00000100:00100000:2.0:1784094162.322839:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844096 00000100:00100000:2.0:1784094162.322936:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 506 00000100:00100000:2.0:1784094162.322948:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55506:x1870757013844096:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094162.323375:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55506:x1870757013844096:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 429us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094162.323384:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 506 00000100:00100000:3.0:1784094162.325506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.325547:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844224 00000100:00100000:3.0:1784094162.325555:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844224 00000100:00100000:3.0:1784094162.325612:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 993 00000100:00100000:3.0:1784094162.325624:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013844224:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094162.326593:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:55506:x1870757013844224:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 969us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094162.326605:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 993 00000100:00100000:0.0:1784094162.383919:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094162.384138:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844480 00000100:00100000:3.0:1784094162.384148:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844480 00000100:00100000:3.0:1784094162.384213:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 994 00000100:00100000:3.0:1784094162.384225:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:55510:x1870757013844480:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094162.384293:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094162.384323:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbdfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cd9 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.384355:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff90721a781d00) 00010000:00010000:3.0:1784094162.384368:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094162.384391:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.384403:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.384459:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.384475:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.384483:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.384492:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.385028:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.385039:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.385047:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094162.386346:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 64 off10176 00000004:00080000:3.0:1784094162.386360:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1323463937394ns, next at 1324463934337ns, rc = 0 00010000:00010000:3.0:1784094162.386519:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386532:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386541:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386549:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386555:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386560:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386644:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094162.386669:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386675:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386681:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386687:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094162.386690:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386697:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386707:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784094162.386710:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094162.386730:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386735:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386752:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386841:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386850:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386855:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094162.386859:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386869:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386878:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094162.386881:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094162.386884:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.386890:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094162.386900:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000042c51285 reply state 0000000051e1a07f transno 4294967678 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094162.386909:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094162.387004:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:55510:x1870757013844480:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2779us (3090us total) trans 4294967678 rc 0/0 00000100:00100000:3.0:1784094162.387013:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 994 00010000:00010000:2.0:1784094162.387124:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094162.387130:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094162.387137:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094162.387140:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094162.387147:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094162.387156:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094162.387158:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094162.387161:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094162.387171:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbe25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094162.387185:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094162.387187:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094162.387189:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094162.389570:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.389586:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.389593:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.389600:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094162.389604:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.389616:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.389630:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907204fce800) 00010000:00010000:3.0:1784094162.389633:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094162.389637:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.389644:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cbe17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094162.410396:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094162.922002:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094162.922026:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024333696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094162.922086:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094162.923622:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333696 00000100:00100000:0.0:1784094162.923633:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333696 00000100:00100000:0.0:1784094162.923699:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1784094162.923709:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024333696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094162.923745:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094162.923812:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024333696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094162.923819:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00080000:0.0:1784094162.923842:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094162.923946:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024333696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094163.433735:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094163.703692:0:92859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1324781266776ns, next at 1314759696278ns, rc = 0 00000004:00080000:2.0:1784094163.703850:0:92859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1324781427095ns, next at 1324463934337ns, rc = 0 00000004:00080000:1.0:1784094163.732092:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00000004:00080000:1.0:1784094163.732336:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 84 committed 00000001:00080000:1.0:1784094163.732365:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967678 is committed 00000004:00080000:1.0:1784094163.732370:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 81 committed 00000100:00100000:3.0:1784094163.732391:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024333824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784094163.732473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094163.732732:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024333824 00000100:00100000:3.0:1784094163.732740:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024333824 00000100:00100000:3.0:1784094163.732829:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1784094163.732840:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024333824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784094163.732865:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:31 count 1 00010000:00010000:3.0:1784094163.732886:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.732908:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.732918:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1784094163.732923:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094163.732928:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.732953:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.732968:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 5 pid: 6573 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094163.732980:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024333952:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094163.733041:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28c00 going to sleep for 11 seconds 00000100:00080000:0.0:1784094163.733215:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094163.735047:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094163.735093:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844608 00000100:00100000:1.0:1784094163.735100:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844608 00010000:00010000:1.0:1784094163.735142:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 6 pid: 6573 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094163.735147:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024333952:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094163.735171:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094163.735187:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 326 00000100:00100000:1.0:1784094163.735197:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013844608:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094163.735209:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094163.735216:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 6 pid: 6573 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094163.735560:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 6 pid: 6573 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094163.735588:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019eb6ea5/0x9ce98053214cbe09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce0 expref: 6 pid: 6573 timeout: 1424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094163.735600:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094163.735604:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094163.735608:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094163.735617:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094163.735639:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094163.735682:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b85450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013844608:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 486us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094163.735690:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 326 00010000:00010000:3.0:1784094163.735982:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.735991:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.736001:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.736010:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094163.736032:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094163.736138:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094163.736147:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094163.736157:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094163.736163:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094163.736173:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094163.736186:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094163.736205:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e11432b6/0x9ce98053214cbe2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094163.736224:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094163.736227:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094163.736229:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094163.739535:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024333824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6691us (7057us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1784094163.739549:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000004:00080000:1.0:1784094163.739659:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d23e300/2, rc 0, transno 4294967359 00000100:00100000:1.0:1784094163.739675:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024333824:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784094164.460717:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094165.374265:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094165.374318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094165.374593:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094165.374695:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094165.374729:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845120 00000100:00100000:1.0:1784094165.374738:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845120 00000100:00100000:1.0:1784094165.374795:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844992 00000100:00100000:1.0:1784094165.374798:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844992 00000100:00100000:1.0:1784094165.374820:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 681 00000100:00100000:1.0:1784094165.374830:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013845120:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094165.374901:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013845120:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094165.375006:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844736 00000100:00100000:0.0:1784094165.375011:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844736 00000100:00100000:0.0:1784094165.375043:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 850 00000100:00100000:0.0:1784094165.375051:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013844736:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094165.375089:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013844736:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094165.375096:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 850 00000100:00080000:0.0:1784094165.375222:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094165.375226:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094165.375263:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 681 00000100:00100000:3.0:1784094165.375393:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013844864 00000100:00100000:3.0:1784094165.375398:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013844864 00000100:00100000:3.0:1784094165.375454:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:3.0:1784094165.375462:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013844864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094165.375503:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013844864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 42us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094165.375510:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:2.0:1784094165.375738:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 682 00000100:00100000:2.0:1784094165.375748:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013844992:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094165.375780:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013844992:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 34us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094165.375787:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 682 00000100:00080000:2.0:1784094165.376359:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094165.482406:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094165.993603:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094165.993625:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024334080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094165.993687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094165.993765:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334080 00000100:00100000:0.0:1784094165.993772:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334080 00000100:00100000:0.0:1784094165.993823:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1784094165.993837:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024334080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094165.993870:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784094165.993926:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024334080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094165.993933:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1784094165.993954:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024334208:0@lo:400:kworker.0 00000100:00080000:2.0:1784094165.993980:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094165.993981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094165.993995:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024334336:0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994020:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024334080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094165.994023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094165.994037:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024334720:0@lo:400:kworker.0 00000100:00100000:2.0:1784094165.994042:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094165.994046:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024334464:0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094165.994070:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334336 00000100:00100000:2.0:1784094165.994074:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334336 00000100:00100000:0.0:1784094165.994075:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094165.994080:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024334592:0@lo:400:kworker.0 00000100:00100000:2.0:1784094165.994101:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334720 00000100:00100000:2.0:1784094165.994103:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334720 00000100:00100000:0.0:1784094165.994106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094165.994130:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1784094165.994137:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024334336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994138:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334208 00000100:00100000:0.0:1784094165.994141:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334208 00000100:00100000:0.0:1784094165.994169:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1784094165.994170:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024334336:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094165.994176:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094165.994188:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1784094165.994201:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1784094165.994207:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024334720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994225:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024334208:12345-0@lo:400:kworker.0 Request processed in 50us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094165.994231:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1784094165.994232:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024334720:12345-0@lo:400:kworker.0 Request processed in 27us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094165.994240:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00080000:2.0:1784094165.994259:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094165.994259:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334592 00000100:00100000:0.0:1784094165.994262:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334592 00000100:00100000:2.0:1784094165.994270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094165.994286:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024334720:0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994297:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784094165.994301:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024334336:0@lo:400:kworker.0 00000100:00100000:3.0:1784094165.994306:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024334208:0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994307:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024334592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094165.994319:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334464 00000100:00100000:2.0:1784094165.994323:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334464 00000100:00100000:2.0:1784094165.994361:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1784094165.994369:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024334464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094165.994380:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024334592:12345-0@lo:400:kworker.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094165.994386:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784094165.994405:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024334464:12345-0@lo:400:kworker.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094165.994411:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1784094165.994414:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024334592:0@lo:400:kworker.0 00000100:00080000:2.0:1784094165.994442:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094165.994445:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094165.994483:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024334464:0@lo:400:kworker.0 00010000:00010000:1.0:1784094166.505843:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094167.530067:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094167.590931:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00000100:00100000:3.0:1784094168.041770:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094168.041839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094168.041959:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334848 00000100:00100000:0.0:1784094168.041967:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334848 00000100:00100000:0.0:1784094168.042026:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1784094168.042036:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024334848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094168.042069:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094168.042118:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024334848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094168.042127:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00080000:2.0:1784094168.042129:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094168.042262:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024334848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094168.553740:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094169.577761:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094170.490984:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094170.491035:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094170.491468:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845248 00000100:00100000:2.0:1784094170.491483:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845248 00000100:00100000:2.0:1784094170.491545:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 852 00000100:00100000:2.0:1784094170.491556:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013845248:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094170.491638:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013845248:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 83us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094170.491647:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 852 00000100:00100000:0.0:1784094170.491762:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845376 00000100:00100000:0.0:1784094170.491766:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845376 00000100:00100000:0.0:1784094170.491805:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 910 00000100:00100000:0.0:1784094170.491812:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013845376:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094170.491841:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013845376:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 30us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094170.491852:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 910 00000100:00080000:0.0:1784094170.491897:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094170.494137:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094170.494603:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845504 00000100:00100000:0.0:1784094170.494612:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845504 00000100:00100000:0.0:1784094170.494701:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 684 00000100:00100000:0.0:1784094170.494710:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013845504:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094170.494765:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013845504:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094170.494772:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 684 00000100:00080000:2.0:1784094170.494814:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094170.500536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094170.500618:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845632 00000100:00100000:3.0:1784094170.500628:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845632 00000100:00100000:3.0:1784094170.500692:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 685 00000100:00100000:3.0:1784094170.500703:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013845632:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094170.500777:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013845632:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094170.500785:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 685 00000100:00080000:2.0:1784094170.500852:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784094170.602762:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094171.113738:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024334976:0@lo:400:kworker.0 00000100:00100000:2.0:1784094171.113757:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024335232:0@lo:400:kworker.0 00000100:00100000:0.0:1784094171.113880:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024335104:0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.113907:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024335360:0@lo:400:kworker.0 00000100:00100000:2.0:1784094171.113959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094171.113959:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094171.113987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094171.113998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094171.114022:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024335616:0@lo:400:kworker.0 00000100:00100000:1.0:1784094171.114031:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024335488:0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.114050:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335104 00000100:00100000:2.0:1784094171.114050:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335232 00000100:00100000:0.0:1784094171.114056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094171.114059:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335104 00000100:00100000:2.0:1784094171.114059:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335232 00000100:00100000:1.0:1784094171.114066:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094171.114112:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335488 00000100:00100000:3.0:1784094171.114116:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335488 00000100:00100000:0.0:1784094171.114133:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024334976 00000100:00100000:0.0:1784094171.114138:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024334976 00000100:00100000:3.0:1784094171.114149:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1784094171.114162:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1784094171.114163:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024335104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094171.114179:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:1.0:1784094171.114185:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094171.114190:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024334976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.114214:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024335104:12345-0@lo:400:kworker.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094171.114223:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1784094171.114261:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024335488:12345-0@lo:400:kworker.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094171.114264:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024334976:12345-0@lo:400:kworker.0 Request processed in 75us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094171.114265:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335360 00000100:00100000:3.0:1784094171.114270:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335360 00000100:00100000:0.0:1784094171.114275:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1784094171.114302:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335616 00000100:00100000:3.0:1784094171.114306:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335616 00000100:00100000:0.0:1784094171.114313:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1784094171.114322:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024335360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.114331:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1784094171.114341:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024335616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094171.114358:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1784094171.114363:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024335360:12345-0@lo:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094171.114372:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1784094171.114388:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024335616:12345-0@lo:400:kworker.0 Request processed in 49us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094171.114397:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1784094171.114412:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024335488:0@lo:400:kworker.0 00000100:00100000:0.0:1784094171.114413:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024335744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094171.114463:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024334976:0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.114492:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024335360:0@lo:400:kworker.0 00000100:00080000:3.0:1784094171.114525:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094171.114529:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094171.114532:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094171.114592:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1784094171.114601:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024335232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094171.114633:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024335232:12345-0@lo:400:kworker.0 Request processed in 35us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094171.114639:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1784094171.116546:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024335104:0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.116560:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:3.0:1784094171.116565:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d23e300, transno 4294967359 00000100:00100000:3.0:1784094171.116588:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024335616:0@lo:400:kworker.0 00000100:00100000:0.0:1784094171.117337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094171.117389:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024335232:0@lo:400:kworker.0 00000100:00100000:3.0:1784094171.117558:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335744 00000100:00100000:3.0:1784094171.117564:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335744 00000100:00100000:3.0:1784094171.117606:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1784094171.117614:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024335744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094171.117640:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094171.117685:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024335744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094171.117692:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1784094171.117731:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024335744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784094171.625876:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094172.649681:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094173.161820:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024335872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094173.161910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094173.162225:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024335872 00000100:00100000:1.0:1784094173.162240:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024335872 00000100:00100000:1.0:1784094173.162298:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1784094173.162305:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024335872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094173.162334:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784094173.162397:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094173.162685:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024335872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 380us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094173.162691:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1784094173.162757:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024335872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094173.673808:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094174.699449:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094175.609550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094175.609596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094175.609681:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094175.609713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094175.609744:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845888 00000100:00100000:2.0:1784094175.609755:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845888 00000100:00100000:0.0:1784094175.609775:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013845760 00000100:00100000:0.0:1784094175.609781:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013845760 00000100:00100000:2.0:1784094175.609830:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 914 00000100:00100000:0.0:1784094175.609830:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 854 00000100:00100000:2.0:1784094175.609846:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013845888:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094175.609847:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013845760:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094175.609922:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013845888:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094175.609931:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 914 00000100:00080000:2.0:1784094175.609953:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094175.610557:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013845760:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 715us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094175.610565:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 854 00000100:00100000:1.0:1784094175.611733:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846016 00000100:00100000:1.0:1784094175.611741:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846016 00000100:00100000:1.0:1784094175.611837:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846144 00000100:00100000:1.0:1784094175.611841:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846144 00000100:00100000:3.0:1784094175.611942:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00100000:3.0:1784094175.611953:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013846016:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094175.612006:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013846016:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 55us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094175.612014:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 688 00000100:00080000:2.0:1784094175.612109:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094175.612113:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094175.612212:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 689 00000100:00100000:1.0:1784094175.612221:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013846144:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094175.612255:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013846144:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094175.612263:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 689 00010000:00010000:2.0:1784094175.722208:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094176.233738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024336128:0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.233812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094176.233876:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024336640:0@lo:400:kworker.0 00000100:00100000:0.0:1784094176.233891:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336128 00000100:00100000:0.0:1784094176.233899:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336128 00000100:00100000:3.0:1784094176.233909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094176.233945:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784094176.233952:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1784094176.233963:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024336128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.233966:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024336256:0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.233998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094176.234051:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024336384:0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.234053:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024336768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094176.234057:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024336128:12345-0@lo:400:kworker.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094176.234069:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1784094176.234087:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336256 00000100:00100000:0.0:1784094176.234090:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336256 00000100:00100000:1.0:1784094176.234104:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094176.234107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094176.234124:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1784094176.234133:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024336256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094176.234141:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784094176.234171:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024336128:0@lo:400:kworker.0 00000100:00100000:0.0:1784094176.234187:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024336256:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094176.234195:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024336000:0@lo:400:kworker.0 00000100:00100000:0.0:1784094176.234197:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1784094176.234202:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024336256:0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.234227:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336640 00000100:00100000:3.0:1784094176.234231:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336640 00000100:00100000:1.0:1784094176.234236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094176.234270:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336384 00000100:00100000:3.0:1784094176.234274:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336384 00000100:00100000:3.0:1784094176.234296:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1784094176.234303:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024336640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.234341:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024336640:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094176.234347:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1784094176.234359:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1784094176.234365:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024336384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.234394:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024336384:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094176.234400:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1784094176.234445:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336768 00000100:00100000:3.0:1784094176.234449:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336768 00000100:00080000:2.0:1784094176.234544:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094176.234548:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094176.234550:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094176.234571:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336000 00000100:00100000:0.0:1784094176.234577:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336000 00000100:00100000:2.0:1784094176.234599:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024336640:0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.234669:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1784094176.234678:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024336768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094176.234706:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094176.234737:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1784094176.234743:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024336768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094176.234750:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024336000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094176.234756:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1784094176.234794:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024336000:12345-0@lo:400:kworker.0 Request processed in 48us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094176.234800:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1784094176.234881:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024336768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094176.235114:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024336000:0@lo:400:kworker.0 00000100:00100000:1.0:1784094176.235121:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024336512:0@lo:400:kworker.0 00000100:00100000:1.0:1784094176.235187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094176.235222:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024336384:0@lo:400:kworker.0 00000100:00100000:2.0:1784094176.235366:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336512 00000100:00100000:2.0:1784094176.235371:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336512 00000100:00100000:2.0:1784094176.235413:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1784094176.235437:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024336512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094176.235471:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024336512:12345-0@lo:400:kworker.0 Request processed in 52us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094176.235477:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00080000:0.0:1784094176.235543:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094176.237101:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024336512:0@lo:400:kworker.0 00010000:00010000:0.0:1784094176.745700:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094177.769595:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094178.281802:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094178.285826:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024336896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094178.285899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094178.286147:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024336896 00000100:00100000:1.0:1784094178.286155:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024336896 00000100:00100000:1.0:1784094178.286250:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1784094178.286259:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024336896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094178.286294:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094178.286346:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024336896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094178.286353:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00080000:0.0:1784094178.286992:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094178.287699:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024336896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094178.796751:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094179.817733:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094180.729494:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094180.729588:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094180.729624:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094180.729655:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094180.731117:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846656 00000100:00100000:1.0:1784094180.731128:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846656 00000100:00100000:1.0:1784094180.731194:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846528 00000100:00100000:1.0:1784094180.731197:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846528 00000100:00100000:1.0:1784094180.731224:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 692 00000100:00100000:1.0:1784094180.731233:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013846656:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094180.731299:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013846656:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 67us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094180.731307:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 692 00000100:00100000:1.0:1784094180.731336:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 693 00000100:00100000:1.0:1784094180.731344:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013846528:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094180.731368:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013846528:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 26us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094180.731374:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 693 00000100:00080000:2.0:1784094180.731446:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094180.731450:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094180.731546:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846272 00000100:00100000:3.0:1784094180.731551:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846272 00000100:00100000:3.0:1784094180.731584:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 856 00000100:00100000:3.0:1784094180.731591:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013846272:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094180.731616:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013846272:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 26us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094180.731622:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 856 00000100:00100000:0.0:1784094180.733136:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846400 00000100:00100000:0.0:1784094180.733144:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846400 00000100:00100000:0.0:1784094180.733254:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 918 00000100:00100000:0.0:1784094180.733263:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013846400:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094180.733317:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013846400:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094180.733333:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 918 00000100:00080000:2.0:1784094180.738272:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094180.843226:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094181.353709:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024337024:0@lo:400:kworker.0 00000100:00100000:2.0:1784094181.353788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094181.353901:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337024 00000100:00100000:3.0:1784094181.353910:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337024 00000100:00100000:0.0:1784094181.353944:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024337152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094181.353965:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1784094181.353975:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024337024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094181.354161:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024337024:12345-0@lo:400:kworker.0 Request processed in 187us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094181.354168:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1784094181.354215:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024337280:0@lo:400:kworker.0 00000100:00100000:3.0:1784094181.354250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094181.354287:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337280 00000100:00100000:3.0:1784094181.354291:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337280 00000100:00100000:0.0:1784094181.354311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094181.354323:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1784094181.354332:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024337280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.354364:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024337408:0@lo:400:kworker.0 00000100:00100000:3.0:1784094181.354373:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024337280:12345-0@lo:400:kworker.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094181.354380:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1784094181.354398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094181.354444:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024337280:0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.354469:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337152 00000100:00100000:3.0:1784094181.354474:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337408 00000100:00100000:0.0:1784094181.354475:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337152 00000100:00100000:3.0:1784094181.354480:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337408 00000100:00100000:1.0:1784094181.354581:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024337664:0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.354596:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1784094181.354606:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024337152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094181.354614:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1784094181.354639:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094181.354662:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337664 00000100:00100000:1.0:1784094181.354667:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337664 00000100:00100000:0.0:1784094181.354688:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024337152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094181.354696:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1784094181.354730:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024337024:0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.354730:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094181.354743:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024337536:0@lo:400:kworker.0 00000100:00100000:3.0:1784094181.354790:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:3.0:1784094181.354796:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024337408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094181.354828:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024337408:12345-0@lo:400:kworker.0 Request processed in 32us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094181.354834:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1784094181.354932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094181.355024:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024337408:0@lo:400:kworker.0 00000100:00100000:1.0:1784094181.355032:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1784094181.355043:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024337664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.355087:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024337152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094181.355094:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024337664:12345-0@lo:400:kworker.0 Request processed in 53us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094181.355102:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1784094181.355113:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024337664:0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.355146:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337536 00000100:00100000:0.0:1784094181.355215:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337536 00000100:00100000:0.0:1784094181.355266:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1784094181.355272:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024337536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094181.355311:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024337536:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094181.355318:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784094181.355334:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024337536:0@lo:400:kworker.0 00000100:00080000:2.0:1784094181.355404:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094181.355409:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094181.355411:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784094181.865911:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094182.664505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094182.664668:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846784 00000100:00100000:0.0:1784094182.664679:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846784 00000100:00080000:2.0:1784094182.664795:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094182.664835:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 995 00000100:00100000:0.0:1784094182.664846:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013846784:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094182.664957:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013846784:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 113us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094182.664966:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 995 00000100:00100000:3.0:1784094182.669127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094182.669310:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013846912 00000100:00100000:1.0:1784094182.669321:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013846912 00000100:00100000:1.0:1784094182.669404:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 508 00000100:00100000:1.0:1784094182.669416:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013846912:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094182.669828:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013846912:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 413us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094182.669837:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 508 00000100:00080000:2.0:1784094182.669923:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094182.671704:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094182.671859:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847040 00000100:00100000:3.0:1784094182.671868:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847040 00000100:00100000:3.0:1784094182.671927:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 509 00000100:00100000:3.0:1784094182.671936:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013847040:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:2.0:1784094182.672051:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094182.672215:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013847040:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 280us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094182.672224:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 509 00000100:00100000:3.0:1784094182.674102:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094182.674297:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847168 00000100:00100000:1.0:1784094182.674306:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847168 00000100:00100000:1.0:1784094182.674357:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 996 00000100:00100000:1.0:1784094182.674368:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013847168:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094182.674748:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013847168:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 381us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094182.674756:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 996 00000100:00100000:0.0:1784094182.677551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094182.677705:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847296 00000100:00100000:1.0:1784094182.677714:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847296 00000100:00100000:1.0:1784094182.677764:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 997 00000100:00100000:1.0:1784094182.677775:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013847296:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094182.681119:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013847296:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 3332us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094182.681131:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 997 00000100:00100000:3.0:1784094182.684014:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094182.685934:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847424 00000100:00100000:0.0:1784094182.685946:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847424 00000100:00100000:0.0:1784094182.686008:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 510 00000100:00100000:0.0:1784094182.686017:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013847424:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094182.686393:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013847424:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 376us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094182.686402:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 510 00000100:00100000:2.0:1784094182.688365:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094182.688540:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847552 00000100:00100000:1.0:1784094182.688549:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847552 00000100:00100000:1.0:1784094182.688633:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 511 00000100:00100000:1.0:1784094182.688642:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013847552:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094182.688946:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:55848:x1870757013847552:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 304us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094182.688954:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 511 00000100:00100000:3.0:1784094182.691777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094182.691809:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847680 00000100:00100000:3.0:1784094182.691817:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847680 00000100:00100000:3.0:1784094182.691875:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 998 00000100:00100000:3.0:1784094182.691884:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013847680:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094182.692221:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:55848:x1870757013847680:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 337us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094182.692229:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 998 00010000:00010000:1.0:1784094182.890359:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094183.405257:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094183.405278:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024337792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094183.405346:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094183.405405:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337792 00000100:00100000:1.0:1784094183.405413:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337792 00000100:00100000:1.0:1784094183.405491:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1784094183.405500:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024337792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094183.405535:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094183.405582:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024337792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094183.405589:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00080000:1.0:1784094183.405610:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094183.405645:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024337792:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094183.913817:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094184.211103:0:93271:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc11db940 20000000:00000080:0.0:1784094184.211120:0:93271:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb15000 uarg=0000000000000000 00010000:00010000:0.0:1784094184.211696:0:93271:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094184.211728:0:93271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcef00) 00010000:00010000:0.0:1784094184.211732:0:93271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094184.211743:0:93271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbddf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cd2 expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094184.211764:0:93271:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784094184.211778:0:93271:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094184.211791:0:93271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094184.211804:0:93271:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094184.211814:0:93271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094184.211848:0:93271:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094184.211861:0:93271:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 18 pid: 5772 timeout: 1495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094184.211882:0:93271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93271:1870757024337920:0@lo:104: 00000100:00100000:0.0:1784094184.211938:0:93271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094184.212039:0:93271:0:(client.c:2702:ptlrpc_set_wait()) set ffff907226004a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784094184.212135:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024337920 00000100:00100000:2.0:1784094184.212142:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024337920 00000100:00100000:2.0:1784094184.212227:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1784094184.212238:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:93271:x1870757024337920:12345-0@lo:104: 00010000:00010000:2.0:1784094184.212251:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094184.212322:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094184.212328:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:93271:x1870757024337920:12345-0@lo:104: Request processed in 93us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094184.212335:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00010000:1.0:1784094184.212377:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094184.212385:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212393:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094184.212397:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212405:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094184.212412:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094184.212418:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094184.212582:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212589:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094184.212606:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212614:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214cbdbc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbdc3 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212627:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094184.212629:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094184.212630:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094184.212647:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024338048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094184.212678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094184.212707:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338048 00000100:00100000:1.0:1784094184.212710:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338048 00010000:00010000:1.0:1784094184.212728:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 19 pid: 5772 timeout: 1495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094184.212749:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1784094184.212755:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024338048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094184.212765:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094184.212770:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 19 pid: 5772 timeout: 1495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212780:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 19 pid: 5772 timeout: 1495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212799:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212808:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212820:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212828:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212835:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212841:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212846:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094184.212850:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212858:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212867:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094184.212876:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094184.212909:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024338048:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094184.212916:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1784094184.212953:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024338048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094184.213135:0:93271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214cbdc3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbdbc expref: 18 pid: 5772 timeout: 1495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094184.213145:0:93271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93271:1870757024337920:0@lo:104: 00010000:00010000:3.0:1784094184.213158:0:93271:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094184.213166:0:93271:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094184.213172:0:93271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094184.213177:0:93271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77c00/0x9ce98053214cbe33 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094184.940780:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094185.848525:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094185.848560:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094185.848595:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094185.848622:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094185.848649:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847808 00000100:00100000:3.0:1784094185.848659:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847808 00000100:00100000:3.0:1784094185.848708:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 858 00000100:00100000:3.0:1784094185.848719:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013847808:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094185.848815:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013847808:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094185.848823:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 858 00000100:00100000:3.0:1784094185.848861:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013848192 00000100:00100000:3.0:1784094185.848865:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013848192 00000100:00100000:3.0:1784094185.848900:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013848064 00000100:00100000:3.0:1784094185.848904:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013848064 00000100:00100000:3.0:1784094185.848926:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:3.0:1784094185.848933:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013848192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094185.848975:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013848192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094185.848982:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 695 00000100:00100000:3.0:1784094185.848995:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 696 00000100:00100000:3.0:1784094185.849001:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013848064:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094185.849030:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013848064:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094185.849036:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 696 00000100:00080000:3.0:1784094185.849151:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094185.849155:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094185.849248:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013847936 00000100:00100000:0.0:1784094185.849252:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013847936 00000100:00100000:0.0:1784094185.849284:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 922 00000100:00100000:0.0:1784094185.849290:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013847936:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094185.849328:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013847936:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094185.849335:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 922 00000100:00080000:3.0:1784094185.849628:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094185.961591:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094186.116912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094186.117000:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013848320 00000100:00100000:1.0:1784094186.117011:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013848320 00000100:00100000:1.0:1784094186.117068:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 999 00000100:00100000:1.0:1784094186.117079:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:55934:x1870757013848320:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094186.117100:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094186.117122:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cbe3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ce7 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.117185:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbe41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.117200:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbe41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.117212:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbe41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094186.117403:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1784094186.117408:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094186.117691:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbe41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.117717:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cbe3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce7 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.117736:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbe41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce7 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.117744:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094186.117747:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094186.117750:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784094186.117858:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:55934:x1870757013848320:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 779us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094186.117866:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 999 00000100:00100000:2.0:1784094186.120867:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094186.121097:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013848576 00000100:00100000:3.0:1784094186.121106:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013848576 00000100:00100000:3.0:1784094186.121157:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1000 00000100:00100000:3.0:1784094186.121166:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55934:x1870757013848576:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094186.121209:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094186.121233:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cbe41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ce7 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.121249:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbddf) 00010000:00010000:3.0:1784094186.121253:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12a00) 00010000:00010000:3.0:1784094186.121263:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094186.121285:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.121296:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.121306:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094186.147270:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967679 is committed 00000004:00010000:3.0:1784094186.147658:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000000a3986e5 reply state 00000000927d94e3 transno 4294967679 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094186.147672:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094186.148490:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00080000:3.0:1784094186.148631:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784094186.148680:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:55934:x1870757013848576:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 27510us (27814us total) trans 4294967679 rc 0/0 00000100:00100000:3.0:1784094186.148689:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1000 00010000:00010000:2.0:1784094186.148752:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.148762:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.148836:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.148844:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094186.148849:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.148857:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.148978:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fce300) 00010000:00010000:2.0:1784094186.148982:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094186.148988:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.148995:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cbe48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094186.217490:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094186.217509:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094186.217516:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094186.217571:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.217584:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.217597:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094186.217631:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024338176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094186.217702:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094186.217828:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220dfa180 going to sleep for 11 seconds 00000100:00100000:3.0:1784094186.219836:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338176 00000100:00100000:3.0:1784094186.219848:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338176 00000100:00100000:3.0:1784094186.220002:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1784094186.220024:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024338176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094186.220042:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094186.220060:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbe4f expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.220086:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.220097:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.220107:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784094186.220187:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024338176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094186.220194:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1784094186.220291:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024338176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094186.220310:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.220331:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094186.220353:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094186.220359:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.220366:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094186.473618:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024338432:0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.473692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094186.473758:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094186.473764:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024338560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.473791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094186.473828:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338432 00000100:00100000:1.0:1784094186.473834:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338432 00000100:00100000:0.0:1784094186.473992:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024338688:0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.474030:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1784094186.474044:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094186.474067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094186.474144:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024338304:0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.474577:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024338432:12345-0@lo:400:kworker.0 Request processed in 536us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094186.474585:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1784094186.474604:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338688 00000100:00100000:1.0:1784094186.474608:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338688 00000100:00100000:1.0:1784094186.474639:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1784094186.474646:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024338688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.474682:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024338688:12345-0@lo:400:kworker.0 Request processed in 37us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094186.474688:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1784094186.474710:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338560 00000100:00100000:1.0:1784094186.474714:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338560 00000100:00100000:1.0:1784094186.474746:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1784094186.474757:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024338560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.474926:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024338560:12345-0@lo:400:kworker.0 Request processed in 110us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094186.474935:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00080000:1.0:1784094186.474966:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094186.474971:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094186.475018:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024338560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.475034:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024338432:0@lo:400:kworker.0 00000100:00100000:0.0:1784094186.475179:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024338688:0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.475368:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094186.475379:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024338944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094186.475411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094186.475491:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338944 00000100:00100000:0.0:1784094186.475496:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338944 00000100:00100000:0.0:1784094186.475535:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1784094186.475542:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024338944:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784094186.475571:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1784094186.475572:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094186.475667:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094186.475676:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024338944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094186.475696:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024338816:0@lo:400:kworker.0 00000100:00100000:0.0:1784094186.475730:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024338944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094186.475735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094186.475744:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1784094186.475804:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338816 00000100:00100000:1.0:1784094186.475809:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338816 00000100:00100000:2.0:1784094186.475839:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024338304 00000100:00100000:2.0:1784094186.475845:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024338304 00000100:00100000:1.0:1784094186.475845:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1784094186.475857:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024338816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094186.475898:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024338816:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094186.475906:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1784094186.475934:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024338816:0@lo:400:kworker.0 00000100:00100000:2.0:1784094186.475961:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1784094186.475972:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024338304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094186.476020:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024338304:12345-0@lo:400:kworker.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094186.476028:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1784094186.476095:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024338304:0@lo:400:kworker.0 00000020:00000080:2.0:1784094186.672693:0:93468:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd16bbbac0 20000000:00000080:2.0:1784094186.672709:0:93468:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723d734800 uarg=0000000000000000 00010000:00010000:2.0:1784094186.673321:0:93468:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094186.673335:0:93468:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094186.673348:0:93468:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094186.673368:0:93468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.673391:0:93468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.673399:0:93468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.673538:0:93468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.673554:0:93468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 18 pid: 5772 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094186.673570:0:93468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93468:1870757024339072:0@lo:104: 00000100:00100000:2.0:1784094186.673629:0:93468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094186.673723:0:93468:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093afb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784094186.673767:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339072 00000100:00100000:3.0:1784094186.673774:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339072 00000100:00100000:3.0:1784094186.673882:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784094186.673891:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:93468:x1870757024339072:12345-0@lo:104: 00010000:00010000:3.0:1784094186.674248:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094186.674363:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094186.674370:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:93468:x1870757024339072:12345-0@lo:104: Request processed in 480us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094186.674378:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00010000:1.0:1784094186.674461:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094186.674468:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.674477:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094186.674482:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.674491:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094186.674498:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094186.674503:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094186.674531:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.674537:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094186.674560:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.674568:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cbe4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbe56 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.674587:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094186.674590:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094186.674593:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094186.674605:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024339200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094186.674636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094186.674704:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339200 00000100:00100000:0.0:1784094186.674711:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339200 00010000:00010000:0.0:1784094186.674739:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 19 pid: 5772 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094186.674780:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784094186.674788:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024339200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094186.674799:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094186.674804:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 19 pid: 5772 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674815:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 19 pid: 5772 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674831:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674840:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674853:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674860:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674867:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674874:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674880:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094186.674884:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674892:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674901:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094186.674910:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094186.674963:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024339200:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094186.674971:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1784094186.674993:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024339200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094186.675081:0:93468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbe56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbe4f expref: 18 pid: 5772 timeout: 1497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094186.675091:0:93468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93468:1870757024339072:0@lo:104: 00010000:00010000:2.0:1784094186.675104:0:93468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.675113:0:93468:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.675120:0:93468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094186.675190:0:93468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41400/0x9ce98053214cbe5d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094186.986515:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094188.009688:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094188.407114:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094188.407186:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013848704 00000100:00100000:1.0:1784094188.407195:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013848704 00000100:00100000:1.0:1784094188.407253:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1001 00000100:00100000:1.0:1784094188.407263:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56011:x1870757013848704:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094188.407284:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094188.407304:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbe64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cee expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407358:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407371:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407384:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407395:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407402:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407409:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407793:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbe79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407802:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbe79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407809:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbe79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094188.407878:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1784094188.407882:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094188.407959:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbe79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407972:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407979:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407986:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.407997:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094188.408001:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408008:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408018:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094188.408021:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094188.408025:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408031:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbe6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408040:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408047:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408053:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408058:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094188.408061:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408066:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408077:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12300) 00010000:00010000:1.0:1784094188.408079:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094188.408082:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408087:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbe72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408110:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbe64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cee expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408123:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbe79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cee expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.408130:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784094188.408132:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094188.408134:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094188.408191:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:56011:x1870757013848704:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 929us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094188.408198:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1001 00000100:00080000:3.0:1784094188.408369:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094188.415382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094188.415417:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013848960 00000100:00100000:3.0:1784094188.415449:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013848960 00000100:00100000:3.0:1784094188.415493:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1002 00000100:00100000:3.0:1784094188.415501:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:56011:x1870757013848960:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784094188.415521:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094188.415538:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cf5 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.415791:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.415806:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.415816:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.415829:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.415837:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.415844:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094188.416516:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:3.0:1784094188.416739:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbe95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416749:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbe95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416757:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbe95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416787:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416794:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416801:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416807:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094188.416810:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416818:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416828:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784094188.416831:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094188.416836:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416843:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cbe87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094188.416853:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000024d1aa9b reply state 000000001a4092ae transno 4294967680 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094188.416862:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094188.416888:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cbe80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cf5 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416900:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbe95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cf5 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.416907:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784094188.416909:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094188.416912:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094188.416984:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:56011:x1870757013848960:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1483us (1609us total) trans 4294967680 rc 0/0 00000100:00100000:3.0:1784094188.416992:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1002 00000100:00100000:3.0:1784094188.421237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:2.0:1784094188.421468:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421481:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421489:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421495:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094188.421500:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421507:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421525:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907204fce700) 00010000:00010000:2.0:1784094188.421528:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094188.421532:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421543:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cbe8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094188.421579:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013849216 00000100:00100000:2.0:1784094188.421589:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013849216 00000100:00100000:2.0:1784094188.421634:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1003 00000100:00100000:2.0:1784094188.421643:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:56011:x1870757013849216:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:2.0:1784094188.421697:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094188.421715:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cbe95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cf5 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421726:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff907204fce100) 00010000:00010000:2.0:1784094188.421733:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094188.421772:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421784:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.421794:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094188.421938:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f530d0fb reply state 000000000fa0aec7 transno 4294967681 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094188.421947:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094188.422031:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:56011:x1870757013849216:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 387us (802us total) trans 4294967681 rc 0/0 00000100:00100000:2.0:1784094188.422038:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1003 00000100:00100000:0.0:1784094188.431208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:3.0:1784094188.431267:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.431280:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.431288:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.431294:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094188.431299:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.431306:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.431322:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784094188.431326:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094188.431331:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.431338:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbea3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094188.431396:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013849344 00000100:00100000:2.0:1784094188.431405:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013849344 00000100:00100000:2.0:1784094188.431474:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1004 00000100:00100000:2.0:1784094188.431484:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:56011:x1870757013849344:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784094188.431506:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094188.431523:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbeaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5cfc expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.431573:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbeaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cfc expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.431586:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbeaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cfc expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.431602:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784094188.431605:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784094188.431607:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784094188.431655:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:56011:x1870757013849344:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 172us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094188.431663:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1004 00000100:00100000:3.0:1784094188.435075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094188.435165:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013849472 00000100:00100000:2.0:1784094188.435175:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013849472 00000100:00100000:2.0:1784094188.435242:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 512 00000100:00100000:2.0:1784094188.435258:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013849472:12345-192.168.204.57@tcp:2:touch.60003 00000100:00080000:3.0:1784094188.435461:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094188.435694:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013849472:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 441us (624us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1784094188.435704:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 512 00000100:00100000:2.0:1784094188.437977:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094188.438056:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013849728 00000100:00100000:0.0:1784094188.438064:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013849728 00000100:00100000:0.0:1784094188.438109:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 102 00000100:00100000:0.0:1784094188.438116:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:56011:x1870757013849728:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:0.0:1784094188.438414:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:56011:x1870757013849728:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 297us (444us total) trans 4294967682 rc 0/0 00000100:00100000:0.0:1784094188.438483:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 102 00000100:00100000:3.0:1784094188.471346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094188.471474:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013849856 00000100:00100000:1.0:1784094188.471488:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013849856 00000100:00100000:1.0:1784094188.471547:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1005 00000100:00100000:1.0:1784094188.471556:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:56015:x1870757013849856:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094188.471576:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094188.471593:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbeb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d03 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471643:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471654:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471661:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471670:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471674:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471678:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471758:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471767:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471773:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094188.471801:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 0 00000004:00200000:1.0:1784094188.471960:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094188.471985:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.471999:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472007:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472013:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472019:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472026:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094188.472030:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472038:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472048:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784094188.472050:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094188.472053:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472057:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbeb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472069:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472075:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472082:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472087:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094188.472089:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472094:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472101:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907219c12900) 00010000:00010000:1.0:1784094188.472103:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094188.472106:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472111:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472140:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbeb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d03 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472153:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d03 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.472160:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff90721a781200) 00010000:00010000:1.0:1784094188.472162:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094188.472164:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094188.472264:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:56015:x1870757013849856:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 707us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094188.472276:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1005 00000100:00100000:3.0:1784094188.474538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094188.474605:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013849984 00000100:00100000:1.0:1784094188.474613:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013849984 00000100:00100000:1.0:1784094188.474655:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00100000:1.0:1784094188.474664:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013849984:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094188.474679:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094188.474695:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d0a expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094188.474718:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x6a571dec, atime: 0x6a571dec, ctime: 0x6a571dec, blocks: 0x1 00010000:00010000:1.0:1784094188.474773:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=1349s v=(0 0) 00010000:00010000:1.0:1784094188.474779:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094188.474788:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.474807:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.474820:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784094188.474867:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013849984:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 205us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094188.474873:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 513 00000100:00100000:2.0:1784094188.478684:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094188.478794:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013850240 00000100:00100000:1.0:1784094188.478804:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013850240 00000100:00100000:1.0:1784094188.479053:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1006 00000100:00100000:1.0:1784094188.479148:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:56015:x1870757013850240:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:1.0:1784094188.479199:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784094188.479226:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cbec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d03 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479247:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbeaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cfc expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479260:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff90721a781200) 00010000:00010000:1.0:1784094188.479270:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094188.479293:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479307:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479316:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479331:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479338:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479345:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479498:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479508:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.479517:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094188.480091:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10240 00000004:00080000:1.0:1784094188.480107:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1349557680622ns, next at 1350557678439ns, rc = 0 00010000:00010000:1.0:1784094188.480166:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480176:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480184:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480192:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480198:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480204:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480229:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094188.480249:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480256:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480262:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480268:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094188.480273:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480280:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480289:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094188.480292:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784094188.480296:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480302:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cbee2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480317:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480323:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480330:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480336:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094188.480339:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480345:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480357:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784094188.480359:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094188.480363:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.480369:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cbed4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094188.480377:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000290b0a2c reply state 000000001c31231c transno 4294967683 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094188.480384:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094188.480494:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:56015:x1870757013850240:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1348us (1817us total) trans 4294967683 rc 0/0 00000100:00100000:1.0:1784094188.480502:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1006 00010000:00010000:2.0:1784094188.480578:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094188.480584:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.480591:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094188.480595:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.480607:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.480616:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff907219c12000) 00010000:00010000:2.0:1784094188.480618:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094188.480621:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.480627:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cbee9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094188.480641:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094188.480642:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094188.480644:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094188.483161:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094188.483176:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094188.483183:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094188.483189:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094188.483194:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094188.483202:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094188.483217:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907219c12900) 00010000:00010000:0.0:1784094188.483221:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094188.483225:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094188.483231:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cbedb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094188.521961:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024339328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094188.522034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094188.522175:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339328 00000100:00100000:1.0:1784094188.522183:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339328 00000100:00100000:1.0:1784094188.522254:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1784094188.522264:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024339328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094188.522301:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784094188.522354:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094188.522392:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024339328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094188.522402:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1784094188.526092:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024339328:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784094188.649557:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094188.649565:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094188.649570:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094188.649617:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.649629:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.649640:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094188.649667:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024339456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094188.649938:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094188.650065:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784094188.650130:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339456 00000100:00100000:1.0:1784094188.650138:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339456 00000100:00100000:1.0:1784094188.650190:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1784094188.650200:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024339456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094188.650214:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094188.650228:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbef0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.650249:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.650259:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094188.650267:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13600, rc 0) 00000100:00100000:1.0:1784094188.650368:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024339456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094188.650375:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1784094188.650563:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024339456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094188.650579:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.650594:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094188.650612:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094188.650618:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094188.650625:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094189.034549:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094189.319679:0:93713:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3b41f2f0 20000000:00000080:3.0:1784094189.319695:0:93713:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e232800 uarg=0000000000000000 00010000:00010000:3.0:1784094189.319934:0:93713:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784094189.319969:0:93713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784094189.319973:0:93713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094189.319985:0:93713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbe79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5cee expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.320008:0:93713:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784094189.320025:0:93713:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094189.320039:0:93713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.320053:0:93713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.320062:0:93713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.320101:0:93713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.320114:0:93713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 18 pid: 5770 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094189.320129:0:93713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93713:1870757024339584:0@lo:104: 00000100:00100000:3.0:1784094189.320188:0:93713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094189.320243:0:93713:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722d981d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784094189.320307:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339584 00000100:00100000:2.0:1784094189.320314:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339584 00000100:00100000:2.0:1784094189.320389:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784094189.320399:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:93713:x1870757024339584:12345-0@lo:104: 00010000:00010000:2.0:1784094189.320411:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094189.320659:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094189.320665:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:93713:x1870757024339584:12345-0@lo:104: Request processed in 268us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094189.320673:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00010000:1.0:1784094189.320684:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094189.320693:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.320702:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094189.320706:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.320715:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094189.320723:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094189.320730:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1784094189.320740:0:93713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93713:1870757024339584:0@lo:104: 00010000:00010000:3.0:1784094189.320760:0:93713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.320771:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.320785:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094189.320817:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094189.320825:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1784094189.320826:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cbef0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbef7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094189.320840:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024339712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094189.320856:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094189.320860:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094189.320871:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094189.320875:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094189.320919:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339712 00000100:00100000:1.0:1784094189.320924:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339712 00010000:00010000:1.0:1784094189.320948:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 19 pid: 5770 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094189.320983:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1784094189.320991:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024339712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094189.321002:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094189.321007:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 19 pid: 5770 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321018:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 19 pid: 5770 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321029:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214cbef7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbef0 expref: 19 pid: 5770 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321040:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321052:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321064:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321071:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321079:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321085:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321091:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094189.321095:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321102:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321119:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094189.321129:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094189.321138:0:93713:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.321148:0:93713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094189.321154:0:93713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbefe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094189.321174:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024339712:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094189.321183:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1784094189.321482:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024339712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094190.057557:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094190.651130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094190.651201:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013850368 00000100:00100000:1.0:1784094190.651213:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013850368 00000100:00100000:1.0:1784094190.651296:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1007 00000100:00100000:1.0:1784094190.651309:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:56102:x1870757013850368:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094190.651348:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094190.651380:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbf05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d11 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784094190.651439:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094190.651490:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbf0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.651506:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbf0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.651520:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbf0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094190.651582:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:1.0:1784094190.651586:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094190.651615:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbf0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.651642:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cbf05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d11 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.651661:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbf0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d11 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.651670:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784094190.651673:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094190.651677:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784094190.651745:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:56102:x1870757013850368:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 438us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094190.651753:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1007 00000100:00100000:2.0:1784094190.656006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094190.656045:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013850624 00000100:00100000:2.0:1784094190.656055:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013850624 00000100:00100000:2.0:1784094190.656110:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1008 00000100:00100000:2.0:1784094190.656121:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:56102:x1870757013850624:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094190.656172:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094190.656204:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cbf0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d11 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.656222:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbe79) 00010000:00010000:2.0:1784094190.656226:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784094190.656240:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094190.656268:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.656281:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.656291:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094190.683017:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000cfe5e124 reply state 00000000322c48c5 transno 4294967684 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094190.683033:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1784094190.683035:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967682 is committed 00000001:00080000:0.0:1784094190.683049:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967683 is committed 00000004:00080000:0.0:1784094190.683054:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 85 committed 00000001:00080000:0.0:1784094190.683073:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967684 is committed 00000004:00200000:1.0:1784094190.683198:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00080000:1.0:1784094190.683288:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784094190.683289:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024339840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784094190.683305:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:56102:x1870757013850624:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 27184us (27307us total) trans 4294967684 rc 0/0 00000100:00100000:1.0:1784094190.683315:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1008 00010000:00010000:1.0:1784094190.683351:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094190.683352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094190.683363:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.683371:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.683378:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094190.683383:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.683390:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.683410:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784094190.683413:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094190.683418:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.683441:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cbf13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094190.683462:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024339840 00000100:00100000:0.0:1784094190.683470:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024339840 00000100:00080000:1.0:1784094190.683501:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094190.683537:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784094190.683546:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024339840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784094190.683570:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:0.0:1784094190.683591:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094190.683611:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094190.683620:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784094190.683625:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094190.683629:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094190.683658:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094190.683673:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 6 pid: 53396 timeout: 1451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094190.683685:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024339968:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784094190.683735:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723e32b300 going to sleep for 11 seconds 00000100:00100000:3.0:1784094190.687531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094190.687613:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024339968:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094190.687638:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094190.687866:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013850752 00000100:00100000:1.0:1784094190.687884:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013850752 00000100:00080000:3.0:1784094190.687930:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784094190.687933:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 7 pid: 53396 timeout: 1451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094190.688084:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 330 00000100:00100000:1.0:1784094190.688097:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013850752:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094190.688112:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094190.688119:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 7 pid: 53396 timeout: 1451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.688133:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 7 pid: 53396 timeout: 1451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.688155:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1cce25a/0x9ce98053214cbecd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d0a expref: 7 pid: 53396 timeout: 1451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.688169:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094190.688173:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094190.688178:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.688198:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094190.688224:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094190.688249:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094190.688261:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094190.688273:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094190.688282:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013850752:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 186us (758us total) trans 0 rc 0/0 00010000:00010000:0.0:1784094190.688284:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094190.688298:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 330 00010000:00010000:0.0:1784094190.688317:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784094190.688806:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024339840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5260us (5453us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1784094190.688814:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00010000:00010000:3.0:1784094190.688899:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094190.688906:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.688922:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094190.688927:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.688937:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094190.688950:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d263b80/2, rc 0, transno 4294967361 00000100:00100000:1.0:1784094190.688958:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024339840:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784094190.688991:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.688999:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b6efc83/0x9ce98053214cbf1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.689015:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094190.689017:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094190.689019:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784094190.762479:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094190.762485:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094190.762489:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094190.762530:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.762542:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.762558:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094190.762582:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024340096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094190.762647:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094190.762693:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486180 going to sleep for 11 seconds 00000100:00100000:3.0:1784094190.762764:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340096 00000100:00100000:3.0:1784094190.762773:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340096 00000100:00100000:3.0:1784094190.762830:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1784094190.762839:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024340096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094190.762853:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094190.762867:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbf21 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.762905:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.762922:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094190.762932:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094190.762980:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024340096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094190.762988:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1784094190.763074:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d261f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024340096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094190.763089:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.763098:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094190.763117:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094190.763122:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094190.763129:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094190.970888:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094190.970941:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094190.970965:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013850880 00000100:00100000:1.0:1784094190.970978:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013850880 00000100:00100000:2.0:1784094190.970989:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094190.971003:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851008 00000100:00100000:3.0:1784094190.971011:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851008 00000100:00100000:1.0:1784094190.971048:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1009 00000100:00100000:1.0:1784094190.971062:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013850880:12345-192.168.204.57@tcp:17:kworker.0 00000100:00100000:3.0:1784094190.971064:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 862 00000100:00100000:3.0:1784094190.971080:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013851008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094190.971118:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851136 00000100:00100000:0.0:1784094190.971124:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851136 00000100:00100000:0.0:1784094190.971212:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00100000:0.0:1784094190.971223:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013851136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094190.971348:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013851008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 270us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094190.971351:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013850880:12345-192.168.204.57@tcp:17:kworker.0 Request processed in 291us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094190.971362:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 862 00000100:00100000:1.0:1784094190.971367:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1009 00000100:00100000:0.0:1784094190.971404:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013851136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 182us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094190.971411:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 699 00000100:00080000:0.0:1784094190.971469:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1784094191.062556:0:93908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe167ef960 20000000:00000080:1.0:1784094191.062572:0:93908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720b846000 uarg=0000000000000000 00010000:00010000:1.0:1784094191.063104:0:93908:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094191.063120:0:93908:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094191.063132:0:93908:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094191.063149:0:93908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094191.063165:0:93908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094191.063175:0:93908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094191.063212:0:93908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094191.063227:0:93908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 18 pid: 5772 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094191.063242:0:93908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93908:1870757024340224:0@lo:104: 00000100:00100000:1.0:1784094191.063302:0:93908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094191.063405:0:93908:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230839840 going to sleep for 11 seconds 00000100:00100000:2.0:1784094191.063591:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340224 00000100:00100000:2.0:1784094191.063598:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340224 00000100:00100000:2.0:1784094191.063678:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784094191.063688:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:93908:x1870757024340224:12345-0@lo:104: 00010000:00010000:2.0:1784094191.063701:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.063760:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094191.063766:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:93908:x1870757024340224:12345-0@lo:104: Request processed in 80us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094191.063772:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1784094191.063828:0:93908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93908:1870757024340224:0@lo:104: 00010000:00010000:1.0:1784094191.063843:0:93908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.063909:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094191.063915:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.063923:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094191.063926:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.063934:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094191.063942:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094191.063948:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094191.064014:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064021:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784094191.064066:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024340352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094191.064094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784094191.064146:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064155:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cbf21 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf28 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064169:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094191.064171:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094191.064172:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094191.064507:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340352 00000100:00100000:2.0:1784094191.064513:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340352 00010000:00010000:2.0:1784094191.064533:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 19 pid: 5772 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094191.064553:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1784094191.064559:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024340352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094191.064570:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094191.064574:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 19 pid: 5772 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064583:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 19 pid: 5772 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064595:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69000/0x9ce98053214cbf28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbf21 expref: 19 pid: 5772 timeout: 1502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064608:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064616:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064628:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064639:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064647:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064653:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064658:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094191.064662:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.064671:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094191.064816:0:93908:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094191.064824:0:93908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.071164:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.071185:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214cbf2f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094191.071207:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094191.071296:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024340352:12345-0@lo:103:ldlm_bl.0 Request processed in 6734us (7197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094191.071309:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784094191.071494:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024340352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094191.082795:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094191.594151:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024340864:0@lo:400:kworker.0 00000100:00100000:0.0:1784094191.594221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094191.594259:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340864 00000100:00100000:1.0:1784094191.594267:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340864 00000100:00100000:0.0:1784094191.594278:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094191.594286:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024340992:0@lo:400:kworker.0 00000100:00100000:1.0:1784094191.594319:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1784094191.594331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094191.594332:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024340864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094191.594371:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340992 00000100:00100000:0.0:1784094191.594377:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340992 00000100:00100000:3.0:1784094191.594395:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024340480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094191.594406:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024340864:12345-0@lo:400:kworker.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094191.594415:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1784094191.594449:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1784094191.594461:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024340992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094191.594545:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024340864:0@lo:400:kworker.0 00000100:00100000:3.0:1784094191.594606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094191.594628:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024340992:12345-0@lo:400:kworker.0 Request processed in 170us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094191.594637:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1784094191.594647:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340480 00000100:00100000:1.0:1784094191.594651:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340480 00000100:00100000:3.0:1784094191.594655:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024340608:0@lo:400:kworker.0 00000100:00080000:0.0:1784094191.594666:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094191.594672:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094191.594684:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1784094191.594687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094191.594694:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024340480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094191.594708:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024341120:0@lo:400:kworker.0 00000100:00100000:0.0:1784094191.594715:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340608 00002000:00000024:1.0:1784094191.594718:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094191.594721:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340608 00000100:00100000:3.0:1784094191.594731:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094191.594757:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024340480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094191.594762:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1784094191.594775:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024340480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094191.594787:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094191.594793:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024340736:0@lo:400:kworker.0 00000100:00100000:3.0:1784094191.594815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094191.594879:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024340992:0@lo:400:kworker.0 00000100:00100000:1.0:1784094191.595406:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1784094191.595416:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024340608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094191.595476:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024340736 00000100:00100000:1.0:1784094191.595478:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024340608:12345-0@lo:400:kworker.0 Request processed in 65us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094191.595482:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024340736 00000100:00100000:1.0:1784094191.595488:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1784094191.595526:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341120 00000100:00100000:3.0:1784094191.595531:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341120 00000100:00100000:0.0:1784094191.595531:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1784094191.595544:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094191.595570:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1784094191.595579:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024341120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094191.595588:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024340736:12345-0@lo:400:kworker.0 Request processed in 47us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094191.595597:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00080000:0.0:1784094191.595617:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094191.595618:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024341120:12345-0@lo:400:kworker.0 Request processed in 41us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094191.595627:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1784094191.595684:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024340736:0@lo:400:kworker.0 00000100:00100000:2.0:1784094191.595697:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024340608:0@lo:400:kworker.0 00000100:00100000:2.0:1784094191.595773:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024341120:0@lo:400:kworker.0 00010000:00010000:1.0:1784094192.106562:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094192.233492:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094192.233499:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094192.233503:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094192.233563:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094192.233576:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094192.233587:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094192.233716:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024341248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094192.233789:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094192.233858:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220dfa000 going to sleep for 11 seconds 00000100:00100000:0.0:1784094192.233885:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341248 00000100:00100000:0.0:1784094192.233893:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341248 00000100:00100000:2.0:1784094192.233969:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1784094192.233981:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024341248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094192.233993:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094192.234007:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbf36 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094192.234029:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094192.234039:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094192.234048:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41000, rc 0) 00000100:00100000:2.0:1784094192.234105:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024341248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094192.234111:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1784094192.234589:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024341248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094192.234607:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094192.234617:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094192.234636:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094192.234641:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094192.234648:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094192.482339:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094192.482373:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851264 00000100:00100000:0.0:1784094192.482383:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851264 00000100:00100000:0.0:1784094192.482469:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1010 00000100:00100000:0.0:1784094192.482481:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:56178:x1870757013851264:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094192.482500:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094192.482520:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbf44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d18 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.482578:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.482591:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.482604:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.482619:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.482627:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.482633:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.483821:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbf59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.483833:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbf59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.483860:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbf59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784094192.483923:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1784094192.483954:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:0.0:1784094192.483959:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094192.484041:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbf59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484055:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484066:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484073:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484079:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094192.484082:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484089:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484101:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094192.484104:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094192.484108:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484115:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cbf4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484126:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484132:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484138:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484143:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094192.484147:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484153:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484159:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907202e6bf00) 00010000:00010000:0.0:1784094192.484161:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094192.484164:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484169:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cbf52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484197:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbf44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d18 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484211:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbf59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d18 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094192.484219:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094192.484222:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094192.484224:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784094192.484318:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56178:x1870757013851264:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1839us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094192.484326:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1010 00010000:00010000:0.0:1784094193.130008:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094193.159350:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00000001:00080000:3.0:1784094193.159368:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000020:00000080:0.0:1784094193.274970:0:94152:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4f8c44e0 20000000:00000080:0.0:1784094193.274987:0:94152:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237459000 uarg=0000000000000000 00010000:00010000:0.0:1784094193.275192:0:94152:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094193.275224:0:94152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094193.275228:0:94152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094193.275238:0:94152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cbf59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d18 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.275261:0:94152:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784094193.275275:0:94152:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094193.275290:0:94152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.275303:0:94152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.275312:0:94152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.275347:0:94152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.275366:0:94152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 18 pid: 5771 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094193.275379:0:94152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94152:1870757024341376:0@lo:104: 00000100:00100000:0.0:1784094193.275466:0:94152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094193.275515:0:94152:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094193.275567:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784094193.275580:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341376 00000100:00100000:2.0:1784094193.275586:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341376 00000100:00100000:2.0:1784094193.275665:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784094193.275678:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237590050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:94152:x1870757024341376:12345-0@lo:104: 00010000:00010000:2.0:1784094193.275688:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094193.275743:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094193.275750:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237590050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:94152:x1870757024341376:12345-0@lo:104: Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094193.275756:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784094193.275763:0:94152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94152:1870757024341376:0@lo:104: 00010000:00010000:1.0:1784094193.275777:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094193.275779:0:94152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.275786:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.275796:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094193.275800:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.275812:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094193.275819:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094193.275838:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094193.275873:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.275881:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094193.275911:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.275919:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cbf36 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf3d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.275933:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094193.275935:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094193.275938:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094193.275945:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024341504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094193.275974:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094193.276045:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341504 00000100:00100000:1.0:1784094193.276050:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341504 00010000:00010000:1.0:1784094193.276067:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 19 pid: 5771 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094193.276090:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1784094193.276097:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024341504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094193.276107:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094193.276112:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 19 pid: 5771 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276122:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 19 pid: 5771 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276132:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41000/0x9ce98053214cbf3d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbf36 expref: 19 pid: 5771 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276144:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276152:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276164:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276171:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276178:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276185:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276191:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094193.276195:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.276202:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.277005:0:94152:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094193.277013:0:94152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.277019:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.277032:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214cbf60 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094193.277047:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094193.277137:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024341504:12345-0@lo:103:ldlm_bl.0 Request processed in 1040us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094193.277144:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784094193.277194:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024341504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094193.641979:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024341632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094193.642049:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094193.642276:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341632 00000100:00100000:1.0:1784094193.642285:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341632 00000100:00100000:1.0:1784094193.642353:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1784094193.642364:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024341632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094193.642402:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094193.642483:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024341632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094193.642491:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1784094193.642521:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:2.0:1784094193.642527:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d263b80, transno 4294967361 00000100:00100000:2.0:1784094193.642552:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024341632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094193.642572:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094194.153695:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094194.409480:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094194.409489:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094194.409494:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094194.409537:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.409550:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.409562:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094194.409589:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024341760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094194.409725:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094194.409783:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230d9f540 going to sleep for 11 seconds 00000100:00100000:3.0:1784094194.409854:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341760 00000100:00100000:3.0:1784094194.409862:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341760 00000100:00100000:3.0:1784094194.409921:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1784094194.409930:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024341760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094194.409941:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094194.409953:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbf67 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.409976:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.409987:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.409997:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784094194.410047:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024341760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094194.410055:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1784094194.410140:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024341760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094194.410151:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.410157:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094194.410171:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094194.410175:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.410181:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094194.699314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094194.699470:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851392 00000100:00100000:0.0:1784094194.699483:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851392 00000100:00100000:0.0:1784094194.699557:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1011 00000100:00100000:0.0:1784094194.699567:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56265:x1870757013851392:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094194.699587:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094194.699610:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cbf75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d1f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784094194.699624:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094194.699679:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cbf7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.699694:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cbf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.699707:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cbf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094194.699899:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:0.0:1784094194.699905:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094194.699980:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cbf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.700009:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cbf75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d1f expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.700030:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cbf7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d1f expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.700038:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:0.0:1784094194.700041:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094194.700044:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094194.700113:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:56265:x1870757013851392:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 546us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094194.700121:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1011 00000100:00100000:2.0:1784094194.703091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094194.703159:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851648 00000100:00100000:3.0:1784094194.703169:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851648 00000100:00100000:3.0:1784094194.703228:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1012 00000100:00100000:3.0:1784094194.703238:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:56265:x1870757013851648:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094194.703289:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094194.703315:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cbf7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d1f expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.703330:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbf59) 00010000:00010000:3.0:1784094194.703334:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6bb00) 00010000:00010000:3.0:1784094194.703345:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094194.703375:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.703389:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094194.703400:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094194.703905:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f7639677 reply state 00000000c509a2d7 transno 4294967685 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094194.703915:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094194.703981:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000100:00100000:3.0:1784094194.704067:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:56265:x1870757013851648:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 829us (984us total) trans 4294967685 rc 0/0 00000100:00100000:3.0:1784094194.704075:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1012 00010000:00010000:0.0:1784094194.707274:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.707294:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.707301:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.707308:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094194.707312:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.707320:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.707336:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907204fcec00) 00010000:00010000:0.0:1784094194.707340:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094194.707344:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094194.707350:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cbf83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094195.123023:0:94348:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1f1b12c0 20000000:00000080:1.0:1784094195.123047:0:94348:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b33800 uarg=0000000000000000 00010000:00010000:1.0:1784094195.123355:0:94348:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094195.123374:0:94348:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094195.123391:0:94348:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094195.123695:0:94348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094195.123716:0:94348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094195.123730:0:94348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094195.123783:0:94348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094195.123812:0:94348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 18 pid: 5770 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094195.123831:0:94348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94348:1870757024341888:0@lo:104: 00000100:00100000:1.0:1784094195.123918:0:94348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094195.123987:0:94348:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103484480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094195.124541:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024341888 00000100:00100000:2.0:1784094195.124554:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024341888 00000100:00100000:2.0:1784094195.124630:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1784094195.124642:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:94348:x1870757024341888:12345-0@lo:104: 00010000:00010000:2.0:1784094195.124659:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.124756:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094195.124763:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:94348:x1870757024341888:12345-0@lo:104: Request processed in 124us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094195.124771:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784094195.124778:0:94348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072373e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94348:1870757024341888:0@lo:104: 00010000:00010000:1.0:1784094195.124816:0:94348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094195.124870:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094195.124879:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094195.124889:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094195.124893:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094195.124902:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094195.124909:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094195.124914:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094195.124962:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094195.124970:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784094195.125020:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024342016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094195.125059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784094195.125126:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094195.125134:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77a00/0x9ce98053214cbf67 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf6e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094195.125135:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342016 00010000:00010000:3.0:1784094195.125155:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094195.125157:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094195.125159:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094195.125305:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342016 00010000:00010000:2.0:1784094195.125330:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 19 pid: 5770 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094195.125364:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1784094195.125372:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024342016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094195.125386:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094195.125393:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 19 pid: 5770 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125404:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 19 pid: 5770 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125458:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cbf6e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbf67 expref: 19 pid: 5770 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125477:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125486:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125502:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125510:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125518:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125525:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125535:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094195.125540:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125549:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125566:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094195.125577:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094195.125614:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b87050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024342016:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094195.125621:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784094195.125831:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024342016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094195.125923:0:94348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094195.125932:0:94348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094195.125940:0:94348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12e00/0x9ce98053214cbf8a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094195.177520:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094195.717400:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967685 is committed 00000100:00100000:2.0:1784094196.091376:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.091409:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.091517:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.091553:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.091626:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851904 00000100:00100000:2.0:1784094196.091635:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851904 00000100:00100000:2.0:1784094196.091701:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 929 00000100:00100000:2.0:1784094196.091711:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013851904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094196.091800:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013851904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.091807:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013851776 00000100:00100000:2.0:1784094196.091812:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 929 00000100:00100000:1.0:1784094196.091814:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013851776 00000100:00100000:1.0:1784094196.091851:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 865 00000100:00100000:1.0:1784094196.091860:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013851776:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094196.091881:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852032 00000100:00100000:0.0:1784094196.091887:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852032 00000100:00100000:1.0:1784094196.091892:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013851776:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.091900:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 865 00000100:00100000:0.0:1784094196.091927:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852160 00000100:00100000:0.0:1784094196.091932:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852160 00000100:00100000:1.0:1784094196.091941:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 702 00000100:00100000:1.0:1784094196.091951:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013852032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094196.091965:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00100000:0.0:1784094196.091977:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013852160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094196.091985:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013852032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.091994:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 702 00000100:00100000:0.0:1784094196.092016:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013852160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094196.092028:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 703 00000100:00080000:0.0:1784094196.092073:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094196.092077:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094196.092080:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094196.203863:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094196.585532:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094196.585541:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094196.585547:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094196.585596:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.585608:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.585620:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094196.585647:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024342144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094196.585711:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094196.585784:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094196.585880:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342144 00000100:00100000:2.0:1784094196.585889:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342144 00000100:00100000:2.0:1784094196.585952:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1784094196.585964:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024342144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094196.585983:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094196.585999:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cbf91 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.586021:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.586031:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.586039:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094196.586082:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024342144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.586089:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1784094196.587529:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024342144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094196.587553:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.587564:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094196.587585:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094196.587591:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.587600:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094196.622305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.622592:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852288 00000100:00100000:0.0:1784094196.622620:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852288 00000100:00100000:0.0:1784094196.622709:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1013 00000100:00100000:0.0:1784094196.622724:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852288:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094196.622884:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852288:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 164us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094196.622893:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1013 00000100:00100000:3.0:1784094196.626517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.626633:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852416 00000100:00100000:0.0:1784094196.626649:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852416 00000100:00100000:0.0:1784094196.626733:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 515 00000100:00100000:0.0:1784094196.626744:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852416:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094196.627285:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852416:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 541us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094196.627295:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 515 00000100:00100000:2.0:1784094196.629714:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094196.629804:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852544 00000100:00100000:1.0:1784094196.629816:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852544 00000100:00100000:1.0:1784094196.629875:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 516 00000100:00100000:1.0:1784094196.629886:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852544:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094196.630282:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852544:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 397us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.630290:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 516 00000100:00100000:1.0:1784094196.631445:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.631475:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852672 00000100:00100000:2.0:1784094196.631482:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852672 00000100:00100000:2.0:1784094196.631523:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1014 00000100:00100000:2.0:1784094196.631530:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852672:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094196.631808:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852672:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 278us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.631815:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1014 00000100:00100000:3.0:1784094196.633724:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.633789:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852800 00000100:00100000:0.0:1784094196.633797:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852800 00000100:00100000:0.0:1784094196.633839:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1015 00000100:00100000:0.0:1784094196.633849:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852800:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094196.633923:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852800:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094196.633938:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1015 00000100:00100000:3.0:1784094196.635198:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.635276:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013852928 00000100:00100000:2.0:1784094196.635287:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013852928 00000100:00100000:2.0:1784094196.635329:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 517 00000100:00100000:2.0:1784094196.635337:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852928:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094196.635636:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013852928:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 299us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.635643:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 517 00000100:00100000:1.0:1784094196.636597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.636653:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853056 00000100:00100000:0.0:1784094196.636664:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853056 00000100:00100000:0.0:1784094196.636716:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 518 00000100:00100000:0.0:1784094196.636732:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013853056:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094196.636995:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013853056:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 263us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094196.637002:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 518 00000100:00100000:2.0:1784094196.638591:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.638634:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853184 00000100:00100000:0.0:1784094196.638640:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853184 00000100:00100000:0.0:1784094196.638669:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1016 00000100:00100000:0.0:1784094196.638675:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013853184:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094196.638979:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56349:x1870757013853184:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 303us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094196.638984:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1016 00000100:00100000:3.0:1784094196.665249:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.665381:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853312 00000100:00100000:2.0:1784094196.665391:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853312 00000100:00100000:2.0:1784094196.665524:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1017 00000100:00100000:2.0:1784094196.665536:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56353:x1870757013853312:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784094196.665554:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094196.665587:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cbf9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d26 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.665652:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.665667:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.665690:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.665704:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.665712:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.665719:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666123:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbfb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666132:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666140:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094196.666224:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:2.0:1784094196.666229:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094196.666305:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666317:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666324:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666330:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666337:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094196.666341:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666348:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666359:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781500) 00010000:00010000:2.0:1784094196.666363:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094196.666367:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666374:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cbfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666386:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666391:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666397:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666402:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094196.666404:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666410:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666417:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff90721a781800) 00010000:00010000:2.0:1784094196.666454:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094196.666457:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666463:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cbfad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666494:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cbf9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d26 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666515:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d26 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.666520:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784094196.666522:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094196.666523:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784094196.666574:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:56353:x1870757013853312:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1040us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.666580:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1017 00000100:00100000:1.0:1784094196.670036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.670338:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853568 00000100:00100000:0.0:1784094196.670347:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853568 00000100:00100000:0.0:1784094196.670405:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1018 00000100:00100000:0.0:1784094196.670415:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:56353:x1870757013853568:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784094196.670482:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094196.670501:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbfbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d2d expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.670950:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.670965:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.670981:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.670996:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.671003:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.671009:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094196.671915:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:0.0:1784094196.672171:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cbfd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672181:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cbfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672190:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cbfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672219:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672227:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672233:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672239:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094196.672244:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672251:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672262:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784094196.672265:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094196.672269:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672275:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cbfc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094196.672286:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000a3aa49aa reply state 00000000a29d4d04 transno 4294967686 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094196.672295:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094196.672320:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cbfbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d2d expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672333:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cbfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d2d expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.672340:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094196.672342:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094196.672345:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784094196.672413:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:56353:x1870757013853568:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1999us (2384us total) trans 4294967686 rc 0/0 00000100:00100000:0.0:1784094196.672543:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1018 00010000:00010000:0.0:1784094196.673413:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.673452:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.673460:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.673467:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094196.673471:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.673478:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.673489:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff907202e6bf00) 00010000:00010000:0.0:1784094196.673493:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094196.673497:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094196.673503:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cbfc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094196.679176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.679263:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853696 00000100:00100000:2.0:1784094196.679273:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853696 00000100:00100000:2.0:1784094196.679369:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 519 00000100:00100000:2.0:1784094196.679380:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56353:x1870757013853696:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784094196.679399:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094196.679459:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d34 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094196.679486:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784094196.679506:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=1357s v=(0 0) 00010000:00010000:2.0:1784094196.679511:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094196.679521:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.679539:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094196.679557:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41a00, rc 0) 00000100:00100000:2.0:1784094196.679613:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:56353:x1870757013853696:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 235us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.679620:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 519 00000100:00100000:3.0:1784094196.689674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094196.689737:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853824 00000100:00100000:1.0:1784094196.689746:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853824 00002000:00100000:1.0:1784094196.689805:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff90723d4d3480 x1870757013853824/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:517/0 lens 488/0 e 0 to 0 dl 1784094207 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784094196.689814:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d4d3480 with x1870757013853824 ext(0->1048575) 00002000:00010000:1.0:1784094196.689819:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d4d3480 00000100:00100000:1.0:1784094196.689845:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 25 00000100:00100000:1.0:1784094196.689853:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013853824:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:1.0:1784094196.702375:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013853824:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 12512us (12699us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1784094196.702389:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 25 00002000:00100000:1.0:1784094196.702402:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff90723d4d3480 x1870757013853824/t4294967360(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:517/0 lens 488/448 e 0 to 0 dl 1784094207 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784094196.702413:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d4d3480 with x1870757013853824 ext(0->1048575) 00002000:00010000:1.0:1784094196.702419:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d4d3480 00000100:00100000:3.0:1784094196.704642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094196.704800:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013853952 00000100:00100000:0.0:1784094196.704810:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013853952 00000100:00100000:0.0:1784094196.704865:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1019 00000100:00100000:0.0:1784094196.704876:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:56353:x1870757013853952:12345-192.168.204.57@tcp:44:dd.60003 00000100:00100000:1.0:1784094196.713547:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094196.713573:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024342400:0@lo:400:kworker.0 00000100:00100000:3.0:1784094196.713606:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024342528:0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.713647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094196.713650:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024342656:0@lo:400:kworker.0 00000100:00100000:3.0:1784094196.713688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094196.713796:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024342784:0@lo:400:kworker.0 00000100:00100000:2.0:1784094196.713827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094196.713835:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024342272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094196.713848:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094196.713857:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024342912:0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.713871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094196.713887:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094196.713925:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342400 00000100:00100000:2.0:1784094196.713927:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342656 00000100:00100000:2.0:1784094196.713934:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342656 00000100:00100000:1.0:1784094196.713934:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342400 00000100:00100000:2.0:1784094196.713982:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342912 00000100:00100000:2.0:1784094196.713985:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342912 00000100:00100000:2.0:1784094196.714006:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1784094196.714013:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024342656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094196.714058:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024342656:12345-0@lo:400:kworker.0 Request processed in 44us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.714066:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1784094196.714081:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342784 00000100:00100000:2.0:1784094196.714086:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1784094196.714087:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342784 00000100:00100000:2.0:1784094196.714095:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024342912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.714121:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1784094196.714131:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024342400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094196.714133:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024342912:12345-0@lo:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.714144:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1784094196.714167:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1784094196.714177:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024342784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.714184:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024342400:12345-0@lo:400:kworker.0 Request processed in 53us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.714196:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1784094196.714214:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024342784:12345-0@lo:400:kworker.0 Request processed in 39us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.714221:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1784094196.714262:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024342912:0@lo:400:kworker.0 00000100:00100000:2.0:1784094196.714274:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024342784:0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.714286:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342272 00000100:00100000:1.0:1784094196.714291:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342272 00000100:00100000:1.0:1784094196.714319:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1784094196.714327:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024342272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094196.714346:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094196.714391:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024342272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.714399:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00080000:0.0:1784094196.714472:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094196.714477:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094196.714479:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094196.714548:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024342656:0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.714586:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094196.714630:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024342528 00000100:00100000:3.0:1784094196.714635:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024342528 00000100:00100000:1.0:1784094196.714654:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024342400:0@lo:400:kworker.0 00000100:00100000:1.0:1784094196.714668:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024342272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094196.714723:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1784094196.714731:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024342528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094196.714901:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094196.715128:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024342528:12345-0@lo:400:kworker.0 Request processed in 397us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094196.715173:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1784094196.715173:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024342528:0@lo:400:kworker.0 00000001:00080000:2.0:1784094196.722731:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967686 is committed 00000100:00100000:2.0:1784094196.722927:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:56353:x1870757013853952:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 18047us (18286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094196.723002:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1019 00000100:00100000:3.0:1784094196.725847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094196.725987:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854080 00000100:00100000:2.0:1784094196.725997:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854080 00000100:00100000:2.0:1784094196.726119:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 520 00000100:00100000:2.0:1784094196.726130:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013854080:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:3.0:1784094196.762151:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967360 is committed 00000100:00100000:1.0:1784094196.763697:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013854080:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 37562us (37849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094196.763709:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 520 00000100:00100000:3.0:1784094196.766216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094196.766681:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854336 00000100:00100000:1.0:1784094196.766692:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854336 00000100:00100000:1.0:1784094196.766767:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 103 00000100:00100000:1.0:1784094196.766779:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:56353:x1870757013854336:12345-192.168.204.57@tcp:35:dd.60003 00000001:00080000:1.0:1784094196.767153:0:5780:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967687 00000100:00100000:1.0:1784094196.767265:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:56353:x1870757013854336:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 487us (1057us total) trans 4294967688 rc 0/0 00000100:00100000:1.0:1784094196.767274:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 103 00000020:00080000:1.0:1784094196.767280:0:5780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784094197.226557:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094197.458256:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967688 is committed 00000004:00080000:3.0:1784094198.090798:0:94595:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1359168373208ns, next at 1350557678439ns, rc = 0 00000004:00080000:3.0:1784094198.090929:0:94595:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1359168506400ns, next at 1324463934337ns, rc = 0 00000004:00080000:2.0:1784094198.094078:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00000004:00080000:2.0:1784094198.094127:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 86 committed 00010000:00010000:3.0:1784094198.250879:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094198.762703:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024343040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094198.762773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094198.762840:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343040 00000100:00100000:1.0:1784094198.762848:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343040 00000100:00100000:1.0:1784094198.762904:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1784094198.762913:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024343040:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094198.762939:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784094198.763005:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094198.763065:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024343040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094198.763072:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1784094198.763146:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024343040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094198.810569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094198.810643:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854464 00000100:00100000:2.0:1784094198.810653:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854464 00000100:00100000:2.0:1784094198.810735:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1020 00000100:00100000:2.0:1784094198.810748:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013854464:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094198.810852:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013854464:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094198.810861:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1020 00000100:00080000:1.0:1784094198.811016:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094198.817513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094198.817615:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854592 00000100:00100000:0.0:1784094198.817625:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854592 00000100:00100000:0.0:1784094198.817698:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:0.0:1784094198.817709:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56545:x1870757013854592:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:1.0:1784094198.818018:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094198.818120:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:56545:x1870757013854592:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 412us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094198.818130:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 521 00000100:00100000:2.0:1784094198.820594:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094198.820713:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854720 00000100:00100000:3.0:1784094198.820733:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854720 00000100:00100000:3.0:1784094198.820806:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 522 00000100:00100000:3.0:1784094198.820817:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56545:x1870757013854720:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:0.0:1784094198.820957:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094198.821179:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56545:x1870757013854720:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 363us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094198.821251:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 522 00000100:00100000:0.0:1784094198.824556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094198.826533:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854848 00000100:00100000:2.0:1784094198.826545:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854848 00000100:00100000:2.0:1784094198.826606:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1021 00000100:00100000:2.0:1784094198.826617:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013854848:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094198.826969:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013854848:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 353us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094198.826978:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1021 00000100:00100000:2.0:1784094198.831222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094198.831344:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013854976 00000100:00100000:2.0:1784094198.831354:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013854976 00000100:00100000:2.0:1784094198.831406:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1022 00000100:00100000:2.0:1784094198.831417:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013854976:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094198.831528:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013854976:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094198.831536:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1022 00000100:00100000:2.0:1784094198.833833:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094198.833871:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013855104 00000100:00100000:2.0:1784094198.833880:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013855104 00000100:00100000:2.0:1784094198.833927:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 523 00000100:00100000:2.0:1784094198.833949:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56545:x1870757013855104:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094198.834652:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56545:x1870757013855104:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 714us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094198.834672:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 523 00000100:00100000:2.0:1784094198.838752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094198.838839:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013855232 00000100:00100000:3.0:1784094198.838846:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013855232 00000100:00100000:3.0:1784094198.838909:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 524 00000100:00100000:3.0:1784094198.838918:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:56545:x1870757013855232:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094198.839390:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:56545:x1870757013855232:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 472us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094198.839396:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 524 00000100:00100000:2.0:1784094198.841197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094198.841268:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013855360 00000100:00100000:3.0:1784094198.841276:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013855360 00000100:00100000:3.0:1784094198.841322:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1023 00000100:00100000:3.0:1784094198.841331:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013855360:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094198.841735:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:56545:x1870757013855360:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 389us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094198.841743:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1023 00000100:00100000:3.0:1784094198.872648:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094198.872714:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013855616 00000100:00100000:2.0:1784094198.872734:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013855616 00000100:00100000:2.0:1784094198.872799:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1024 00000100:00100000:2.0:1784094198.872810:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:56549:x1870757013855616:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784094198.872860:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094198.872887:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cbfd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d2d expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.872905:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff907202e6be00) 00010000:00010000:2.0:1784094198.872916:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094198.872938:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.872950:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.872961:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.872974:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.872981:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.872987:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.873377:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.873386:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094198.873395:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094198.874466:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10240 00000004:00080000:3.0:1784094198.874474:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1359952051749ns, next at 1360952050174ns, rc = 0 00010000:00010000:3.0:1784094198.874540:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874550:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874560:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874578:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874586:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874593:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874611:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094198.874627:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874631:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874635:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874639:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094198.874641:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874646:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874652:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff90721a781000) 00010000:00010000:3.0:1784094198.874653:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094198.874656:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874660:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cbff3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874671:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874674:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874680:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874683:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094198.874685:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874688:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874691:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:3.0:1784094198.874693:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094198.874694:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094198.874697:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cbfe5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094198.874702:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e1594666 reply state 00000000c697ce52 transno 4294967689 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094198.874708:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094198.874763:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094198.874772:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.874779:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094198.874783:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.874790:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094198.874798:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:56549:x1870757013855616:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1988us (2156us total) trans 4294967689 rc 0/0 00010000:00010000:0.0:1784094198.874800:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff90721a781000) 00010000:00010000:0.0:1784094198.874805:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784094198.874810:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094198.874812:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1024 00010000:00010000:0.0:1784094198.874821:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cbffa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.874838:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094198.874840:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094198.874842:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094198.875979:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.875990:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.875995:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.876000:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094198.876004:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.876009:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.876020:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff90721a781800) 00010000:00010000:0.0:1784094198.876022:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094198.876025:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094198.876030:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cbfec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094199.273914:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784094199.963078:0:94739:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1361040653212ns, next at 1350557678439ns, rc = 0 00000004:00080000:3.0:1784094199.963405:0:94739:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1361040982417ns, next at 1360952050174ns, rc = 0 00000004:00080000:2.0:1784094199.999065:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000004:00080000:2.0:1784094199.999088:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 87 committed 00000001:00080000:2.0:1784094199.999147:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967689 is committed 00000004:00080000:2.0:1784094199.999152:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000100:00100000:2.0:1784094199.999241:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024343168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784094199.999468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094199.999617:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343168 00000100:00100000:3.0:1784094199.999625:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343168 00000100:00100000:3.0:1784094199.999791:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1784094199.999801:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024343168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784094199.999827:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:3.0:1784094199.999851:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094199.999872:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094199.999880:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784094199.999885:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094199.999889:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094199.999916:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094199.999931:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 5 pid: 8031 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094199.999943:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024343296:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094200.000009:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720840 going to sleep for 11 seconds 00000100:00080000:0.0:1784094200.000063:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094200.004223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094200.004314:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013855744 00000100:00100000:0.0:1784094200.004323:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013855744 00010000:00010000:0.0:1784094200.004380:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 6 pid: 8031 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094200.004452:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 334 00000100:00100000:0.0:1784094200.004462:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013855744:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094200.004479:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1784094200.004485:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784094200.004486:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 6 pid: 8031 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094200.004513:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 6 pid: 8031 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094200.004542:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094200.004546:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094200.004553:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094200.004564:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094200.004586:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094200.004639:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013855744:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 179us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094200.004647:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 334 00010000:00010000:3.0:1784094200.008102:0:6573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dcb7a17/0x9ce98053214cbfde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d34 expref: 5 pid: 8031 timeout: 1461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094200.008128:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024343296:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094200.008157:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094200.008180:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094200.008189:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094200.008201:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094200.008209:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094200.008239:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094200.008335:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094200.008344:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094200.008355:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094200.008360:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094200.008370:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094200.008389:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094200.008398:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093395f5f/0x9ce98053214cc001 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094200.008451:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094200.008454:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094200.008457:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094200.008938:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024343168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9137us (9469us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1784094200.008948:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000004:00080000:2.0:1784094200.009104:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237376300/2, rc 0, transno 4294967361 00000100:00100000:2.0:1784094200.009124:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024343168:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784094200.298733:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094201.208858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094201.208920:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856000 00000100:00100000:2.0:1784094201.208931:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856000 00000100:00100000:1.0:1784094201.208958:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094201.208994:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094201.209010:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 933 00000100:00100000:2.0:1784094201.209019:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013856000:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094201.209039:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094201.209065:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013855872 00000100:00100000:1.0:1784094201.209069:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013855872 00000100:00100000:3.0:1784094201.209078:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856256 00000100:00100000:3.0:1784094201.209081:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856256 00000100:00100000:1.0:1784094201.209098:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 867 00000100:00100000:3.0:1784094201.209103:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856128 00000100:00100000:3.0:1784094201.209105:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856128 00000100:00100000:1.0:1784094201.209105:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013855872:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094201.209134:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094201.209135:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 706 00000100:00080000:0.0:1784094201.209143:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094201.209145:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013856256:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094201.209172:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013855872:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094201.209173:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013856256:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094201.209180:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 867 00000100:00100000:3.0:1784094201.209186:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 706 00000100:00100000:0.0:1784094201.209201:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 707 00000100:00100000:0.0:1784094201.209214:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013856128:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094201.209250:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013856128:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094201.209301:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013856000:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 282us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094201.209308:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 933 00000100:00100000:0.0:1784094201.209622:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 707 00010000:00010000:0.0:1784094201.321580:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094201.833636:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024343680:0@lo:400:kworker.0 00000100:00100000:2.0:1784094201.833637:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024343808:0@lo:400:kworker.0 00000100:00100000:0.0:1784094201.833712:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024343552:0@lo:400:kworker.0 00000100:00100000:1.0:1784094201.833732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094201.833737:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024343936:0@lo:400:kworker.0 00000100:00100000:0.0:1784094201.835865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094201.835951:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024344064:0@lo:400:kworker.0 00000100:00100000:0.0:1784094201.835990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094201.836033:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343680 00000100:00100000:0.0:1784094201.836039:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343680 00000100:00100000:0.0:1784094201.836082:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344064 00000100:00100000:0.0:1784094201.836084:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344064 00000100:00100000:0.0:1784094201.836112:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1784094201.836119:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024343680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094201.836161:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024343680:12345-0@lo:400:kworker.0 Request processed in 44us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094201.836167:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1784094201.836191:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:0.0:1784094201.836196:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024344064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094201.836221:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024344064:12345-0@lo:400:kworker.0 Request processed in 25us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094201.836225:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00080000:0.0:1784094201.836257:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094201.836293:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024344064:0@lo:400:kworker.0 00000100:00100000:1.0:1784094201.836551:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024343680:0@lo:400:kworker.0 00000100:00100000:1.0:1784094201.836562:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024343424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094201.836570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094201.836602:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094201.836616:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343552 00000100:00100000:2.0:1784094201.836621:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343552 00000100:00100000:2.0:1784094201.836650:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1784094201.836658:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024343552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094201.836713:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024343552:12345-0@lo:400:kworker.0 Request processed in 55us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094201.836721:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1784094201.836724:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343424 00000100:00100000:1.0:1784094201.836730:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343424 00000100:00100000:2.0:1784094201.836752:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343936 00000100:00100000:2.0:1784094201.836757:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343936 00000100:00100000:2.0:1784094201.836787:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1784094201.836793:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024343936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094201.836822:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024343936:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094201.836828:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1784094201.837074:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024343552:0@lo:400:kworker.0 00000100:00100000:1.0:1784094201.837091:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1784094201.837103:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024343424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094201.837134:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784094201.837176:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024343424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094201.837183:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00080000:1.0:1784094201.837199:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094201.837202:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094201.837243:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024343424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094201.837584:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723757f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024343936:0@lo:400:kworker.0 00000100:00100000:0.0:1784094201.838049:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094201.838156:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024343808 00000100:00100000:2.0:1784094201.838163:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024343808 00000100:00100000:2.0:1784094201.838207:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1784094201.838215:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024343808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094201.838260:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024343808:12345-0@lo:400:kworker.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094201.838266:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00080000:0.0:1784094201.838325:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094201.838389:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024343808:0@lo:400:kworker.0 00000100:00100000:1.0:1784094201.838400:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024344192:0@lo:400:kworker.0 00000100:00100000:1.0:1784094201.838953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094201.839101:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344192 00000100:00100000:2.0:1784094201.839106:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344192 00000100:00100000:2.0:1784094201.839174:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1784094201.839182:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024344192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094201.839229:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024344192:12345-0@lo:400:kworker.0 Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094201.839236:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1784094201.839287:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024344192:0@lo:400:kworker.0 00010000:00010000:3.0:1784094202.346557:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094203.369708:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094203.881690:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094203.881715:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024344320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094203.881794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094203.881924:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344320 00000100:00100000:1.0:1784094203.881945:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344320 00000100:00100000:1.0:1784094203.882010:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1784094203.882034:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024344320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094203.882074:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094203.882143:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024344320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094203.882152:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00080000:1.0:1784094203.882185:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094203.882231:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024344320:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784094203.904032:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00010000:00010000:3.0:1784094204.393660:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094205.418804:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094206.333194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094206.333305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094206.333344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094206.333395:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856640 00000100:00100000:0.0:1784094206.333407:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856640 00000100:00100000:1.0:1784094206.333411:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:1.0:1784094206.333485:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094206.333502:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856768 00000100:00100000:0.0:1784094206.333506:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856768 00000100:00100000:1.0:1784094206.333516:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 710 00000100:00100000:1.0:1784094206.333532:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013856640:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094206.333542:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 711 00000100:00100000:0.0:1784094206.333551:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013856768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094206.333630:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856512 00000100:00100000:3.0:1784094206.333636:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856512 00000100:00100000:2.0:1784094206.333672:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856384 00000100:00100000:3.0:1784094206.333674:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 937 00000100:00100000:2.0:1784094206.333676:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856384 00000100:00100000:3.0:1784094206.333681:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013856512:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094206.333701:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 869 00000100:00100000:2.0:1784094206.333708:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013856384:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094206.333741:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013856640:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 212us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094206.333749:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 710 00000100:00100000:0.0:1784094206.334063:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013856768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 512us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094206.334070:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 711 00000100:00080000:0.0:1784094206.334093:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094206.334096:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094206.334167:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013856512:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 485us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094206.334167:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013856384:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 458us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094206.334175:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 937 00000100:00100000:2.0:1784094206.334376:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 869 00010000:00010000:3.0:1784094206.441945:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094206.953580:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024344448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094206.953667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094206.953773:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344448 00000100:00100000:1.0:1784094206.953783:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344448 00000100:00100000:2.0:1784094206.953807:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024344576:0@lo:400:kworker.0 00000100:00100000:2.0:1784094206.953853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094206.953853:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1784094206.953865:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024344448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094206.953882:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024345088:0@lo:400:kworker.0 00002000:00000024:1.0:1784094206.953901:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094206.953911:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094206.953935:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094206.953942:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024344960:0@lo:400:kworker.0 00000100:00100000:1.0:1784094206.953953:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024344448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094206.953962:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1784094206.953980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094206.954012:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024344704:0@lo:400:kworker.0 00000100:00100000:2.0:1784094206.954040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094206.954065:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094206.954072:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024344832:0@lo:400:kworker.0 00000100:00100000:2.0:1784094206.954095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094206.954134:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344576 00000100:00100000:2.0:1784094206.954138:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344576 00000100:00100000:2.0:1784094206.954172:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1784094206.954181:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024344576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094206.954222:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024344576:12345-0@lo:400:kworker.0 Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094206.954224:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345088 00000100:00100000:1.0:1784094206.954229:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345088 00000100:00100000:2.0:1784094206.954234:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1784094206.954265:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344704 00000100:00100000:2.0:1784094206.954269:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344960 00000100:00100000:1.0:1784094206.954270:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344704 00000100:00100000:2.0:1784094206.954276:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344960 00000100:00100000:1.0:1784094206.954293:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024344832 00000100:00100000:1.0:1784094206.954297:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024344832 00000100:00100000:2.0:1784094206.954318:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1784094206.954323:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1784094206.954330:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024344960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094206.954335:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024345088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094206.954341:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1784094206.954349:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024344704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094206.954373:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024344960:12345-0@lo:400:kworker.0 Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094206.954382:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723757f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024345088:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094206.954386:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024344704:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094206.954390:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1784094206.954390:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:3.0:1784094206.954405:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1784094206.954412:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1784094206.954418:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024344832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094206.954471:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024344960:0@lo:400:kworker.0 00000100:00100000:2.0:1784094206.954476:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024344704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094206.954556:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024344832:12345-0@lo:400:kworker.0 Request processed in 138us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094206.954563:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00080000:1.0:1784094206.954594:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094206.954601:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094206.954604:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094206.954610:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024344832:0@lo:400:kworker.0 00000100:00100000:0.0:1784094206.955893:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:0.0:1784094206.955903:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237376300, transno 4294967361 00000100:00100000:0.0:1784094206.955923:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024344448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094206.956638:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024344576:0@lo:400:kworker.0 00000100:00100000:3.0:1784094206.956657:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024345088:0@lo:400:kworker.0 00010000:00010000:1.0:1784094207.465665:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094208.489692:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094209.001773:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024345216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094209.001855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094209.001888:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345216 00000100:00100000:0.0:1784094209.002247:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345216 00000100:00080000:2.0:1784094209.003441:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094209.003699:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1784094209.003711:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024345216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094209.003831:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094209.004010:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024345216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 302us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094209.004016:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1784094209.004047:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024345216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094209.513660:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094210.537651:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094211.449778:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094211.449807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094211.449826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094211.449849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094211.449880:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857280 00000100:00100000:1.0:1784094211.449889:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857280 00000100:00100000:1.0:1784094211.449938:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857152 00000100:00100000:1.0:1784094211.449941:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857152 00000100:00100000:1.0:1784094211.449964:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 713 00000100:00100000:1.0:1784094211.449973:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013857280:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094211.450033:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013857280:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094211.450040:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 713 00000100:00100000:1.0:1784094211.450065:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 714 00000100:00100000:1.0:1784094211.450071:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013857152:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094211.450091:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013857152:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 20us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094211.450099:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 714 00000100:00100000:3.0:1784094211.450391:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857024 00000100:00100000:3.0:1784094211.450397:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857024 00000100:00100000:3.0:1784094211.450463:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 941 00000100:00100000:3.0:1784094211.450472:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013857024:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094211.450512:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013857024:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 42us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094211.450521:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 941 00000100:00100000:2.0:1784094211.450542:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013856896 00000100:00100000:2.0:1784094211.450548:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013856896 00000100:00100000:2.0:1784094211.450594:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 871 00000100:00100000:2.0:1784094211.450601:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013856896:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094211.450628:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013856896:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 29us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094211.450635:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 871 00000100:00080000:2.0:1784094211.450671:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094211.450675:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094211.450677:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784094211.561758:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094212.073754:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024345344:0@lo:400:kworker.0 00000100:00100000:3.0:1784094212.073775:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024345728:0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.073837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094212.073838:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094212.073872:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024345472:0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.073889:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024345856:0@lo:400:kworker.0 00000100:00100000:1.0:1784094212.073905:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094212.073930:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345344 00000100:00100000:0.0:1784094212.073933:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345728 00000100:00100000:1.0:1784094212.073934:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024345984:0@lo:400:kworker.0 00000100:00100000:2.0:1784094212.073939:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345344 00000100:00100000:0.0:1784094212.073939:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345728 00000100:00100000:1.0:1784094212.073958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094212.073979:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784094212.073985:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024345600:0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.073988:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345984 00000100:00100000:0.0:1784094212.073991:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345984 00000100:00100000:2.0:1784094212.073993:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1784094212.074006:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024345344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094212.074012:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094212.074017:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1784094212.074024:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094212.074029:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024346112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094212.074072:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024345728:12345-0@lo:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094212.074079:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1784094212.074095:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1784094212.074102:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024345984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.074131:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024345984:12345-0@lo:400:kworker.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094212.074137:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1784094212.074161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094212.074191:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345472 00000100:00100000:0.0:1784094212.074196:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345472 00000100:00100000:0.0:1784094212.074221:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345600 00000100:00100000:0.0:1784094212.074224:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345600 00000100:00100000:0.0:1784094212.074243:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024345856 00000100:00100000:0.0:1784094212.074246:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024345856 00000100:00100000:0.0:1784094212.074258:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1784094212.074264:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024345472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.074296:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024345472:12345-0@lo:400:kworker.0 Request processed in 32us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094212.074302:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1784094212.074314:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1784094212.074320:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024345600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.074346:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024345600:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094212.074352:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1784094212.074363:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1784094212.074369:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024345856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.074397:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024345856:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094212.074403:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1784094212.074456:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024345856:0@lo:400:kworker.0 00000100:00080000:0.0:1784094212.074519:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094212.074524:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094212.074526:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094212.075137:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024345728:0@lo:400:kworker.0 00000100:00100000:1.0:1784094212.077505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094212.077573:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024345472:0@lo:400:kworker.0 00000100:00100000:1.0:1784094212.077588:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024345984:0@lo:400:kworker.0 00000100:00100000:1.0:1784094212.077616:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024345600:0@lo:400:kworker.0 00000100:00100000:0.0:1784094212.077650:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346112 00000100:00100000:0.0:1784094212.077658:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346112 00000100:00100000:0.0:1784094212.077712:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1784094212.077720:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024346112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094212.077757:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094212.077823:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024346112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094212.077831:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1784094212.077898:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024345344:12345-0@lo:400:kworker.0 Request processed in 3894us (4064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094212.077908:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1784094212.078021:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024346112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094212.078101:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024345344:0@lo:400:kworker.0 00010000:00010000:1.0:1784094212.586591:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094213.609614:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094214.121757:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094214.121783:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024346240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094214.121862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094214.121937:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346240 00000100:00100000:0.0:1784094214.121945:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346240 00000100:00100000:0.0:1784094214.122002:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1784094214.122012:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024346240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094214.122046:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094214.122096:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024346240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094214.122103:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00080000:0.0:1784094214.122125:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094214.122166:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024346240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094214.633641:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094215.657674:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094216.568849:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094216.568893:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094216.568935:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094216.568974:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094216.569008:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857792 00000100:00100000:1.0:1784094216.569018:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857792 00000100:00100000:1.0:1784094216.569072:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857664 00000100:00100000:1.0:1784094216.569076:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857664 00000100:00100000:1.0:1784094216.569103:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 717 00000100:00100000:1.0:1784094216.569112:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013857792:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094216.569177:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013857792:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094216.569184:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 717 00000100:00100000:1.0:1784094216.569220:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 718 00000100:00100000:1.0:1784094216.569227:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013857664:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094216.569251:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013857664:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094216.569256:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 718 00000100:00080000:1.0:1784094216.569272:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094216.569276:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094216.569495:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857408 00000100:00100000:3.0:1784094216.569500:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857408 00000100:00100000:3.0:1784094216.569533:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 873 00000100:00100000:3.0:1784094216.569540:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013857408:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094216.569570:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013857408:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094216.569575:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 873 00000100:00100000:0.0:1784094216.569824:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857536 00000100:00100000:0.0:1784094216.569828:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857536 00000100:00100000:0.0:1784094216.569871:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 945 00000100:00100000:0.0:1784094216.569879:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013857536:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094216.569909:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013857536:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094216.569915:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 945 00000100:00080000:1.0:1784094216.570015:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094216.681714:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094217.129702:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.129767:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013857920 00000100:00100000:0.0:1784094217.129776:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013857920 00000100:00100000:0.0:1784094217.129849:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1025 00000100:00100000:0.0:1784094217.129862:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013857920:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094217.129968:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013857920:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.129975:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1025 00000100:00100000:1.0:1784094217.131676:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.131817:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858048 00000100:00100000:0.0:1784094217.131825:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858048 00000100:00100000:0.0:1784094217.131894:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 526 00000100:00100000:0.0:1784094217.131903:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858048:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094217.132229:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858048:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 327us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.132237:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 526 00000100:00100000:1.0:1784094217.134288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.134477:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858176 00000100:00100000:0.0:1784094217.134486:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858176 00000100:00100000:0.0:1784094217.134682:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 527 00000100:00100000:0.0:1784094217.134703:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858176:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094217.135516:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858176:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 824us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.135524:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 527 00000100:00100000:2.0:1784094217.137276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.137452:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858304 00000100:00100000:0.0:1784094217.137460:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858304 00000100:00100000:0.0:1784094217.137551:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1026 00000100:00100000:0.0:1784094217.137562:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013858304:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094217.137943:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013858304:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 382us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.137951:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1026 00000100:00100000:1.0:1784094217.140672:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094217.140744:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858432 00000100:00100000:3.0:1784094217.140752:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858432 00000100:00100000:3.0:1784094217.140799:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1027 00000100:00100000:3.0:1784094217.140817:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013858432:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094217.140899:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013858432:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094217.140907:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1027 00000100:00100000:1.0:1784094217.143509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094217.143616:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858560 00000100:00100000:2.0:1784094217.143625:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858560 00000100:00100000:2.0:1784094217.143671:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 528 00000100:00100000:2.0:1784094217.143680:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858560:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094217.144156:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858560:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 476us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094217.144164:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 528 00000100:00100000:2.0:1784094217.148910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.148995:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858688 00000100:00100000:0.0:1784094217.149005:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858688 00000100:00100000:0.0:1784094217.149053:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 529 00000100:00100000:0.0:1784094217.149060:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858688:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094217.149450:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:56847:x1870757013858688:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 389us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.149458:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 529 00000100:00100000:1.0:1784094217.151500:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.151711:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858816 00000100:00100000:0.0:1784094217.151720:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858816 00000100:00100000:0.0:1784094217.151773:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1028 00000100:00100000:0.0:1784094217.151782:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013858816:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094217.152189:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56847:x1870757013858816:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 407us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.152197:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1028 00000100:00100000:2.0:1784094217.170267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.170803:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013858944 00000100:00100000:0.0:1784094217.170814:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013858944 00000100:00100000:0.0:1784094217.170876:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1029 00000100:00100000:0.0:1784094217.170887:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:56848:x1870757013858944:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094217.170907:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094217.170939:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d3b expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.171003:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc00f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.171017:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.171031:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094217.171233:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:0.0:1784094217.171238:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094217.171309:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc00f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.171334:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d3b expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.171354:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc00f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d3b expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.171363:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784094217.171366:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094217.171370:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77800, rc 0) 00000100:00100000:0.0:1784094217.171469:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:56848:x1870757013858944:12345-192.168.204.57@tcp:101:rm.0 Request processed in 582us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094217.171477:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1029 00000100:00100000:2.0:1784094217.175817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094217.175881:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013859200 00000100:00100000:1.0:1784094217.175892:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013859200 00000100:00100000:1.0:1784094217.175958:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1030 00000100:00100000:1.0:1784094217.175970:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:56848:x1870757013859200:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094217.175993:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094217.176029:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d42 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094217.176320:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:1.0:1784094217.176592:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc016 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d42 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094217.176607:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784094217.176610:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784094217.176615:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d42 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094217.176634:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094217.176690:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:56848:x1870757013859200:12345-192.168.204.57@tcp:101:rm.0 Request processed in 722us (950us total) trans 4294967690 rc 301/301 00000100:00100000:1.0:1784094217.176699:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1030 00000100:00100000:1.0:1784094217.180456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094217.180551:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013859328 00000100:00100000:2.0:1784094217.180561:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013859328 00000100:00100000:2.0:1784094217.180668:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 104 00000100:00100000:2.0:1784094217.180680:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:56848:x1870757013859328:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784094217.184081:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:56848:x1870757013859328:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3396us (3628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094217.184092:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 104 00000100:00100000:1.0:1784094217.186867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.186987:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013859584 00000100:00100000:0.0:1784094217.186997:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013859584 00000100:00100000:0.0:1784094217.187055:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 105 00000100:00100000:0.0:1784094217.187066:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:56848:x1870757013859584:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:0.0:1784094217.187617:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:56848:x1870757013859584:12345-192.168.204.57@tcp:35:rm.0 Request processed in 548us (754us total) trans 4294967691 rc 0/0 00000100:00100000:0.0:1784094217.187626:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 105 00000100:00100000:2.0:1784094217.190510:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094217.190605:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013859840 00000100:00100000:0.0:1784094217.190615:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013859840 00000100:00100000:0.0:1784094217.190671:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1031 00000100:00100000:0.0:1784094217.190681:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:56848:x1870757013859840:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094217.190735:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784094217.190762:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc00f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d3b expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190783:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cbfb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d26 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190793:0:5778:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cbc11) 00010000:00010000:0.0:1784094217.190798:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784094217.190810:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094217.190836:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190849:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190859:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190873:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190881:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.190888:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192548:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192562:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192570:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192705:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192713:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192725:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192731:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094217.192735:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192742:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192752:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6b600) 00010000:00010000:0.0:1784094217.192754:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094217.192758:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192765:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc032 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192780:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192787:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192791:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192796:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094217.192799:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192804:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192811:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784094217.192813:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094217.192816:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192821:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77600/0x9ce98053214cc024 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192831:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192836:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192841:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192845:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094217.192849:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192854:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192860:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907202e6bf00) 00010000:00010000:0.0:1784094217.192862:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094217.192865:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094217.192870:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc02b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094217.192949:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:56848:x1870757013859840:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2268us (2446us total) trans 0 rc -13/-13 00000100:00100000:0.0:1784094217.192958:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1031 00000100:00100000:0.0:1784094217.193679:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024346368:0@lo:400:kworker.0 00000100:00100000:0.0:1784094217.193744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094217.193845:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346368 00000100:00100000:3.0:1784094217.193853:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346368 00000100:00100000:3.0:1784094217.193892:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1784094217.193900:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024346368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094217.194091:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024346752:0@lo:400:kworker.0 00000100:00100000:1.0:1784094217.194117:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094217.194146:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024346368:12345-0@lo:400:kworker.0 Request processed in 245us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094217.194155:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1784094217.194200:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024346496:0@lo:400:kworker.0 00000100:00100000:3.0:1784094217.194229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094217.194258:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094217.194264:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024346624:0@lo:400:kworker.0 00000100:00100000:3.0:1784094217.194285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094217.194313:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346496 00000100:00100000:3.0:1784094217.194317:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346496 00000100:00100000:3.0:1784094217.194343:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346624 00000100:00100000:3.0:1784094217.194346:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346624 00000100:00100000:1.0:1784094217.194353:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1784094217.194362:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024346496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094217.194395:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:3.0:1784094217.194405:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024346624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094217.194454:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024346496:12345-0@lo:400:kworker.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094217.194462:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:3.0:1784094217.194472:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024346624:12345-0@lo:400:kworker.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094217.194479:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00080000:3.0:1784094217.194507:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094217.194528:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094217.194534:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094217.194545:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024346624:0@lo:400:kworker.0 00000100:00100000:3.0:1784094217.194561:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024346496:0@lo:400:kworker.0 00000100:00100000:1.0:1784094217.194562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094217.194598:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346880 00000100:00100000:3.0:1784094217.194602:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346880 00000100:00100000:3.0:1784094217.194644:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1784094217.194651:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024346880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094217.194679:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784094217.194718:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094217.194878:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094217.194888:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024347008:0@lo:400:kworker.0 00000100:00100000:2.0:1784094217.194917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094217.194966:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347008 00000100:00100000:1.0:1784094217.194971:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347008 00000100:00100000:3.0:1784094217.194990:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024346880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 338us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094217.195003:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1784094217.195038:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024346880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094217.195068:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1784094217.195077:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024347008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784094217.195109:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094217.195124:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024347008:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094217.195131:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1784094217.195167:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024346752 00000100:00100000:1.0:1784094217.195171:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024347008:0@lo:400:kworker.0 00000100:00100000:3.0:1784094217.195172:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024346752 00000100:00100000:3.0:1784094217.195208:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1784094217.195216:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024346752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094217.195262:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024346752:12345-0@lo:400:kworker.0 Request processed in 47us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094217.195268:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00080000:2.0:1784094217.195290:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094217.195358:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024346752:0@lo:400:kworker.0 00000100:00100000:0.0:1784094217.195505:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024346368:0@lo:400:kworker.0 00010000:00010000:2.0:1784094217.709857:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094218.730610:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094218.739894:0:95149:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefda3d100 20000000:00000080:2.0:1784094218.739910:0:95149:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103d800 uarg=0000000000000000 00010000:00010000:2.0:1784094218.740365:0:95149:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094218.740381:0:95149:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094218.740395:0:95149:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094218.740412:0:95149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094218.740485:0:95149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094218.740494:0:95149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094218.740533:0:95149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094218.740548:0:95149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 18 pid: 5772 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094218.740563:0:95149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95149:1870757024347136:0@lo:104: 00000100:00100000:2.0:1784094218.740620:0:95149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094218.740710:0:95149:0:(client.c:2702:ptlrpc_set_wait()) set ffff907204fb6840 going to sleep for 11 seconds 00000100:00100000:0.0:1784094218.740807:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347136 00000100:00100000:0.0:1784094218.740814:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347136 00000100:00100000:0.0:1784094218.740893:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784094218.740902:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:95149:x1870757024347136:12345-0@lo:104: 00010000:00010000:0.0:1784094218.740914:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094218.740979:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094218.740985:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:95149:x1870757024347136:12345-0@lo:104: Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094218.740993:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00010000:3.0:1784094218.741038:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094218.741045:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741052:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1c54c20) 00000100:00100000:1.0:1784094218.741053:0:95149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95149:1870757024347136:0@lo:104: 10000000:00010000:3.0:1784094218.741055:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741063:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094218.741070:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741070:0:95149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094218.741077:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094218.741108:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741115:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094218.741142:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741149:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76800/0x9ce98053214cbf91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cbf98 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741163:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094218.741165:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094218.741167:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094218.741175:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094218.741185:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024347264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094218.741216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094218.741369:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347264 00000100:00100000:1.0:1784094218.741374:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347264 00010000:00010000:1.0:1784094218.741395:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 19 pid: 5772 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094218.741528:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1784094218.741537:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024347264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094218.741548:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094218.741554:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 19 pid: 5772 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741564:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 19 pid: 5772 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741575:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40400/0x9ce98053214cbf98 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cbf91 expref: 19 pid: 5772 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741593:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741601:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741614:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741621:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741627:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741633:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741638:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094218.741641:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741648:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741670:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094218.741679:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094218.741717:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024347264:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094218.741725:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:3.0:1784094218.741781:0:95149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741790:0:95149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094218.741796:0:95149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41c00/0x9ce98053214cc039 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094218.742829:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024347264:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784094219.167840:0:95197:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9812afc0 20000000:00000080:2.0:1784094219.167909:0:95197:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103e000 uarg=0000000000000000 00010000:00010000:2.0:1784094219.168112:0:95197:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094219.168125:0:95197:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094219.168136:0:95197:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094219.168154:0:95197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168168:0:95197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168178:0:95197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168184:0:95197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168191:0:95197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168198:0:95197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168204:0:95197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094219.168207:0:95197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168215:0:95197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168225:0:95197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168233:0:95197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094219.168239:0:95197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214cc040 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094219.241645:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024347392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094219.241722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094219.241756:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347392 00000100:00100000:0.0:1784094219.241764:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347392 00000100:00100000:0.0:1784094219.241828:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1784094219.241837:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024347392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094219.241868:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094219.241924:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024347392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094219.241931:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00080000:0.0:1784094219.242547:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094219.242659:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024347392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094219.753819:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784094220.074984:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094220.074992:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094220.075000:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094220.075048:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094220.075060:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094220.075071:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094220.075098:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024347520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094220.075170:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094220.075242:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094220.075270:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347520 00000100:00100000:0.0:1784094220.075279:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347520 00000100:00100000:0.0:1784094220.075344:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1784094220.075354:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024347520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094220.075368:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094220.075383:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc047 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.075406:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc047 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.075417:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc047 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.075462:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784094220.076623:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024347520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1268us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.076631:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1784094220.076718:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024347520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094220.076737:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094220.076746:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094220.076766:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094220.076771:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094220.076779:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094220.732778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.733062:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013859968 00000100:00100000:0.0:1784094220.733072:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013859968 00000100:00100000:0.0:1784094220.733172:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1032 00000100:00100000:0.0:1784094220.733183:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:56961:x1870757013859968:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094220.733204:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094220.733225:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc055 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d49 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.733282:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc05c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.733296:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc05c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.733320:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc05c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094220.733567:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094220.733572:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094220.733651:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc05c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.733675:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d49 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.733691:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc05c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d49 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.733706:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784094220.733709:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094220.733713:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094220.733809:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:56961:x1870757013859968:12345-192.168.204.57@tcp:101:rm.0 Request processed in 628us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.733817:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1032 00000100:00080000:2.0:1784094220.733852:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094220.736400:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.736720:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013860096 00000100:00100000:0.0:1784094220.736728:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013860096 00000100:00100000:0.0:1784094220.737375:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1033 00000100:00100000:0.0:1784094220.737386:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:56961:x1870757013860096:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094220.737404:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094220.737460:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d50 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737512:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737524:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737534:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737547:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737553:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737563:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737860:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737868:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.737875:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094220.737956:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00000004:00200000:0.0:1784094220.737961:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094220.738027:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738039:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738046:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738052:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738059:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094220.738063:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738070:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738082:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784094220.738085:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094220.738089:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738094:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc06a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738104:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738110:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738115:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738119:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094220.738122:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738128:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738134:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907202e6b900) 00010000:00010000:0.0:1784094220.738137:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094220.738139:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738144:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc071 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738174:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d50 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738194:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d50 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.738201:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094220.738204:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094220.738206:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784094220.738262:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:56961:x1870757013860096:12345-192.168.204.57@tcp:101:rm.0 Request processed in 878us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.738270:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1033 00000100:00100000:1.0:1784094220.741657:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094220.741709:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013860352 00000100:00100000:3.0:1784094220.741718:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013860352 00000100:00100000:3.0:1784094220.741770:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1034 00000100:00100000:3.0:1784094220.741794:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:56961:x1870757013860352:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094220.741814:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094220.741832:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc07f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d57 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094220.742043:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:3.0:1784094220.742212:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc07f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d57 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.742226:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:3.0:1784094220.742230:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784094220.742234:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc07f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d57 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.742245:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784094220.742294:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:56961:x1870757013860352:12345-192.168.204.57@tcp:101:rm.0 Request processed in 504us (643us total) trans 4294967692 rc 301/301 00000100:00100000:3.0:1784094220.742301:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1034 00000100:00100000:2.0:1784094220.744779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094220.745291:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013860480 00000100:00100000:1.0:1784094220.745300:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013860480 00000100:00100000:1.0:1784094220.745354:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 106 00000100:00100000:1.0:1784094220.745363:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:56961:x1870757013860480:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784094220.751094:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:56961:x1870757013860480:12345-192.168.204.57@tcp:37:rm.0 Request processed in 5723us (6310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094220.751107:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 106 00000100:00100000:3.0:1784094220.754752:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.754859:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013860736 00000100:00100000:0.0:1784094220.754868:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013860736 00000100:00100000:0.0:1784094220.754980:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 107 00000100:00100000:0.0:1784094220.754987:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:56961:x1870757013860736:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:0.0:1784094220.755648:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:56961:x1870757013860736:12345-192.168.204.57@tcp:35:rm.0 Request processed in 659us (899us total) trans 4294967693 rc 0/0 00000100:00100000:0.0:1784094220.755657:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 107 00000100:00100000:1.0:1784094220.758070:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.758135:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013860992 00000100:00100000:0.0:1784094220.758146:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013860992 00000100:00100000:0.0:1784094220.758202:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1035 00000100:00100000:0.0:1784094220.758212:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:56961:x1870757013860992:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094220.758255:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094220.758278:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d50 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758292:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094220.758323:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc05c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d49 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758348:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784094220.758355:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094220.758381:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758397:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758408:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758471:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758591:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758599:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758861:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758871:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.758942:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094220.759852:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 7680 00010000:00010000:0.0:1784094220.759870:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.759973:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.759981:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.759987:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094220.759991:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.759998:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760008:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094220.760011:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094220.760015:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760021:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc09b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760041:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760047:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760054:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760059:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094220.760062:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760067:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760075:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784094220.760077:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094220.760080:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.760085:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc08d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094220.760096:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c9f83d8e reply state 0000000087b3bc13 transno 4294967694 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094220.760104:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094220.760188:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:56961:x1870757013860992:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1975us (2120us total) trans 4294967694 rc 0/0 00000100:00100000:0.0:1784094220.760196:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1035 00010000:00010000:2.0:1784094220.762049:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.762061:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.762067:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.762071:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094220.762075:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.762080:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.762092:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907202e6be00) 00010000:00010000:2.0:1784094220.762095:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094220.762098:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.762103:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc094 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.778451:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094220.784809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.785176:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013861120 00000100:00100000:0.0:1784094220.785187:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013861120 00000100:00100000:0.0:1784094220.785238:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1036 00000100:00100000:0.0:1784094220.785318:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:56965:x1870757013861120:12345-192.168.204.57@tcp:101:mkdir.0 00010000:00010000:0.0:1784094220.785344:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094220.785368:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc0a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d5e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.785574:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc0a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.785590:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.785602:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094220.785735:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094220.785739:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094220.785830:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.785854:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc0a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d5e expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.785871:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d5e expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.785879:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094220.785881:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094220.785885:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784094220.785944:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:56965:x1870757013861120:12345-192.168.204.57@tcp:101:mkdir.0 Request processed in 696us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.786021:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1036 00000100:00100000:1.0:1784094220.788387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094220.788556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094220.788685:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013861248 00000100:00100000:3.0:1784094220.788692:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013861248 00000100:00100000:3.0:1784094220.788722:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013861504 00000100:00100000:3.0:1784094220.788725:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013861504 00000100:00100000:0.0:1784094220.788840:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1037 00000100:00100000:0.0:1784094220.788852:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:2353:x1870757013861248:12345-192.168.204.57@tcp:41:mkdir.0 00000004:00000024:0.0:1784094220.788886:0:5777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784094220.789002:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:2353:x1870757013861248:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 153us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.789010:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1037 00000100:00100000:3.0:1784094220.789243:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1038 00000100:00100000:3.0:1784094220.789252:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:56965:x1870757013861504:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:3.0:1784094220.789335:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094220.789359:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc0a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d5e expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.789379:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b800) 00010000:00010000:3.0:1784094220.789390:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094220.789939:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.789965:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.789974:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.789989:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.789999:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.790005:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094220.791313:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 512 00010000:00010000:3.0:1784094220.791328:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.791335:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.791343:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.791352:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094220.791359:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.791367:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.791379:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784094220.791383:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094220.791388:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.791395:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094220.791434:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000001e6b2bcf reply state 000000005a34a48a transno 4294967695 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094220.791446:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094220.791608:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:56965:x1870757013861504:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 2355us (3050us total) trans 4294967695 rc 0/0 00000100:00100000:3.0:1784094220.791617:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1038 00010000:00010000:2.0:1784094220.794220:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.794235:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.794241:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.794246:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094220.794249:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.794254:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.794265:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fce400) 00010000:00010000:2.0:1784094220.794268:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094220.794270:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.794275:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc0b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094220.805653:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967694 is committed 00000100:00100000:2.0:1784094220.819324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.819395:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013861632 00000100:00100000:0.0:1784094220.819405:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013861632 00000100:00100000:0.0:1784094220.819659:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1039 00000100:00100000:0.0:1784094220.819669:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:56969:x1870757013861632:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784094220.819696:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094220.819718:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc0be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d65 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.819771:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc0c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.819783:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.819793:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094220.819851:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094220.819855:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094220.819875:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc0c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.819896:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc0be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d65 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.819912:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc0c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d65 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.819921:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094220.819925:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094220.819927:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094220.819986:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:56969:x1870757013861632:12345-192.168.204.57@tcp:101:chown.0 Request processed in 319us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.819993:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1039 00000100:00100000:3.0:1784094220.821382:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094220.821465:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013861760 00000100:00100000:0.0:1784094220.821471:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013861760 00000100:00100000:0.0:1784094220.821513:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1040 00000100:00100000:0.0:1784094220.821522:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:56969:x1870757013861760:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784094220.821534:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094220.821545:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc0cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d6c expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821579:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821589:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821598:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821609:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821616:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821623:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821690:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc0e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821697:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821704:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094220.821729:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 512 00000004:00200000:0.0:1784094220.821732:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094220.821745:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821755:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821762:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821769:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821788:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094220.821792:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821800:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821810:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094220.821812:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094220.821816:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821822:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc0d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821832:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821838:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821844:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821848:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094220.821851:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821856:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821862:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907202e6bc00) 00010000:00010000:0.0:1784094220.821864:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094220.821866:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821876:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc0da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821897:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc0cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d6c expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821908:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d6c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094220.821914:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784094220.821916:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094220.821918:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094220.821959:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:56969:x1870757013861760:12345-192.168.204.57@tcp:101:chown.0 Request processed in 439us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094220.821965:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1040 00000100:00100000:2.0:1784094220.823828:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094220.823889:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862016 00000100:00100000:3.0:1784094220.823897:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862016 00000100:00100000:3.0:1784094220.823953:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1041 00000100:00100000:3.0:1784094220.823962:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:56969:x1870757013862016:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:3.0:1784094220.823999:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094220.824020:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc0e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d6c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.824043:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6b900) 00010000:00010000:3.0:1784094220.824052:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094220.824084:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.824094:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094220.824103:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094220.849820:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006f93de38 reply state 000000008b3bbd90 transno 4294967696 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094220.849843:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094220.849990:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:2.0:1784094220.850251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:56969:x1870757013862016:12345-192.168.204.57@tcp:36:chown.0 Request processed in 26286us (26421us total) trans 4294967696 rc 0/0 00000100:00100000:2.0:1784094220.850261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1041 00000001:00080000:2.0:1784094220.850316:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967696 is committed 00010000:00010000:2.0:1784094220.850337:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.850346:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.850352:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.850358:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094220.850363:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.850370:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.850388:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784094220.850391:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094220.850396:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094220.850402:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc0e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094221.273549:0:95396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4daf6de0 20000000:00000080:0.0:1784094221.273566:0:95396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907231063800 uarg=0000000000000000 00010000:00010000:0.0:1784094221.273936:0:95396:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094221.273964:0:95396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6b400) 00010000:00010000:0.0:1784094221.273967:0:95396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094221.273975:0:95396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc0c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d65 expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.273991:0:95396:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784094221.274001:0:95396:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094221.274011:0:95396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.274024:0:95396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc047 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.274029:0:95396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.274057:0:95396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc047 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.274067:0:95396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc047 expref: 18 pid: 5770 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094221.274077:0:95396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95396:1870757024347648:0@lo:104: 00000100:00100000:0.0:1784094221.274385:0:95396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094221.274556:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347648 00000100:00100000:3.0:1784094221.274564:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347648 00000100:00100000:0.0:1784094221.274593:0:95396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094221.274645:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1784094221.274657:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:95396:x1870757024347648:12345-0@lo:104: 00010000:00010000:2.0:1784094221.274671:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.274738:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094221.274745:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:95396:x1870757024347648:12345-0@lo:104: Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094221.274752:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1784094221.274828:0:95396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95396:1870757024347648:0@lo:104: 00010000:00010000:0.0:1784094221.274845:0:95396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.274903:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094221.274910:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.274918:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094221.274922:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.274930:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094221.274937:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094221.274943:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094221.274969:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.274976:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094221.275010:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.275017:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12000/0x9ce98053214cc047 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc04e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.275031:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094221.275033:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094221.275035:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094221.275073:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024347776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094221.275102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094221.275325:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347776 00000100:00100000:2.0:1784094221.275330:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347776 00010000:00010000:2.0:1784094221.275353:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc047 expref: 19 pid: 5770 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094221.275389:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1784094221.275397:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024347776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094221.275407:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094221.275412:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc047 expref: 19 pid: 5770 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275634:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc047 expref: 19 pid: 5770 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275649:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214cc04e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc047 expref: 19 pid: 5770 timeout: 1532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275661:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275674:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275688:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275696:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275703:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275709:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275715:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094221.275718:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.275725:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.275848:0:95396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094221.275856:0:95396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.276841:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.276852:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214cc0ef lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094221.276867:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094221.276914:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024347776:12345-0@lo:103:ldlm_bl.0 Request processed in 1518us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094221.276923:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784094221.276995:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024347776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094221.691998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094221.692041:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094221.692085:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094221.692126:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094221.692247:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862272 00000100:00100000:0.0:1784094221.692258:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862272 00000100:00100000:1.0:1784094221.692261:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862528 00000100:00100000:1.0:1784094221.692269:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862528 00000100:00100000:0.0:1784094221.692329:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 949 00000100:00100000:1.0:1784094221.692331:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862400 00000100:00100000:1.0:1784094221.692336:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862400 00000100:00100000:0.0:1784094221.692342:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013862272:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094221.692363:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 720 00000100:00100000:1.0:1784094221.692374:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013862528:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094221.692439:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862144 00000100:00100000:0.0:1784094221.692442:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013862272:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094221.692443:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862144 00000100:00100000:0.0:1784094221.692450:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 949 00000100:00100000:2.0:1784094221.692475:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 876 00000100:00100000:2.0:1784094221.692482:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013862144:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094221.692497:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 721 00000100:00100000:0.0:1784094221.692504:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013862400:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094221.692510:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013862144:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094221.692517:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 876 00000100:00100000:0.0:1784094221.692526:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013862400:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094221.692532:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 721 00000100:00080000:0.0:1784094221.692546:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094221.692550:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094221.692701:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013862528:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 329us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094221.692709:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 720 00000020:00000080:3.0:1784094221.696924:0:95444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe046b95a0 20000000:00000080:3.0:1784094221.696945:0:95444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df7c00 uarg=0000000000000000 00010000:00010000:3.0:1784094221.697189:0:95444:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094221.697205:0:95444:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094221.697219:0:95444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094221.697238:0:95444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697255:0:95444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697266:0:95444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697273:0:95444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697281:0:95444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697302:0:95444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697308:0:95444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094221.697313:0:95444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697320:0:95444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697333:0:95444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697341:0:95444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.697347:0:95444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc0f6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094221.807998:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094222.313650:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024348032:0@lo:400:kworker.0 00000100:00100000:0.0:1784094222.313684:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024347904:0@lo:400:kworker.0 00000100:00100000:2.0:1784094222.313738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094222.313741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094222.313767:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024348160:0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.313806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094222.313809:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024348544:0@lo:400:kworker.0 00000100:00100000:0.0:1784094222.313814:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024348416:0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.313834:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024348672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094222.313857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094222.313859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094222.313881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094222.313911:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094222.313919:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024348288:0@lo:400:kworker.0 00000100:00100000:0.0:1784094222.313936:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024347904 00000100:00100000:2.0:1784094222.313937:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348032 00000100:00100000:3.0:1784094222.313946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094222.313946:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348032 00000100:00100000:0.0:1784094222.313947:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024347904 00000100:00100000:3.0:1784094222.313984:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348544 00000100:00100000:3.0:1784094222.313989:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348544 00000100:00100000:0.0:1784094222.314007:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1784094222.314035:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348288 00000100:00100000:3.0:1784094222.314038:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348288 00000100:00100000:3.0:1784094222.314063:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1784094222.314071:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024348544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.314124:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024348544:12345-0@lo:400:kworker.0 Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094222.314132:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1784094222.314151:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1784094222.314157:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024348288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.314188:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024348288:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094222.314194:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1784094222.314214:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348672 00000100:00100000:3.0:1784094222.314218:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348672 00000100:00100000:3.0:1784094222.314241:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1784094222.314249:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024347904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.314253:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024348672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094222.314299:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094222.314338:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024348672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094222.314344:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00080000:3.0:1784094222.314363:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094222.314367:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094222.314397:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024348288:0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.314414:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024348672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094222.314479:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024348544:0@lo:400:kworker.0 00000100:00100000:0.0:1784094222.316249:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024347904:12345-0@lo:400:kworker.0 Request processed in 1998us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094222.316263:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1784094222.316400:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348160 00000100:00100000:3.0:1784094222.316410:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348160 00000100:00100000:3.0:1784094222.316475:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348416 00000100:00100000:3.0:1784094222.316479:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348416 00000100:00100000:3.0:1784094222.316500:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1784094222.316509:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024348032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.316576:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024348032:12345-0@lo:400:kworker.0 Request processed in 68us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094222.316583:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1784094222.316597:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1784094222.316603:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024348160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.316636:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024348160:12345-0@lo:400:kworker.0 Request processed in 34us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094222.316642:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1784094222.316653:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1784094222.316660:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024348416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.316688:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024348416:12345-0@lo:400:kworker.0 Request processed in 29us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094222.316694:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00080000:3.0:1784094222.316713:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094222.316748:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024348160:0@lo:400:kworker.0 00000100:00100000:3.0:1784094222.316792:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024348032:0@lo:400:kworker.0 00000100:00100000:0.0:1784094222.317147:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024347904:0@lo:400:kworker.0 00000100:00100000:0.0:1784094222.317163:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024348416:0@lo:400:kworker.0 10000000:01000000:1.0:1784094222.442540:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094222.442545:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094222.442550:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094222.442589:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094222.442597:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094222.442605:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094222.442633:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024348800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094222.442696:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094222.442739:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230d9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094222.442842:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348800 00000100:00100000:2.0:1784094222.442851:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348800 00000100:00100000:2.0:1784094222.442909:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1784094222.442919:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024348800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094222.442932:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094222.442946:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc0fd expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094222.442975:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094222.442986:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094222.442995:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784094222.443128:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024348800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094222.443137:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1784094222.443149:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024348800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094222.443164:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094222.443170:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094222.443184:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094222.443188:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094222.443193:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094222.825857:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094223.185977:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094223.186036:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862656 00000100:00100000:1.0:1784094223.186046:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862656 00000100:00080000:3.0:1784094223.186107:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094223.186124:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 16 00000100:00100000:1.0:1784094223.186137:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:5558:x1870757013862656:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094223.186395:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094223.186400:0:5765:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc0c5) 00010000:00010000:1.0:1784094223.186402:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094223.186515:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:5558:x1870757013862656:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 380us (545us total) trans 0 rc 116/116 00000100:00100000:1.0:1784094223.186523:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 16 00010000:00010000:2.0:1784094223.849815:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094224.067682:0:95688:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1de43fa0 20000000:00000080:3.0:1784094224.067697:0:95688:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb14000 uarg=0000000000000000 00010000:00010000:3.0:1784094224.067881:0:95688:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094224.067892:0:95688:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094224.067901:0:95688:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094224.067916:0:95688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094224.067928:0:95688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094224.067935:0:95688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094224.067965:0:95688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094224.067979:0:95688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 18 pid: 5771 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094224.067995:0:95688:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95688:1870757024348928:0@lo:104: 00000100:00100000:3.0:1784094224.068234:0:95688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094224.068336:0:95688:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230d079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094224.068392:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024348928 00000100:00100000:0.0:1784094224.068400:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024348928 00000100:00100000:0.0:1784094224.068472:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1784094224.068482:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:95688:x1870757024348928:12345-0@lo:104: 00010000:00010000:0.0:1784094224.068494:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094224.068560:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094224.068566:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:95688:x1870757024348928:12345-0@lo:104: Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094224.068573:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00010000:2.0:1784094224.068594:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094224.068603:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068612:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094224.068617:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068627:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094224.068635:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094224.068642:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094224.068681:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068689:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094224.068723:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068731:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc0fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc104 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094224.068734:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024349056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094224.068751:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094224.068754:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094224.068756:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094224.068772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094224.068837:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349056 00000100:00100000:2.0:1784094224.068840:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349056 00010000:00010000:2.0:1784094224.068861:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 19 pid: 5771 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094224.068886:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1784094224.068892:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024349056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094224.068901:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784094224.068901:0:95688:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95688:1870757024348928:0@lo:104: 00010000:00010000:2.0:1784094224.068907:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 19 pid: 5771 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068921:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 19 pid: 5771 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068931:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41c00/0x9ce98053214cc104 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc0fd expref: 19 pid: 5771 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094224.068934:0:95688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068941:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068951:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068961:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068966:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068970:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068975:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068978:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094224.068980:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068985:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.068994:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094224.069000:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094224.069028:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024349056:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094224.069032:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00010000:1.0:1784094224.069084:0:95688:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094224.069093:0:95688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094224.069099:0:95688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc10b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094224.069529:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024349056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094224.361640:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094224.361659:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024349184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094224.361723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094224.361780:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349184 00000100:00100000:3.0:1784094224.361788:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349184 00000100:00100000:3.0:1784094224.361838:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1784094224.361848:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024349184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094224.361887:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094224.361933:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024349184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094224.361941:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00080000:3.0:1784094224.361961:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094224.361995:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024349184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094224.874683:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094225.605622:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094225.605714:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862784 00000100:00100000:3.0:1784094225.605724:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862784 00000100:00100000:3.0:1784094225.605830:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1042 00000100:00100000:3.0:1784094225.605841:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:57146:x1870757013862784:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094225.605862:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094225.605884:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d73 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.605942:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc119 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.605957:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.605969:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094225.606157:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784094225.606163:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094225.606258:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.606288:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d73 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.606303:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc119 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d73 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784094225.606437:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094225.606503:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784094225.606507:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094225.606511:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784094225.606612:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:57146:x1870757013862784:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 772us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094225.606620:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1042 00000100:00100000:2.0:1784094225.608659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094225.608749:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013862912 00000100:00100000:3.0:1784094225.608758:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013862912 00000100:00100000:3.0:1784094225.608806:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1043 00000100:00100000:3.0:1784094225.608816:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:57146:x1870757013862912:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094225.608833:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094225.608850:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d7a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.608900:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.608914:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.608925:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.608939:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.608959:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.608966:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609592:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609602:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609610:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094225.609692:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1784094225.609696:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094225.609766:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609779:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609785:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609792:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609803:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094225.609811:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609819:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609831:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784094225.609834:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094225.609838:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609844:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609853:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609860:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609866:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609872:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094225.609875:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609882:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609893:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fceb00) 00010000:00010000:3.0:1784094225.609895:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094225.609898:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609903:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc12e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.609932:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d7a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.610007:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d7a expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094225.610015:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784094225.610018:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094225.610020:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094225.610194:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:57146:x1870757013862912:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 1378us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094225.610203:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1043 00000100:00100000:2.0:1784094225.613537:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094225.613615:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013863168 00000100:00100000:1.0:1784094225.613625:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013863168 00000100:00100000:1.0:1784094225.613684:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1044 00000100:00100000:1.0:1784094225.613695:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:57146:x1870757013863168:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784094225.613742:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094225.613769:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d7a expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094225.613786:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784094225.613797:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094225.613822:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094225.613835:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094225.613845:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094225.641943:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000007da957d1 reply state 00000000c66358ee transno 4294967697 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094225.641962:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784094225.642097:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000001:00080000:0.0:1784094225.642310:0:95357:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967697 is committed 00010000:00080000:1.0:1784094225.642602:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784094225.642661:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:57146:x1870757013863168:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 28965us (29129us total) trans 4294967697 rc 0/0 00000100:00100000:1.0:1784094225.642670:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1044 00010000:00010000:0.0:1784094225.642733:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094225.643035:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094225.643043:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094225.643050:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094225.643054:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094225.643119:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094225.643134:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12400) 00010000:00010000:0.0:1784094225.643138:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094225.643143:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094225.643150:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc13c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094225.898396:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094226.026533:0:95883:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff75d7a4b0 10000000:01000000:1.0:1784094226.026536:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094226.026542:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094226.026548:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 20000000:00000080:0.0:1784094226.026551:0:95883:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907231060400 uarg=0000000000000000 00010000:00010000:1.0:1784094226.026594:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.026606:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.026627:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094226.026653:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024349312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094226.026725:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094226.026793:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094226.026844:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349312 00000100:00100000:2.0:1784094226.026850:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349312 00000100:00100000:2.0:1784094226.026899:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1784094226.026911:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024349312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094226.026924:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094226.026939:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc143 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094226.026972:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc143 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094226.026984:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc143 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094226.026993:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784094226.027079:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024349312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094226.027088:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00010000:00010000:0.0:1784094226.027091:0:95883:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094226.027125:0:95883:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce100) 00010000:00010000:0.0:1784094226.027129:0:95883:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094226.027138:0:95883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc119 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d73 expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094226.027149:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024349312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094226.027161:0:95883:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784094226.027166:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027177:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094226.027178:0:95883:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094226.027192:0:95883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094226.027198:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094226.027203:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094226.027221:0:95883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc143 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027224:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094226.027243:0:95883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094226.027267:0:95883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc143 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094226.027279:0:95883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc143 expref: 18 pid: 5772 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094226.027294:0:95883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95883:1870757024349440:0@lo:104: 00000100:00100000:0.0:1784094226.027323:0:95883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094226.027351:0:95883:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cd8b240 going to sleep for 11 seconds 00000100:00100000:2.0:1784094226.027366:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349440 00000100:00100000:2.0:1784094226.027372:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349440 00000100:00100000:2.0:1784094226.027418:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784094226.027450:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:95883:x1870757024349440:12345-0@lo:104: 00010000:00010000:2.0:1784094226.027460:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094226.027503:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094226.027509:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:95883:x1870757024349440:12345-0@lo:104: Request processed in 61us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1784094226.027512:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784094226.027515:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:1.0:1784094226.027518:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027525:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094226.027529:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027541:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094226.027549:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094226.027555:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094226.027582:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094226.027586:0:95883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95883:1870757024349440:0@lo:104: 00010000:00010000:1.0:1784094226.027589:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094226.027598:0:95883:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027607:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027614:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12a00/0x9ce98053214cc143 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc14a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027626:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094226.027628:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024349568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094226.027628:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094226.027630:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094226.027657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094226.027692:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349568 00000100:00100000:1.0:1784094226.027696:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349568 00010000:00010000:1.0:1784094226.027715:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc143 expref: 19 pid: 5772 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094226.027743:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1784094226.027750:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024349568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094226.027759:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094226.027764:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc143 expref: 19 pid: 5772 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027774:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc143 expref: 19 pid: 5772 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027785:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214cc14a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc143 expref: 19 pid: 5772 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027796:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027803:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027813:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027820:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027826:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027832:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027837:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094226.027840:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027847:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027869:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094226.027878:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094226.027893:0:95883:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094226.027903:0:95883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094226.027909:0:95883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77800/0x9ce98053214cc151 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094226.027914:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024349568:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094226.027924:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1784094226.027951:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024349568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094226.809416:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094226.809480:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013863424 00000100:00100000:2.0:1784094226.809486:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094226.809492:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013863424 00000100:00100000:3.0:1784094226.809546:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 953 00000100:00100000:3.0:1784094226.809558:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013863424:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094226.809565:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094226.809595:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094226.809634:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013863424:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094226.809643:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 953 00000100:00100000:3.0:1784094226.809664:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013863552 00000100:00100000:3.0:1784094226.809667:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013863552 00000100:00100000:0.0:1784094226.809678:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013863680 00000100:00100000:0.0:1784094226.809682:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013863680 00000100:00100000:3.0:1784094226.809697:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 724 00000100:00100000:3.0:1784094226.809703:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013863552:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094226.809761:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013863296 00000100:00100000:1.0:1784094226.809765:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013863296 00000100:00100000:1.0:1784094226.809788:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 880 00000100:00100000:1.0:1784094226.809793:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013863296:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094226.809845:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 725 00000100:00100000:0.0:1784094226.809855:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013863680:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094226.809909:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013863680:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094226.809917:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 725 00000100:00080000:0.0:1784094226.810529:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094226.810534:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094226.811752:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013863552:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 2038us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094226.811752:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013863296:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1947us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094226.811772:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 724 00000100:00100000:1.0:1784094226.811772:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 880 00010000:00010000:0.0:1784094226.921595:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094227.409354:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094227.409413:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013863808 00000100:00100000:3.0:1784094227.409450:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013863808 00000100:00100000:3.0:1784094227.409509:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1045 00000100:00100000:3.0:1784094227.409518:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57222:x1870757013863808:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094227.409539:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094227.409561:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d81 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.409624:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.409638:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.409654:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.409668:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.409676:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.409683:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784094227.409686:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094227.410070:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc16d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410079:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410086:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094227.410161:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1784094227.410165:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094227.410248:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410259:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410265:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410271:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410282:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094227.410286:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410294:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410306:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784094227.410308:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094227.410313:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410318:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410327:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410333:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410338:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410343:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094227.410345:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410351:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410361:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fcec00) 00010000:00010000:3.0:1784094227.410364:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094227.410366:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410372:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410400:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d81 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410414:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc16d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d81 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.410438:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094227.410441:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094227.410443:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784094227.410503:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:57222:x1870757013863808:12345-192.168.204.57@tcp:101:touch.0 Request processed in 985us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094227.410510:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1045 00000100:00100000:0.0:1784094227.412785:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094227.413221:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013864064 00000100:00100000:1.0:1784094227.413230:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013864064 00000100:00100000:1.0:1784094227.413290:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1046 00000100:00100000:1.0:1784094227.413302:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:57222:x1870757013864064:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094227.413321:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094227.413339:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc174 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d88 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.413729:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.413761:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.413775:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.413792:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.413799:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.413807:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094227.414736:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:0.0:1784094227.415064:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415074:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415083:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415121:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415129:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415136:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415143:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094227.415148:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415156:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415168:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:0.0:1784094227.415171:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094227.415176:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415193:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc17b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094227.415204:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c8535e12 reply state 0000000052652b6d transno 4294967698 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094227.415213:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094227.415248:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc174 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d88 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415265:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d88 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.415273:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff907202e6b700) 00010000:00010000:0.0:1784094227.415275:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094227.415277:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094227.415355:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:57222:x1870757013864064:12345-192.168.204.57@tcp:101:touch.0 Request processed in 2055us (2577us total) trans 4294967698 rc 0/0 00000100:00100000:0.0:1784094227.415363:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1046 00000100:00100000:0.0:1784094227.419486:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:1.0:1784094227.420068:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.420082:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.420096:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.420103:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094227.420107:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.420114:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.420131:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907202e6bf00) 00010000:00010000:1.0:1784094227.420134:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094227.420139:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.420145:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc182 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094227.420410:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013864320 00000100:00100000:3.0:1784094227.420440:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013864320 00000100:00100000:3.0:1784094227.420484:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1047 00000100:00100000:3.0:1784094227.420496:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:57222:x1870757013864320:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:3.0:1784094227.420554:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094227.420572:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d88 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.420588:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff907202e6b700) 00010000:00010000:3.0:1784094227.420595:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094227.420640:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.420654:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.420663:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094227.420797:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004937dac9 reply state 00000000ac63b45c transno 4294967699 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094227.420806:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094227.420902:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:57222:x1870757013864320:12345-192.168.204.57@tcp:36:touch.0 Request processed in 408us (1422us total) trans 4294967699 rc 0/0 00000100:00100000:3.0:1784094227.420910:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1047 00000100:00100000:1.0:1784094227.425484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:1.0:1784094227.425518:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425528:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425536:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425543:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094227.425547:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425555:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425571:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff907204fcea00) 00010000:00010000:1.0:1784094227.425574:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094227.425578:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425584:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094227.425622:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013864448 00000100:00100000:1.0:1784094227.425630:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013864448 00000100:00100000:1.0:1784094227.425672:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1048 00000100:00100000:1.0:1784094227.425680:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:57222:x1870757013864448:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094227.425700:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094227.425716:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc19e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d8f expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425767:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc19e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d8f expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425779:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc19e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d8f expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.425794:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094227.425797:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094227.425799:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784094227.425845:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:57222:x1870757013864448:12345-192.168.204.57@tcp:101:touch.0 Request processed in 166us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094227.425852:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1048 00000100:00100000:3.0:1784094227.429531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094227.429568:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013864576 00000100:00100000:3.0:1784094227.429577:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013864576 00000100:00100000:3.0:1784094227.429629:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 530 00000100:00100000:3.0:1784094227.429639:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013864576:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:3.0:1784094227.430299:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013864576:12345-192.168.204.57@tcp:2:touch.0 Request processed in 659us (775us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1784094227.430309:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 530 00000100:00100000:2.0:1784094227.433632:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024349952:0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.433702:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094227.433721:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024349696:0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.433763:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094227.433771:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024350080:0@lo:400:kworker.0 00000100:00100000:1.0:1784094227.433779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094227.433813:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024350208:0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.433814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094227.433850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094227.433861:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349952 00000100:00100000:2.0:1784094227.433868:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349952 00000100:00100000:1.0:1784094227.433873:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784094227.433881:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024349824:0@lo:400:kworker.0 00000100:00100000:1.0:1784094227.433908:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094227.433935:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024350336:0@lo:400:kworker.0 00000100:00100000:1.0:1784094227.433970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094227.434247:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350080 00000100:00100000:1.0:1784094227.434251:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350080 00000100:00100000:1.0:1784094227.434278:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350336 00000100:00100000:1.0:1784094227.434281:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350336 00000100:00100000:1.0:1784094227.434301:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1784094227.434309:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024350080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094227.434361:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024350080:12345-0@lo:400:kworker.0 Request processed in 52us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094227.434368:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1784094227.434384:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1784094227.434391:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024350336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094227.434453:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024350336:12345-0@lo:400:kworker.0 Request processed in 63us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094227.434459:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1784094227.434510:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024350336:0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.434748:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350208 00000100:00100000:2.0:1784094227.434754:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350208 00000100:00100000:2.0:1784094227.434782:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349824 00000100:00100000:2.0:1784094227.434784:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349824 00000100:00100000:3.0:1784094227.434788:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1784094227.434802:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1784094227.434803:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.434811:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094227.434854:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024349952:12345-0@lo:400:kworker.0 Request processed in 56us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094227.434861:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024350208:12345-0@lo:400:kworker.0 Request processed in 52us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094227.434863:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1784094227.434872:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1784094227.434887:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1784094227.434896:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024349824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.434904:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024349696 00000100:00100000:2.0:1784094227.434907:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024349696 00000100:00100000:3.0:1784094227.434935:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024349824:12345-0@lo:400:kworker.0 Request processed in 39us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094227.434935:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1784094227.434947:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1784094227.434947:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094227.434966:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094227.434976:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024350464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094227.434989:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024349696:12345-0@lo:400:kworker.0 Request processed in 44us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094227.434996:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1784094227.435011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784094227.435030:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094227.435035:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094227.435038:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094227.435044:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350464 00000100:00100000:3.0:1784094227.435049:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350464 00000100:00100000:2.0:1784094227.435071:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024349824:0@lo:400:kworker.0 00000100:00100000:3.0:1784094227.435079:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1784094227.435086:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024349696:0@lo:400:kworker.0 00000100:00100000:3.0:1784094227.435090:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024350464:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094227.435102:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024350208:0@lo:400:kworker.0 00002000:00000024:3.0:1784094227.435121:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094227.435132:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024350080:0@lo:400:kworker.0 00000100:00100000:2.0:1784094227.435146:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024349952:0@lo:400:kworker.0 00000100:00100000:3.0:1784094227.435165:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024350464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094227.435172:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1784094227.435220:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024350464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094227.435298:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094227.435341:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013864832 00000100:00100000:2.0:1784094227.435346:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013864832 00000100:00100000:2.0:1784094227.435508:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 108 00000100:00100000:2.0:1784094227.435518:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:57222:x1870757013864832:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:2.0:1784094227.436192:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:57222:x1870757013864832:12345-192.168.204.57@tcp:35:touch.0 Request processed in 675us (894us total) trans 4294967700 rc 0/0 00000100:00100000:2.0:1784094227.436201:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 108 00000100:00100000:2.0:1784094227.466469:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094227.466589:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013864960 00000100:00100000:0.0:1784094227.466599:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013864960 00000100:00100000:1.0:1784094227.466724:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1049 00000100:00100000:1.0:1784094227.466738:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:57226:x1870757013864960:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094227.466763:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094227.466783:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc1a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d96 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.466848:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.466862:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.466956:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.466973:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.466981:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.466989:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467081:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467160:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467171:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094227.467214:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x56:0x0]: returning size 0 00000004:00200000:1.0:1784094227.467218:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094227.467237:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467248:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467256:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467263:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467270:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467276:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094227.467280:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467288:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467299:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:1.0:1784094227.467302:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094227.467307:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467318:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc1ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467329:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467335:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467341:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467346:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094227.467349:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467355:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467362:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907219c12a00) 00010000:00010000:1.0:1784094227.467364:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094227.467366:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467371:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc1b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467397:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc1a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d96 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467626:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d96 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.467634:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094227.467637:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094227.467640:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784094227.467709:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:57226:x1870757013864960:12345-192.168.204.57@tcp:101:rm.0 Request processed in 974us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094227.467718:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1049 00000100:00100000:3.0:1784094227.471595:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094227.471780:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013865088 00000100:00100000:0.0:1784094227.471792:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013865088 00000100:00100000:0.0:1784094227.471882:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 531 00000100:00100000:0.0:1784094227.471892:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013865088:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094227.471914:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094227.471935:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5d9d expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784094227.471964:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x6a571e13, atime: 0x6a571e13, ctime: 0x6a571e13, blocks: 0x1 00010000:00010000:0.0:1784094227.471981:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=1388s v=(0 0) 00010000:00010000:0.0:1784094227.471985:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094227.471991:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.472005:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.472015:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00000100:00100000:0.0:1784094227.472061:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013865088:12345-192.168.204.57@tcp:101:rm.0 Request processed in 171us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094227.472068:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 531 00000100:00100000:0.0:1784094227.476401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094227.477572:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013865344 00000100:00100000:2.0:1784094227.477586:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013865344 00000100:00100000:2.0:1784094227.477672:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1050 00000100:00100000:2.0:1784094227.477683:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:57226:x1870757013865344:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784094227.477739:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094227.477781:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc1ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d96 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477804:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc19e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d8f expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477814:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff907219c12000) 00010000:00010000:2.0:1784094227.477825:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094227.477847:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477869:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477880:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477894:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477902:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.477908:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478029:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478038:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478047:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094227.478571:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10304 00000004:00080000:2.0:1784094227.478582:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1388556158989ns, next at 1389556156117ns, rc = 0 00010000:00010000:2.0:1784094227.478642:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478652:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478659:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478667:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478674:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478680:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478696:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094227.478716:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478723:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478728:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478735:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094227.478739:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478746:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478755:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784094227.478758:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094227.478761:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478767:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc1d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478782:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478788:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478793:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478798:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094227.478801:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478806:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478818:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:2.0:1784094227.478820:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094227.478824:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094227.478829:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc1c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094227.478839:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000053f9a557 reply state 000000004a1ab026 transno 4294967701 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094227.478848:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094227.479075:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094227.479082:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.479091:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094227.479094:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.479102:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.479112:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff90721a781600) 00010000:00010000:0.0:1784094227.479115:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784094227.479118:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094227.479124:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc1dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094227.479140:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:57226:x1870757013865344:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1456us (2748us total) trans 4294967701 rc 0/0 00010000:00010000:0.0:1784094227.479141:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094227.479144:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094227.479148:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094227.479153:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1050 00010000:00010000:1.0:1784094227.483236:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.483255:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.483263:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.483270:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094227.483275:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.483282:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.483299:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff90721a781200) 00010000:00010000:1.0:1784094227.483302:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094227.483307:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.483314:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc1cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094227.690610:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094227.690617:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094227.690622:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094227.690662:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.690674:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.690685:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094227.690712:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024350592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094227.690779:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094227.690819:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350592 00000100:00100000:3.0:1784094227.690828:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350592 00000100:00100000:1.0:1784094227.690834:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de666c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094227.690891:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1784094227.690901:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024350592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094227.690916:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094227.690932:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc1e4 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.690952:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.690970:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.690979:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094227.691024:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024350592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094227.691029:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1784094227.691063:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024350592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094227.691077:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.691086:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094227.691103:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094227.691108:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094227.691121:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094227.945795:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094228.438120:0:96127:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe58166940 20000000:00000080:3.0:1784094228.438138:0:96127:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907203bfe400 uarg=0000000000000000 00010000:00010000:3.0:1784094228.438385:0:96127:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784094228.438713:0:96127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094228.438717:0:96127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094228.438727:0:96127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc16d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d81 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094228.438747:0:96127:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1784094228.438762:0:96127:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094228.438778:0:96127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094228.438792:0:96127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094228.438801:0:96127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094228.438834:0:96127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094228.438846:0:96127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 18 pid: 5771 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094228.438860:0:96127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96127:1870757024350720:0@lo:104: 00000100:00100000:3.0:1784094228.438915:0:96127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094228.438980:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350720 00000100:00100000:2.0:1784094228.438988:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350720 00000100:00100000:3.0:1784094228.438999:0:96127:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784094228.439070:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1784094228.439080:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:96127:x1870757024350720:12345-0@lo:104: 00010000:00010000:2.0:1784094228.439094:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094228.439178:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094228.439186:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:96127:x1870757024350720:12345-0@lo:104: Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094228.439192:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784094228.439205:0:96127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96127:1870757024350720:0@lo:104: 00010000:00010000:3.0:1784094228.439225:0:96127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439276:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094228.439282:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439290:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094228.439294:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439302:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094228.439310:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094228.439315:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094228.439349:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439356:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094228.439389:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439397:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc1e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc1eb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094228.439410:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1784094228.439449:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094228.439449:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024350848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094228.439453:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094228.439456:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094228.439489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094228.439539:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350848 00000100:00100000:1.0:1784094228.439544:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350848 00010000:00010000:1.0:1784094228.439567:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 19 pid: 5771 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094228.439595:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1784094228.439607:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024350848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094228.439616:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094228.439622:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 19 pid: 5771 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439632:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 19 pid: 5771 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439642:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69000/0x9ce98053214cc1eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc1e4 expref: 19 pid: 5771 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439654:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439661:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439673:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439681:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439688:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439695:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439701:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094228.439705:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439712:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439734:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094228.439746:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094228.439781:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024350848:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094228.439787:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1784094228.439820:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024350848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094228.439893:0:96127:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094228.439901:0:96127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094228.439906:0:96127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214cc1f2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094228.971614:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784094229.482851:0:7044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1390560425887ns, next at 1391560421992ns, rc = 0 00000100:00100000:3.0:1784094229.482889:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094229.482909:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024350976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094229.483034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094229.483213:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024350976 00000100:00100000:1.0:1784094229.483222:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024350976 00000100:00100000:1.0:1784094229.483276:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1784094229.483286:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024350976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094229.483317:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094229.483361:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024350976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094229.483368:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00080000:1.0:1784094229.483388:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094229.483581:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024350976:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1784094229.499867:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 10000000:01000000:2.0:1784094229.865471:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094229.865479:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094229.865486:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094229.865530:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094229.865542:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094229.865553:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094229.865581:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024351104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094229.865650:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094229.865697:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723cfe0780 going to sleep for 11 seconds 00000100:00100000:0.0:1784094229.865787:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024351104 00000100:00100000:0.0:1784094229.865796:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024351104 00000100:00100000:0.0:1784094229.865846:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1784094229.865856:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024351104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094229.865869:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094229.865884:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc1f9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.865907:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.865917:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.865925:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784094229.865973:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024351104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094229.865981:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1784094229.866082:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024351104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094229.866098:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.866112:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094229.866130:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094229.866145:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.866152:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094229.973186:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094229.973375:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013865472 00000100:00100000:3.0:1784094229.973387:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013865472 00000100:00100000:3.0:1784094229.973483:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1051 00000100:00100000:3.0:1784094229.973495:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:57314:x1870757013865472:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094229.973522:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094229.973546:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5da4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.973612:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.973627:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.973640:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094229.973703:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1784094229.973708:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094229.973736:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.973762:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5da4 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.973785:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc20e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5da4 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094229.973794:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094229.973798:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094229.973808:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094229.973877:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:57314:x1870757013865472:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 385us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094229.973884:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1051 00000100:00080000:2.0:1784094229.973952:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094229.976762:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094229.977012:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013865728 00000100:00100000:0.0:1784094229.977021:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013865728 00000100:00100000:0.0:1784094229.977080:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1052 00000100:00100000:0.0:1784094229.977091:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:57314:x1870757013865728:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094229.977145:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094229.977169:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc20e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5da4 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.977189:0:5809:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc16d) 00010000:00010000:0.0:1784094229.977193:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fceb00) 00010000:00010000:0.0:1784094229.977204:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094229.977228:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.977240:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.977251:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094229.994812:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1784094230.008069:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000063a6de94 reply state 000000000d57d690 transno 4294967702 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094230.008088:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094230.008239:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:0.0:1784094230.008352:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:57314:x1870757013865728:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 31259us (31590us total) trans 4294967702 rc 0/0 00000100:00100000:0.0:1784094230.008362:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1052 00000001:00080000:0.0:1784094230.008408:0:95357:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000004:00080000:0.0:1784094230.008457:0:95357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 88 committed 00000004:00080000:0.0:1784094230.008478:0:95357:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00010000:00010000:0.0:1784094230.008556:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.008565:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.008577:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.008583:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094230.008587:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.008595:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.008610:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094230.008614:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094230.008619:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.008624:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc215 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094230.008704:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024351232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784094230.008759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094230.009393:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024351232 00000100:00100000:0.0:1784094230.009401:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024351232 00000100:00100000:0.0:1784094230.009587:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1784094230.009598:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024351232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784094230.009623:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00010000:00010000:0.0:1784094230.009643:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.009659:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 5 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.009668:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1784094230.009672:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094230.009675:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.009695:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 5 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.009705:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 5 pid: 53396 timeout: 1491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094230.009714:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024351360:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784094230.009759:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230d07cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094230.011397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094230.011605:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6573:1870757024351360:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094230.011614:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013865856 00000100:00100000:2.0:1784094230.011620:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013865856 00010000:00010000:0.0:1784094230.011629:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.011699:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 6 pid: 53396 timeout: 1491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094230.011729:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 340 00000100:00100000:2.0:1784094230.011741:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013865856:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784094230.011754:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094230.011760:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 6 pid: 53396 timeout: 1491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.011773:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 6 pid: 53396 timeout: 1491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.011816:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bea49d88/0x9ce98053214cc1c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5d9d expref: 6 pid: 53396 timeout: 1491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784094230.011818:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784094230.011829:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094230.011833:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094230.011839:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.011848:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.011877:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094230.011917:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013865856:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 179us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094230.011924:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 340 00010000:00010000:0.0:1784094230.011989:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.011998:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.012004:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.012010:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.012026:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094230.012052:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094230.012059:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.012066:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094230.012082:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.012091:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.012103:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.012110:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3225ea1/0x9ce98053214cc21c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.012126:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094230.012127:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094230.012141:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094230.012744:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024351232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3147us (3983us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1784094230.012752:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000004:00080000:3.0:1784094230.012782:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230ce4a80/2, rc 0, transno 4294967363 00000100:00100000:3.0:1784094230.012791:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024351232:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1784094230.434785:0:96325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb3412e50 20000000:00000080:2.0:1784094230.434802:0:96325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101bbc000 uarg=0000000000000000 00010000:00010000:2.0:1784094230.435197:0:96325:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094230.435207:0:96325:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094230.435220:0:96325:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094230.435238:0:96325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.435252:0:96325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.435262:0:96325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.435304:0:96325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.435413:0:96325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 18 pid: 5770 timeout: 1541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094230.435449:0:96325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96325:1870757024351488:0@lo:104: 00000100:00100000:2.0:1784094230.435524:0:96325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094230.435595:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784094230.435607:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024351488 00000100:00100000:2.0:1784094230.435613:0:96325:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1000 going to sleep for 11 seconds 00000100:00100000:0.0:1784094230.435614:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024351488 00000100:00100000:0.0:1784094230.435661:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784094230.435671:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e210850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:96325:x1870757024351488:12345-0@lo:104: 00010000:00010000:0.0:1784094230.435682:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094230.435759:0:96325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96325:1870757024351488:0@lo:104: 00010000:00010000:2.0:1784094230.435776:0:96325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094230.435781:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094230.435787:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e210850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:96325:x1870757024351488:12345-0@lo:104: Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094230.435794:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:1.0:1784094230.435842:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094230.435849:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.435857:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094230.435861:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.435869:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094230.435877:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094230.435882:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094230.435934:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.435939:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094230.435968:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.435975:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40c00/0x9ce98053214cc1f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc200 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094230.435985:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024351616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094230.435991:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094230.435992:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094230.435994:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094230.436013:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094230.436064:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024351616 00000100:00100000:1.0:1784094230.436069:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024351616 00010000:00010000:1.0:1784094230.436087:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 19 pid: 5770 timeout: 1541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094230.436111:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1784094230.436118:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024351616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094230.436140:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094230.436147:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 19 pid: 5770 timeout: 1541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436158:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 19 pid: 5770 timeout: 1541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436171:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214cc200 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc1f9 expref: 19 pid: 5770 timeout: 1541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436183:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436191:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436203:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436210:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436216:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436222:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436228:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094230.436232:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436240:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436261:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094230.436275:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094230.436315:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024351616:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094230.436322:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:2.0:1784094230.436369:0:96325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094230.436377:0:96325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094230.436379:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024351616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094230.436384:0:96325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cc223 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094231.017559:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094231.761822:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094231.761870:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013865984 00000100:00100000:1.0:1784094231.761881:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013865984 00000100:00080000:2.0:1784094231.761929:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094231.761955:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1053 00000100:00100000:1.0:1784094231.761967:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:57390:x1870757013865984:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094231.761992:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094231.762014:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc22a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dab expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762088:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762114:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762135:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762152:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762160:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762167:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762719:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762747:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762754:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094231.762856:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1784094231.762860:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094231.762955:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762968:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762975:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762981:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.762988:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094231.762992:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763000:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763013:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784094231.763017:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.763022:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763028:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763038:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763045:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763051:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763056:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094231.763059:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763065:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763073:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12900) 00010000:00010000:1.0:1784094231.763076:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.763079:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763084:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763131:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc22a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dab expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763152:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dab expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.763160:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094231.763162:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094231.763164:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784094231.763231:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013865984:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1266us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094231.763240:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1053 00000100:00100000:3.0:1784094231.766804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094231.766839:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013866240 00000100:00100000:3.0:1784094231.766849:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013866240 00000100:00100000:3.0:1784094231.766899:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1054 00000100:00100000:3.0:1784094231.766909:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013866240:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094231.766932:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094231.767076:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc246 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5db2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767544:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767561:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767572:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767588:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767596:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767603:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094231.767763:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00010000:3.0:1784094231.767786:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767793:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767801:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767811:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094231.767815:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767823:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767835:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:3.0:1784094231.767838:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094231.767843:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767848:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc24d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767859:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767866:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767872:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767877:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094231.767880:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767886:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767898:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907204fcec00) 00010000:00010000:3.0:1784094231.767901:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094231.767904:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.767909:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc254 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.768008:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc246 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5db2 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.768019:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:3.0:1784094231.768021:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094231.768026:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc246 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5db2 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094231.768036:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094231.768107:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013866240:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1189us (1300us total) trans 0 rc 301/301 00000100:00100000:3.0:1784094231.768115:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1054 00000100:00100000:2.0:1784094231.773686:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094231.773733:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013866368 00000100:00100000:1.0:1784094231.773745:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013866368 00000100:00100000:1.0:1784094231.773802:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1055 00000100:00100000:1.0:1784094231.773813:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013866368:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094231.773835:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094231.773853:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc25b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5db9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.773916:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.773931:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.773943:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.773958:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.773971:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.773978:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774161:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774170:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774177:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774184:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094231.774189:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774196:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774207:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094231.774210:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.774215:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774221:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774231:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774237:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774243:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774248:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094231.774251:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774257:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774265:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907219c12400) 00010000:00010000:1.0:1784094231.774267:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.774270:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774276:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774306:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc25b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5db9 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774317:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094231.774319:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.774322:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc25b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5db9 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.774336:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784094231.774394:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013866368:12345-192.168.204.57@tcp:101:touch.0 Request processed in 584us (718us total) trans 0 rc 301/301 00000100:00100000:1.0:1784094231.774403:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1055 00000100:00100000:3.0:1784094231.776245:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094231.776286:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013866496 00000100:00100000:1.0:1784094231.776294:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013866496 00000100:00100000:1.0:1784094231.776358:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1056 00000100:00100000:1.0:1784094231.776368:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013866496:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094231.776385:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094231.776402:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc270 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dc0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776483:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776507:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776519:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776534:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776542:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776550:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776707:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776716:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776723:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776728:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094231.776752:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776761:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776771:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094231.776774:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.776778:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776785:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776795:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776801:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776806:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776812:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094231.776815:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776820:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776827:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907219c12900) 00010000:00010000:1.0:1784094231.776830:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.776833:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776840:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc27e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776880:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc270 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dc0 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776889:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094231.776892:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094231.776895:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc270 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dc0 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094231.776904:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784094231.776959:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:57390:x1870757013866496:12345-192.168.204.57@tcp:101:touch.0 Request processed in 593us (720us total) trans 0 rc 301/301 00000100:00100000:1.0:1784094231.776966:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1056 00000100:00100000:2.0:1784094231.931604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094231.931650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094231.931683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094231.931722:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013866880 00000100:00100000:2.0:1784094231.931737:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013866880 00000100:00100000:2.0:1784094231.931814:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013866752 00000100:00100000:2.0:1784094231.931818:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013866752 00000100:00100000:2.0:1784094231.931850:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 728 00000100:00100000:2.0:1784094231.931863:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013866880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094231.931962:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013866880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 102us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094231.931971:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 728 00000100:00100000:2.0:1784094231.931992:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 729 00000100:00100000:2.0:1784094231.932000:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013866752:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094231.932030:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013866752:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094231.932036:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 729 00000100:00080000:1.0:1784094231.932178:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094231.932813:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013866624 00000100:00100000:0.0:1784094231.932820:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013866624 00000100:00100000:0.0:1784094231.932916:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 884 00000100:00100000:0.0:1784094231.932926:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013866624:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094231.932981:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013866624:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094231.932992:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 884 00010000:00010000:0.0:1784094232.042570:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094232.297938:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094232.297947:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094232.297953:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094232.297997:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.298009:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.298020:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094232.298113:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024351744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094232.298200:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094232.298260:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784094232.298931:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024351744 00000100:00100000:0.0:1784094232.298940:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024351744 00000100:00100000:0.0:1784094232.298999:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1784094232.299009:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024351744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094232.299024:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094232.299038:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc285 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.299063:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc285 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.299074:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc285 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.299083:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784094232.299140:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024351744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094232.299148:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1784094232.299196:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024351744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094232.299212:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.299220:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094232.299238:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094232.299243:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.299251:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094232.554549:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024351872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094232.554598:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024352000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094232.554619:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094232.554639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094232.554670:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024351872 00000100:00100000:1.0:1784094232.554676:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024352512:0@lo:400:kworker.0 00000100:00100000:2.0:1784094232.554680:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024351872 00000100:00100000:3.0:1784094232.554685:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024352384:0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.554707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094232.554728:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094232.554732:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094232.554741:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024352128:0@lo:400:kworker.0 00000100:00100000:2.0:1784094232.554742:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1784094232.554759:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024351872:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784094232.554770:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094232.554784:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352512 00000100:00100000:1.0:1784094232.554788:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352512 00002000:00000024:2.0:1784094232.554795:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094232.554819:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1784094232.554828:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024352512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094232.554844:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024351872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094232.554857:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1784094232.554877:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024352512:12345-0@lo:400:kworker.0 Request processed in 49us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094232.554885:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024351872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094232.554886:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1784094232.554909:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094232.554917:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024352256:0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.554945:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352000 00000100:00100000:1.0:1784094232.554948:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352000 00000100:00100000:1.0:1784094232.554979:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352384 00000100:00100000:1.0:1784094232.554982:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352384 00000100:00100000:1.0:1784094232.555007:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1784094232.555013:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024352000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094232.555038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094232.555067:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1784094232.555076:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024352384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.555217:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024352000:12345-0@lo:400:kworker.0 Request processed in 204us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094232.555225:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352256 00000100:00100000:1.0:1784094232.555225:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1784094232.555232:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352256 00000100:00080000:1.0:1784094232.555249:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094232.555254:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094232.555265:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1784094232.555276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094232.555278:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024352256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.555305:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024352000:0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.555320:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024352512:0@lo:400:kworker.0 00000100:00100000:3.0:1784094232.555327:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024352256:12345-0@lo:400:kworker.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094232.555336:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1784094232.555346:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352128 00000100:00100000:1.0:1784094232.555350:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352128 00000100:00100000:3.0:1784094232.555374:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024352256:0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.555382:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1784094232.555392:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024352128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094232.555447:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024352128:12345-0@lo:400:kworker.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094232.555453:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00080000:1.0:1784094232.555465:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094232.555513:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024352128:0@lo:400:kworker.0 00000100:00100000:2.0:1784094232.555542:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024352384:12345-0@lo:400:kworker.0 Request processed in 468us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094232.555550:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1784094232.555554:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024352384:0@lo:400:kworker.0 00000020:00000080:0.0:1784094232.563345:0:96568:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc740f2da0 20000000:00000080:0.0:1784094232.563362:0:96568:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df2000 uarg=0000000000000000 00010000:00010000:0.0:1784094232.563591:0:96568:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094232.563619:0:96568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12500) 00010000:00010000:0.0:1784094232.563621:0:96568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094232.563631:0:96568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc23f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dab expref: 5 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.563653:0:96568:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1784094232.563668:0:96568:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094232.563681:0:96568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.563693:0:96568:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc285 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.563701:0:96568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.563735:0:96568:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc285 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.563748:0:96568:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc285 expref: 18 pid: 5770 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094232.563766:0:96568:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96568:1870757024352640:0@lo:104: 00000100:00100000:0.0:1784094232.563814:0:96568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094232.563851:0:96568:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720133a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094232.563854:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352640 00000100:00100000:2.0:1784094232.563862:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352640 00000100:00100000:2.0:1784094232.563911:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784094232.563920:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:96568:x1870757024352640:12345-0@lo:104: 00010000:00010000:2.0:1784094232.563933:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094232.563985:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094232.563992:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:96568:x1870757024352640:12345-0@lo:104: Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094232.564000:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00010000:1.0:1784094232.564016:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784094232.564021:0:96568:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96568:1870757024352640:0@lo:104: 00010000:00010000:1.0:1784094232.564025:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094232.564035:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094232.564042:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.564042:0:96568:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094232.564064:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094232.564073:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094232.564079:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094232.564114:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094232.564120:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094232.564145:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094232.564153:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214cc285 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc28c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094232.564154:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094232.564170:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024352768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094232.564172:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094232.564175:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094232.564176:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094232.564211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094232.564254:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352768 00000100:00100000:3.0:1784094232.564260:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352768 00010000:00010000:3.0:1784094232.564284:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc285 expref: 19 pid: 5770 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094232.564313:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1784094232.564320:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024352768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094232.564332:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094232.564338:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc285 expref: 19 pid: 5770 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564348:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc285 expref: 19 pid: 5770 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564360:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77200/0x9ce98053214cc28c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc285 expref: 19 pid: 5770 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564372:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564380:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564393:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564401:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564407:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564435:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564442:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094232.564448:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564510:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564529:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094232.564539:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094232.564556:0:96568:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.564566:0:96568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094232.564572:0:96568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214cc293 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094232.564588:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024352768:12345-0@lo:103:ldlm_bl.0 Request processed in 267us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094232.564598:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1784094232.564614:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024352768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094233.065661:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094233.577548:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094233.577555:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094233.577561:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094233.577609:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.577621:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.577631:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094233.577658:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024352896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094233.577720:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094233.577750:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024352896 00000100:00100000:3.0:1784094233.577759:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024352896 00000100:00100000:0.0:1784094233.577768:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720133ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094233.577812:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1784094233.577823:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024352896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094233.577836:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094233.577849:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc29a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094233.577882:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc29a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094233.577892:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc29a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094233.577902:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784094233.577942:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024352896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094233.577949:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1784094233.578013:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024352896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094233.578025:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.578032:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094233.578045:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094233.578049:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.578053:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094233.911998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094233.912042:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867008 00000100:00100000:1.0:1784094233.912052:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867008 00000100:00080000:2.0:1784094233.912116:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094233.912130:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1057 00000100:00100000:1.0:1784094233.912138:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57476:x1870757013867008:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094233.912157:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094233.912643:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dc7 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.912707:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.912720:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.912733:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094233.912926:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:0.0:1784094233.912931:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094233.913348:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.913382:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dc7 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.913401:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dc7 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.913410:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094233.913413:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094233.913416:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784094233.913498:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:57476:x1870757013867008:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 1360us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094233.913506:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1057 00000100:00100000:2.0:1784094233.918170:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094233.918259:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867264 00000100:00100000:0.0:1784094233.918268:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867264 00000100:00100000:0.0:1784094233.918319:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1058 00000100:00100000:0.0:1784094233.918331:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:57476:x1870757013867264:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094233.918379:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094233.918406:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dc7 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.918456:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc23f) 00010000:00010000:0.0:1784094233.918460:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094233.918473:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094233.918498:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.918512:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.918523:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094233.918927:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c7c8b4a9 reply state 00000000d6350d3b transno 4294967703 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094233.918938:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094233.919005:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:0.0:1784094233.919096:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:57476:x1870757013867264:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 767us (934us total) trans 4294967703 rc 0/0 00000100:00100000:0.0:1784094233.919104:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1058 00010000:00010000:0.0:1784094233.920244:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.920256:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.920263:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.920270:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094233.920274:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.920280:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.920291:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6b900) 00010000:00010000:0.0:1784094233.920294:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094233.920298:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094233.920303:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc2b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.090763:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094234.322196:0:96763:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda405a040 20000000:00000080:1.0:1784094234.322213:0:96763:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103e400 uarg=0000000000000000 00010000:00010000:1.0:1784094234.322388:0:96763:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094234.322398:0:96763:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094234.322406:0:96763:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094234.322476:0:96763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094234.322494:0:96763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc29a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094234.322503:0:96763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094234.322540:0:96763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc29a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094234.322551:0:96763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc29a expref: 18 pid: 5771 timeout: 1545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094234.322562:0:96763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96763:1870757024353024:0@lo:104: 00000100:00100000:1.0:1784094234.322611:0:96763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094234.322661:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353024 00000100:00100000:0.0:1784094234.322668:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353024 00000100:00100000:1.0:1784094234.322701:0:96763:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8900 going to sleep for 11 seconds 00000100:00100000:0.0:1784094234.322769:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1784094234.322779:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:96763:x1870757024353024:12345-0@lo:104: 00010000:00010000:0.0:1784094234.322792:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.322851:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094234.322857:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:96763:x1870757024353024:12345-0@lo:104: Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094234.322865:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00010000:2.0:1784094234.322935:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094234.322942:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.322949:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094234.322953:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.322962:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094234.322970:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094234.322976:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094234.323003:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323010:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784094234.323064:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024353152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094234.323097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094234.323126:0:96763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96763:1870757024353024:0@lo:104: 00010000:00010000:1.0:1784094234.323147:0:96763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094234.323164:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353152 00000100:00100000:0.0:1784094234.323169:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353152 00010000:00010000:0.0:1784094234.323186:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc29a expref: 19 pid: 5771 timeout: 1545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094234.323212:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1784094234.323219:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024353152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094234.323229:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094234.323234:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc29a expref: 19 pid: 5771 timeout: 1545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323245:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc29a expref: 19 pid: 5771 timeout: 1545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323257:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69600/0x9ce98053214cc2a1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc29a expref: 19 pid: 5771 timeout: 1545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323270:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323282:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323293:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323295:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323301:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc29a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc2a1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323303:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323309:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323315:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094234.323315:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323317:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094234.323318:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094234.323320:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094234.323325:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323332:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323354:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094234.323363:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094234.323374:0:96763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323381:0:96763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094234.323387:0:96763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214cc2bd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094234.323578:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024353152:12345-0@lo:103:ldlm_bl.0 Request processed in 359us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094234.323586:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1784094234.323625:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024353152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094234.602708:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024353280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094234.602772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094234.602831:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353280 00000100:00100000:0.0:1784094234.602839:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353280 00000100:00100000:0.0:1784094234.602889:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1784094234.602897:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024353280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094234.602928:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094234.602971:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024353280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094234.602977:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00080000:0.0:1784094234.602995:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094234.606816:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024353280:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784094234.634214:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00010000:00010000:3.0:1784094235.113589:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094235.139873:0:95359:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967703 is committed 10000000:01000000:3.0:1784094235.370478:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094235.370485:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094235.370490:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094235.370528:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094235.370536:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094235.370543:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094235.370565:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024353408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094235.370627:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094235.370661:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a76e540 going to sleep for 11 seconds 00000100:00100000:1.0:1784094235.370893:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353408 00000100:00100000:1.0:1784094235.370901:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353408 00000100:00100000:1.0:1784094235.370965:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1784094235.370976:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024353408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094235.370989:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094235.371004:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc2c4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.371046:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.371062:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.371072:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784094235.371118:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024353408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094235.371123:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1784094235.371174:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024353408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094235.371192:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094235.371208:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094235.371227:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094235.371233:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094235.371240:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094235.852942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.853078:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867392 00000100:00100000:1.0:1784094235.853088:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867392 00000100:00100000:1.0:1784094235.853178:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1059 00000100:00100000:1.0:1784094235.853194:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867392:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094235.853305:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867392:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 119us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094235.853313:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1059 00000100:00080000:0.0:1784094235.853328:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094235.854736:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.855087:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867520 00000100:00100000:1.0:1784094235.855095:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867520 00000100:00080000:0.0:1784094235.855141:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094235.855158:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 533 00000100:00100000:1.0:1784094235.855169:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867520:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094235.855572:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867520:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 404us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094235.855580:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 533 00000100:00100000:2.0:1784094235.857374:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.857465:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867648 00000100:00100000:1.0:1784094235.857473:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867648 00000100:00100000:1.0:1784094235.857531:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 534 00000100:00100000:1.0:1784094235.857540:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867648:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:0.0:1784094235.857852:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094235.857894:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867648:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 355us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094235.857903:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 534 00000100:00100000:2.0:1784094235.859786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094235.859952:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867776 00000100:00100000:0.0:1784094235.859961:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867776 00000100:00100000:0.0:1784094235.860012:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1060 00000100:00100000:0.0:1784094235.860033:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867776:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094235.860581:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867776:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 559us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094235.860590:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1060 00000100:00100000:2.0:1784094235.864707:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094235.864780:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013867904 00000100:00100000:0.0:1784094235.864790:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013867904 00000100:00100000:0.0:1784094235.864845:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1061 00000100:00100000:0.0:1784094235.864854:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867904:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094235.864951:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013867904:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094235.864959:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1061 00000100:00100000:2.0:1784094235.866979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094235.867066:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868032 00000100:00100000:3.0:1784094235.867076:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868032 00000100:00100000:3.0:1784094235.867130:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 535 00000100:00100000:3.0:1784094235.867141:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013868032:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094235.867547:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013868032:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 408us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094235.867556:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 535 00000100:00100000:1.0:1784094235.869173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094235.869227:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868160 00000100:00100000:0.0:1784094235.869234:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868160 00000100:00100000:0.0:1784094235.869270:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:0.0:1784094235.869276:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013868160:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094235.869618:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013868160:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 340us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094235.869626:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 536 00000100:00100000:2.0:1784094235.871164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.871246:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868288 00000100:00100000:1.0:1784094235.871254:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868288 00000100:00100000:1.0:1784094235.871303:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1062 00000100:00100000:1.0:1784094235.871312:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013868288:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094235.871737:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57561:x1870757013868288:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 425us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094235.871744:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1062 00000100:00100000:2.0:1784094235.911093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094235.911164:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868416 00000100:00100000:0.0:1784094235.911174:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868416 00000100:00100000:0.0:1784094235.911228:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1063 00000100:00100000:0.0:1784094235.911240:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57565:x1870757013868416:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:0.0:1784094235.911261:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094235.911284:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc2d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dce expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911348:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911361:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911374:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911386:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911393:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911400:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911955:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911966:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.911973:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094235.912065:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:0.0:1784094235.912070:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094235.912204:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912223:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912230:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912238:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912244:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094235.912248:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912256:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912269:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094235.912272:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094235.912277:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912283:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cc2d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912294:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912301:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912306:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912312:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094235.912315:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912321:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912328:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907202e6b800) 00010000:00010000:0.0:1784094235.912330:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094235.912332:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912338:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc2e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912371:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc2d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dce expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912385:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dce expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094235.912392:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094235.912395:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094235.912396:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784094235.912509:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:57565:x1870757013868416:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1271us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094235.912517:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1063 00000100:00100000:3.0:1784094235.914503:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094235.914606:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868672 00000100:00100000:2.0:1784094235.914615:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868672 00000100:00100000:2.0:1784094235.914665:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1064 00000100:00100000:2.0:1784094235.914676:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:57565:x1870757013868672:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094235.914694:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094235.914711:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc2ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dd5 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.915282:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.915296:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.915307:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.915321:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.915328:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.915334:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094235.916319:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:2.0:1784094235.916614:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916625:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916634:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916667:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916674:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916681:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916688:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094235.916692:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916699:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916711:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6be00) 00010000:00010000:2.0:1784094235.916714:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094235.916719:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916731:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc2f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094235.916744:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000022c71306 reply state 00000000e0ece18b transno 4294967704 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094235.916753:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094235.916787:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc2ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dd5 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916803:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dd5 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094235.916811:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784094235.916813:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094235.916816:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094235.917009:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:57565:x1870757013868672:12345-192.168.204.57@tcp:101:dd.0 Request processed in 2334us (2522us total) trans 4294967704 rc 0/0 00000100:00100000:2.0:1784094235.917027:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1064 00010000:00010000:1.0:1784094235.918655:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.918669:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.918674:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.918678:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094235.918680:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.918685:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.918695:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff90721a781e00) 00010000:00010000:1.0:1784094235.918696:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094235.918699:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.918702:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc2fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094235.921737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.921835:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868800 00000100:00100000:1.0:1784094235.921846:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868800 00000100:00100000:1.0:1784094235.921896:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 537 00000100:00100000:1.0:1784094235.921906:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57565:x1870757013868800:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:1.0:1784094235.921924:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094235.921944:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ddc expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094235.921972:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784094235.921995:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1396s v=(0 0) 00010000:00010000:1.0:1784094235.921999:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094235.922009:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.922039:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094235.922052:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13400, rc 0) 00000100:00100000:1.0:1784094235.922112:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:57565:x1870757013868800:12345-192.168.204.57@tcp:101:dd.0 Request processed in 206us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094235.922119:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 537 00000100:00100000:2.0:1784094235.936081:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.936272:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013868928 00000100:00100000:1.0:1784094235.936282:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013868928 00002000:00100000:1.0:1784094235.936328:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff90710134ce00 x1870757013868928/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:556/0 lens 488/0 e 0 to 0 dl 1784094246 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784094235.936338:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90710134ce00 with x1870757013868928 ext(0->1048575) 00002000:00010000:1.0:1784094235.936343:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90710134ce00 00000100:00100000:1.0:1784094235.936369:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 26 00000100:00100000:1.0:1784094235.936378:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013868928:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:1.0:1784094235.950278:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013868928:12345-192.168.204.57@tcp:4:dd.0 Request processed in 13889us (14195us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1784094235.950292:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 26 00002000:00100000:1.0:1784094235.950304:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff90710134ce00 x1870757013868928/t4294967362(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:556/0 lens 488/448 e 0 to 0 dl 1784094246 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784094235.950316:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90710134ce00 with x1870757013868928 ext(0->1048575) 00002000:00010000:1.0:1784094235.950323:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90710134ce00 00000100:00100000:3.0:1784094235.952108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094235.952284:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869056 00000100:00100000:2.0:1784094235.952295:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869056 00000100:00100000:2.0:1784094235.952352:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1065 00000100:00100000:2.0:1784094235.952362:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:57565:x1870757013869056:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:0.0:1784094235.973480:0:95358:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00000100:00100000:3.0:1784094235.973676:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:57565:x1870757013869056:12345-192.168.204.57@tcp:44:dd.0 Request processed in 21300us (21557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094235.973688:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1065 00000100:00100000:3.0:1784094235.975909:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094235.976068:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869184 00000100:00100000:2.0:1784094235.976078:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869184 00000100:00100000:2.0:1784094235.976133:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 538 00000100:00100000:2.0:1784094235.976145:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013869184:12345-192.168.204.57@tcp:16:dd.0 00000001:00080000:0.0:1784094235.996861:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000100:00100000:2.0:1784094235.997054:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013869184:12345-192.168.204.57@tcp:16:dd.0 Request processed in 20906us (21143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094235.997066:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 538 00000100:00100000:2.0:1784094235.999536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094235.999627:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869440 00000100:00100000:1.0:1784094235.999639:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869440 00000100:00100000:1.0:1784094235.999736:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 109 00000100:00100000:1.0:1784094235.999748:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:57565:x1870757013869440:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:1.0:1784094236.000237:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:57565:x1870757013869440:12345-192.168.204.57@tcp:35:dd.0 Request processed in 490us (823us total) trans 4294967705 rc 0/0 00000100:00100000:1.0:1784094236.000703:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 109 00010000:00010000:1.0:1784094236.137658:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784094236.654545:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967705 is committed 00000100:00100000:3.0:1784094237.048886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094237.048944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094237.049063:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869568 00000100:00100000:1.0:1784094237.049064:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869696 00000100:00100000:1.0:1784094237.049074:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869696 00000100:00100000:0.0:1784094237.049074:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869568 00000100:00100000:0.0:1784094237.049130:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 888 00000100:00100000:0.0:1784094237.049142:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013869568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094237.049152:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 960 00000100:00100000:1.0:1784094237.049163:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013869696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094237.049247:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094237.049340:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013869568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 199us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094237.049349:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 888 00000100:00100000:1.0:1784094237.049677:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013869696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 515us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094237.049879:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 960 00000100:00100000:3.0:1784094237.050866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094237.050952:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094237.051108:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869952 00000100:00100000:0.0:1784094237.051116:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869952 00000100:00100000:0.0:1784094237.051179:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013869824 00000100:00100000:0.0:1784094237.051183:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013869824 00000100:00100000:0.0:1784094237.051214:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 732 00000100:00100000:0.0:1784094237.051225:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013869952:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094237.051238:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 733 00000100:00100000:3.0:1784094237.051250:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013869824:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094237.051287:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013869824:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094237.051293:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013869952:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094237.051299:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 733 00000100:00100000:0.0:1784094237.051308:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 732 00000100:00080000:1.0:1784094237.051463:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094237.051467:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784094237.161724:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094237.346863:0:97010:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1398424436755ns, next at 1391560421992ns, rc = 0 00000004:00080000:2.0:1784094237.346988:0:97010:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1398424565127ns, next at 1360952050174ns, rc = 0 00000004:00080000:0.0:1784094237.349025:0:95358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000004:00080000:0.0:1784094237.349230:0:95358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00000100:00100000:0.0:1784094237.675828:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094237.675855:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024353536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094237.675934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094237.676012:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353536 00000100:00100000:0.0:1784094237.676020:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353536 00000100:00100000:0.0:1784094237.676090:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1784094237.676100:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024353536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094237.676127:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1784094237.676174:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024353536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094237.676182:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:0.0:1784094237.676204:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094237.676240:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024353536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094237.676474:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024353792:0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.676510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094237.676534:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094237.676540:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024353920:0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.676563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094237.676591:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353792 00000100:00100000:1.0:1784094237.676595:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353792 00000100:00100000:1.0:1784094237.676626:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353920 00000100:00100000:1.0:1784094237.676629:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353920 00000100:00100000:1.0:1784094237.676652:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1784094237.676659:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024353792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.676696:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024353792:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094237.676703:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1784094237.676716:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1784094237.676722:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024353920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.676749:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024353920:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094237.676754:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1784094237.676786:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024353920:0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.676795:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024353792:0@lo:400:kworker.0 00000100:00080000:0.0:1784094237.676869:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094237.676880:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024353664:0@lo:400:kworker.0 00000100:00100000:0.0:1784094237.676909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094237.676942:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024354176:0@lo:400:kworker.0 00000100:00100000:0.0:1784094237.676963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094237.676981:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094237.676997:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024354048:0@lo:400:kworker.0 00000100:00100000:0.0:1784094237.677019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094237.677043:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354176 00000100:00100000:0.0:1784094237.677046:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354176 00000100:00100000:0.0:1784094237.677072:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1784094237.677077:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024354176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094237.677107:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024354176:12345-0@lo:400:kworker.0 Request processed in 30us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094237.677112:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1784094237.677130:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354048 00000100:00100000:0.0:1784094237.677133:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354048 00000100:00100000:0.0:1784094237.677157:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1784094237.677163:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024354048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094237.677190:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024354048:12345-0@lo:400:kworker.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094237.677195:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00080000:0.0:1784094237.677209:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094237.677211:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094237.677224:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:0.0:1784094237.677230:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230ce4a80, transno 4294967363 00000100:00100000:0.0:1784094237.677240:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024354048:0@lo:400:kworker.0 00000100:00100000:0.0:1784094237.677250:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024354176:0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.677792:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024353664 00000100:00100000:1.0:1784094237.677799:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024353664 00000100:00100000:1.0:1784094237.677830:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1784094237.677836:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024353664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094237.677884:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024353664:12345-0@lo:400:kworker.0 Request processed in 49us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094237.677890:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1784094237.677974:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024353664:0@lo:400:kworker.0 00000100:00100000:1.0:1784094238.058594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094238.059031:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870080 00000100:00100000:2.0:1784094238.059041:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870080 00000100:00100000:2.0:1784094238.059107:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1066 00000100:00100000:2.0:1784094238.059119:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870080:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094238.059221:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870080:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 105us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094238.059229:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1066 00000100:00100000:0.0:1784094238.061525:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.062210:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870208 00000100:00100000:1.0:1784094238.062221:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870208 00000100:00100000:1.0:1784094238.062276:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 539 00000100:00100000:1.0:1784094238.062286:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57757:x1870757013870208:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094238.062731:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:57757:x1870757013870208:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 446us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094238.062740:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 539 00000100:00100000:0.0:1784094238.064187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.064232:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870336 00000100:00100000:1.0:1784094238.064239:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870336 00000100:00100000:1.0:1784094238.064269:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00100000:1.0:1784094238.064275:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:57757:x1870757013870336:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094238.064562:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:57757:x1870757013870336:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 285us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094238.064569:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 540 00000100:00100000:0.0:1784094238.065738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.065885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870464 00000100:00100000:1.0:1784094238.065893:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870464 00000100:00100000:1.0:1784094238.065973:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1067 00000100:00100000:1.0:1784094238.065994:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870464:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094238.066265:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870464:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 283us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094238.066276:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1067 00000100:00100000:0.0:1784094238.068475:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.068586:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870592 00000100:00100000:1.0:1784094238.068594:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870592 00000100:00100000:1.0:1784094238.068669:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1068 00000100:00100000:1.0:1784094238.068679:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870592:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094238.068781:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870592:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094238.068789:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1068 00000100:00100000:0.0:1784094238.070269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.071684:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870720 00000100:00100000:1.0:1784094238.071695:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870720 00000100:00100000:1.0:1784094238.071748:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 541 00000100:00100000:1.0:1784094238.071758:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57757:x1870757013870720:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094238.072142:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:57757:x1870757013870720:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 384us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094238.072149:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 541 00000100:00100000:0.0:1784094238.075379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094238.075515:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870848 00000100:00100000:3.0:1784094238.075525:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870848 00000100:00100000:3.0:1784094238.075695:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 542 00000100:00100000:3.0:1784094238.075707:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:57757:x1870757013870848:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094238.076135:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:57757:x1870757013870848:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 429us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094238.076145:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 542 00000100:00100000:2.0:1784094238.080630:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.080848:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013870976 00000100:00100000:1.0:1784094238.080859:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013870976 00000100:00100000:1.0:1784094238.080937:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1069 00000100:00100000:1.0:1784094238.080949:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870976:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094238.081656:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:57757:x1870757013870976:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 708us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094238.081666:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1069 00000100:00100000:0.0:1784094238.116652:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094238.116882:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013871232 00000100:00100000:1.0:1784094238.116893:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013871232 00000100:00100000:1.0:1784094238.116949:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1070 00000100:00100000:1.0:1784094238.116958:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:57761:x1870757013871232:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784094238.117021:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094238.117052:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dd5 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117070:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff90721a781700) 00010000:00010000:1.0:1784094238.117081:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094238.117103:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117116:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117127:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117141:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117149:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117155:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117538:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117547:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.117553:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094238.118354:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 64 off10304 00000004:00080000:1.0:1784094238.118364:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1399195941313ns, next at 1400195939038ns, rc = 0 00010000:00010000:1.0:1784094238.118482:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118492:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118501:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118508:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118514:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118519:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118586:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094238.118609:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118616:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118622:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118629:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094238.118634:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118642:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118652:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784094238.118656:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784094238.118659:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118665:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc326 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118680:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118684:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118688:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118690:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094238.118692:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118695:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118699:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784094238.118701:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094238.118703:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.118706:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc318 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094238.118711:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c14e23f9 reply state 00000000fcc693e9 transno 4294967706 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094238.118717:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094238.118795:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:57761:x1870757013871232:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1835us (2150us total) trans 4294967706 rc 0/0 00000100:00100000:1.0:1784094238.118803:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1070 00010000:00010000:2.0:1784094238.118845:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094238.118850:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094238.118855:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094238.118858:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094238.118862:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094238.118868:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff907219c12400) 00010000:00010000:2.0:1784094238.118871:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094238.118873:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094238.118877:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc32d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094238.118887:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094238.118888:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094238.118889:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094238.121229:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.121246:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.121253:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.121259:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094238.121263:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.121271:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.121285:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907219c12100) 00010000:00010000:1.0:1784094238.121288:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094238.121292:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094238.121298:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc31f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094238.185684:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094239.209989:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094239.239809:0:97155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1400317384261ns, next at 1391560421992ns, rc = 0 00000004:00080000:2.0:1784094239.239910:0:97155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1400317487235ns, next at 1400195939038ns, rc = 0 00000001:00080000:0.0:1784094239.268198:0:95358:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967706 is committed 00000004:00080000:0.0:1784094239.268210:0:95358:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000004:00080000:0.0:1784094239.268384:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00000004:00080000:0.0:1784094239.268393:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00000100:00100000:1.0:1784094239.268683:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024354304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094239.268750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094239.268799:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354304 00000100:00100000:2.0:1784094239.268808:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354304 00000100:00100000:2.0:1784094239.268883:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00080000:0.0:1784094239.268887:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094239.268898:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024354304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784094239.268936:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:2.0:1784094239.268969:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.268991:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.269001:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1784094239.269006:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784094239.269011:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.269037:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.269053:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 5 pid: 8031 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094239.269065:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024354432:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094239.269121:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208f356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094239.272841:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094239.272897:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013871360 00000100:00100000:1.0:1784094239.272907:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013871360 00000100:00100000:2.0:1784094239.272977:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024354432:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784094239.272981:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 6 pid: 8031 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.273012:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094239.273029:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 344 00000100:00100000:1.0:1784094239.273040:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013871360:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094239.273054:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094239.273060:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 6 pid: 8031 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784094239.273065:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784094239.273077:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 6 pid: 8031 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273098:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021cf75aa/0x9ce98053214cc311 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ddc expref: 6 pid: 8031 timeout: 1500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273115:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094239.273119:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094239.273125:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273134:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273159:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094239.273186:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.273198:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094239.273209:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094239.273216:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013871360:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 176us (384us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094239.273227:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094239.273231:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 344 00010000:00010000:2.0:1784094239.273253:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094239.273266:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094239.273273:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273282:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094239.273287:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273296:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273309:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273318:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008450040b/0x9ce98053214cc334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094239.273338:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094239.273341:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094239.273343:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094239.274053:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024354304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5160us (5301us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1784094239.274066:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000004:00080000:1.0:1784094239.274091:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90710134f480/2, rc 0, transno 4294967363 00000100:00100000:1.0:1784094239.274109:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024354304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094239.721656:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094239.721680:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024354560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094239.721751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094239.721795:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354560 00000100:00100000:0.0:1784094239.721869:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354560 00000100:00080000:2.0:1784094239.721901:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094239.721940:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1784094239.721960:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024354560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094239.721994:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094239.722049:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024354560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094239.722057:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1784094239.722097:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024354560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094240.233729:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094241.257970:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094242.169917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094242.169963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094242.170001:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013871488 00000100:00100000:3.0:1784094242.170003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094242.170013:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013871488 00000100:00100000:3.0:1784094242.170053:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094242.170069:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 890 00000100:00100000:0.0:1784094242.170082:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013871488:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094242.170103:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013871744 00000100:00100000:1.0:1784094242.170105:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013871872 00000100:00100000:3.0:1784094242.170108:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013871744 00000100:00100000:1.0:1784094242.170108:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013871872 00000100:00100000:0.0:1784094242.170155:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013871488:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094242.170163:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 735 00000100:00100000:0.0:1784094242.170167:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 890 00000100:00100000:1.0:1784094242.170177:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013871872:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094242.170213:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013871872:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094242.170214:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 736 00000100:00100000:1.0:1784094242.170221:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 735 00000100:00100000:3.0:1784094242.170223:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013871744:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:1.0:1784094242.170244:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094242.170249:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094242.170253:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013871744:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094242.170265:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 736 00000100:00100000:2.0:1784094242.170304:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013871616 00000100:00100000:2.0:1784094242.170310:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013871616 00000100:00100000:2.0:1784094242.170357:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 964 00000100:00100000:2.0:1784094242.170368:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013871616:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094242.170412:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013871616:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094242.170453:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 964 00000100:00080000:1.0:1784094242.170620:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094242.281632:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094242.793726:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024354688:0@lo:400:kworker.0 00000100:00100000:3.0:1784094242.793839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094242.793912:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024355200:0@lo:400:kworker.0 00000100:00100000:3.0:1784094242.793947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094242.793976:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784094242.793982:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024354816:0@lo:400:kworker.0 00000100:00100000:3.0:1784094242.794005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094242.794037:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024355328:0@lo:400:kworker.0 00000100:00100000:3.0:1784094242.794064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094242.794183:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354688 00000100:00100000:1.0:1784094242.794193:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354688 00000100:00100000:1.0:1784094242.794258:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1784094242.794269:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024354688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.794333:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024354688:12345-0@lo:400:kworker.0 Request processed in 66us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094242.794340:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1784094242.794391:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355200 00000100:00100000:1.0:1784094242.794396:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355200 00000100:00100000:1.0:1784094242.794467:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354816 00000100:00100000:1.0:1784094242.794471:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354816 00000100:00100000:1.0:1784094242.794494:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1784094242.794501:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024355200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.794544:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024355200:12345-0@lo:400:kworker.0 Request processed in 43us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094242.794552:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1784094242.794568:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1784094242.794579:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024354816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.794615:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024354816:12345-0@lo:400:kworker.0 Request processed in 41us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094242.794622:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00080000:1.0:1784094242.794642:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094242.794694:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024354816:0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.794708:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024354688:0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.794717:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024355200:0@lo:400:kworker.0 00000100:00100000:2.0:1784094242.795467:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024354944:0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.795512:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024355072:0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.795555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094242.795768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094242.795846:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024355456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094242.795882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094242.795960:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024354944 00000100:00100000:1.0:1784094242.795967:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024354944 00000100:00100000:1.0:1784094242.796014:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1784094242.796022:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024354944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094242.796074:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024354944:12345-0@lo:400:kworker.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094242.796081:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:1.0:1784094242.796111:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094242.797474:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355328 00000100:00100000:3.0:1784094242.797487:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355328 00000100:00100000:2.0:1784094242.797504:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355072 00000100:00100000:2.0:1784094242.797511:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355072 00000100:00100000:0.0:1784094242.797588:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355456 00000100:00100000:2.0:1784094242.797589:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1784094242.797608:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355456 00000100:00100000:3.0:1784094242.797652:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1784094242.797674:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1784094242.797675:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1870757024355328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094242.797677:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024355072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094242.797695:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1870757024355456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094242.797740:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1784094242.797799:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024355072:12345-0@lo:400:kworker.0 Request processed in 198us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094242.797801:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1870757024355328:12345-0@lo:400:kworker.0 Request processed in 138us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094242.797816:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1784094242.797827:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1784094242.797846:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024355456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094242.797859:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:3.0:1784094242.797860:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094242.797866:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094242.797908:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024355072:0@lo:400:kworker.0 00000100:00100000:3.0:1784094242.797917:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024355328:0@lo:400:kworker.0 00000100:00100000:0.0:1784094242.798034:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024354944:0@lo:400:kworker.0 00000100:00100000:0.0:1784094242.798063:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024355456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784094243.305660:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094243.325273:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00010000:00010000:2.0:1784094244.330928:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094244.844904:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024355584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094244.844965:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094244.845786:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355584 00000100:00100000:1.0:1784094244.845797:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355584 00000100:00080000:3.0:1784094244.845866:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094244.845875:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1784094244.845887:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024355584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094244.845923:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094244.845987:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024355584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094244.845994:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1784094244.846207:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024355584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094245.353616:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094246.377898:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094247.288882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094247.288924:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872128 00000100:00100000:3.0:1784094247.288930:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094247.288934:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872128 00000100:00100000:3.0:1784094247.288976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094247.288988:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 968 00000100:00100000:1.0:1784094247.288996:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013872128:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094247.289019:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872000 00000100:00100000:2.0:1784094247.289026:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872000 00000100:00100000:2.0:1784094247.289064:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 892 00000100:00100000:2.0:1784094247.289074:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013872000:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094247.289093:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013872128:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 95us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094247.289101:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 968 00000100:00100000:2.0:1784094247.289110:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013872000:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094247.289119:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 892 00000100:00080000:1.0:1784094247.289126:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094247.290521:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872384 00000100:00100000:1.0:1784094247.290529:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872384 00000100:00100000:1.0:1784094247.290571:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 739 00000100:00100000:1.0:1784094247.290579:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013872384:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094247.290601:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094247.290636:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872256 00000100:00100000:3.0:1784094247.290641:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872256 00000100:00100000:1.0:1784094247.290669:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013872384:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 91us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094247.290675:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 739 00000100:00100000:3.0:1784094247.290689:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 740 00000100:00100000:3.0:1784094247.290700:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013872256:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:1.0:1784094247.290708:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094247.290713:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094247.290735:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013872256:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094247.290742:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 740 00010000:00010000:2.0:1784094247.401985:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094247.913840:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024355712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094247.913911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094247.914119:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355712 00000100:00100000:1.0:1784094247.914127:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355712 00000100:00080000:0.0:1784094247.914183:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094247.914197:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1784094247.914207:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024355712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094247.914242:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094247.914441:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024355712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 216us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094247.914450:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1784094247.914855:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:0.0:1784094247.914861:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90710134f480, transno 4294967363 00000100:00100000:0.0:1784094247.914884:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024355712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094247.915972:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024356096:0@lo:400:kworker.0 00000100:00100000:3.0:1784094247.916018:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094247.916051:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094247.916057:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024355968:0@lo:400:kworker.0 00000100:00100000:3.0:1784094247.916080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094247.916159:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356096 00000100:00100000:1.0:1784094247.916164:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356096 00000100:00100000:1.0:1784094247.916211:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355968 00000100:00100000:1.0:1784094247.916214:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355968 00000100:00100000:1.0:1784094247.916233:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1784094247.916241:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024356096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094247.916283:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024356096:12345-0@lo:400:kworker.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094247.916290:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1784094247.916303:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1784094247.916308:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024355968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094247.916335:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024355968:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094247.916341:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1784094247.916378:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024356224:0@lo:400:kworker.0 00000100:00100000:1.0:1784094247.916413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094247.916464:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784094247.916471:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024355840:0@lo:400:kworker.0 00000100:00100000:1.0:1784094247.916499:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094247.916526:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024356352:0@lo:400:kworker.0 00000100:00100000:1.0:1784094247.916545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094247.916569:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356352 00000100:00100000:1.0:1784094247.916572:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356352 00000100:00100000:1.0:1784094247.916596:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1784094247.916601:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024356352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094247.916631:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024356352:12345-0@lo:400:kworker.0 Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094247.916636:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1784094247.916664:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024356352:0@lo:400:kworker.0 00000100:00100000:3.0:1784094247.916733:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356224 00000100:00100000:3.0:1784094247.916737:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356224 00000100:00100000:3.0:1784094247.916776:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1784094247.916778:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024355840 00000100:00100000:2.0:1784094247.916784:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024355840 00000100:00100000:3.0:1784094247.916785:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024356224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094247.916830:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1784094247.916840:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024355840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094247.916847:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024356224:12345-0@lo:400:kworker.0 Request processed in 62us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094247.916856:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00080000:3.0:1784094247.916877:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094247.916883:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094247.916883:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024355840:12345-0@lo:400:kworker.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094247.916894:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1784094247.916907:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024355968:0@lo:400:kworker.0 00000100:00100000:3.0:1784094247.916921:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024356096:0@lo:400:kworker.0 00000100:00100000:2.0:1784094247.916950:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024355840:0@lo:400:kworker.0 00000100:00100000:2.0:1784094247.916962:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024356224:0@lo:400:kworker.0 00010000:00010000:1.0:1784094248.426619:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094249.449728:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094249.962329:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024356480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094249.962464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094249.962677:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356480 00000100:00100000:0.0:1784094249.962765:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356480 00000100:00080000:3.0:1784094249.962885:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094249.962903:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1784094249.962915:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024356480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094249.962962:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094249.963017:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024356480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094249.963022:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1784094249.963084:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024356480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094250.473933:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094251.497823:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094252.408999:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094252.409090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094252.409130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094252.409169:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094252.409256:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872640 00000100:00100000:3.0:1784094252.409264:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872640 00000100:00080000:1.0:1784094252.409314:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094252.409329:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 972 00000100:00100000:3.0:1784094252.409339:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013872640:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094252.409342:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872896 00000100:00100000:1.0:1784094252.409345:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872896 00000100:00100000:1.0:1784094252.409373:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872768 00000100:00100000:1.0:1784094252.409375:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872768 00000100:00100000:1.0:1784094252.409393:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 742 00000100:00100000:1.0:1784094252.409399:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013872896:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094252.409444:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013872640:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094252.409447:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013872896:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094252.409452:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 972 00000100:00100000:1.0:1784094252.409453:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 742 00000100:00100000:1.0:1784094252.409468:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 743 00000100:00100000:1.0:1784094252.409474:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013872768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094252.409496:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013872768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 23us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094252.409501:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 743 00000100:00080000:1.0:1784094252.409513:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094252.409516:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094252.409630:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013872512 00000100:00100000:2.0:1784094252.409635:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013872512 00000100:00100000:2.0:1784094252.409677:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 894 00000100:00100000:2.0:1784094252.409686:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013872512:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094252.409748:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013872512:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 62us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094252.409756:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 894 00010000:00010000:1.0:1784094252.521617:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094253.033877:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024356608:0@lo:400:kworker.0 00000100:00100000:3.0:1784094253.033910:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024356864:0@lo:400:kworker.0 00000100:00100000:2.0:1784094253.033936:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024356736:0@lo:400:kworker.0 00000100:00100000:1.0:1784094253.033973:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094253.033979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094253.033983:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024356992:0@lo:400:kworker.0 00000100:00100000:1.0:1784094253.034108:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024357120:0@lo:400:kworker.0 00000100:00100000:3.0:1784094253.034136:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356608 00000100:00100000:3.0:1784094253.034144:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356608 00000100:00100000:1.0:1784094253.034149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094253.034177:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356864 00000100:00100000:0.0:1784094253.034184:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356864 00000100:00100000:2.0:1784094253.034188:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094253.034200:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1784094253.034214:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024356608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094253.034217:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357120 00000100:00100000:1.0:1784094253.034222:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357120 00000100:00100000:2.0:1784094253.034241:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356992 00000100:00100000:0.0:1784094253.034243:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1784094253.034247:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356992 00000100:00100000:0.0:1784094253.034256:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024356864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094253.034267:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1784094253.034280:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024357120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094253.034287:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024356608:12345-0@lo:400:kworker.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094253.034292:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1784094253.034301:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1784094253.034308:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024356864:12345-0@lo:400:kworker.0 Request processed in 55us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094253.034309:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024356992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094253.034322:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1784094253.034324:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024357120:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094253.034331:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00080000:0.0:1784094253.034355:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094253.034361:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094253.034362:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024357376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094253.034367:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024356992:12345-0@lo:400:kworker.0 Request processed in 63us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094253.034376:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1784094253.034396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094253.034402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094253.034444:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357376 00000100:00100000:1.0:1784094253.034449:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357376 00000100:00100000:2.0:1784094253.034463:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024357248:0@lo:400:kworker.0 00000100:00100000:3.0:1784094253.034476:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024356864:0@lo:400:kworker.0 00000100:00100000:1.0:1784094253.034483:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1784094253.034491:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024357376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094253.034493:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024356736 00000100:00100000:0.0:1784094253.034499:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024356736 00000100:00100000:2.0:1784094253.034511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1784094253.034520:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094253.034524:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024357120:0@lo:400:kworker.0 00000100:00100000:0.0:1784094253.034537:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:3.0:1784094253.034542:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024356608:0@lo:400:kworker.0 00000100:00100000:0.0:1784094253.034549:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024356736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094253.034569:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024356992:0@lo:400:kworker.0 00000100:00100000:3.0:1784094253.034572:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357248 00000100:00100000:3.0:1784094253.034576:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357248 00000100:00100000:1.0:1784094253.034579:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024357376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094253.034586:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1784094253.034605:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024356736:12345-0@lo:400:kworker.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094253.034612:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024356736:0@lo:400:kworker.0 00000100:00080000:1.0:1784094253.034612:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094253.034617:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1784094253.034618:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:3.0:1784094253.034633:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024357248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094253.034654:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024357376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094253.035294:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024357248:0@lo:400:kworker.0 00000100:00100000:3.0:1784094253.035835:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024357248:12345-0@lo:400:kworker.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094253.035843:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00010000:00010000:2.0:1784094253.545593:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094254.569636:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094255.081814:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024357504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094255.081885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094255.082715:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357504 00000100:00100000:1.0:1784094255.082773:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357504 00000100:00080000:0.0:1784094255.082875:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094255.082881:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1784094255.082893:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024357504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094255.082927:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094255.082986:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024357504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094255.082993:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1784094255.083067:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024357504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094255.593894:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094256.618095:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094257.528827:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094257.528881:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094257.528916:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094257.528957:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094257.528991:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873408 00000100:00100000:1.0:1784094257.529000:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873408 00000100:00100000:1.0:1784094257.529056:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873280 00000100:00100000:1.0:1784094257.529059:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873280 00000100:00100000:1.0:1784094257.529085:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 746 00000100:00100000:1.0:1784094257.529095:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013873408:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094257.529162:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013873408:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094257.529170:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 746 00000100:00100000:1.0:1784094257.529185:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 747 00000100:00100000:1.0:1784094257.529191:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013873280:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094257.529214:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013873280:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 24us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094257.529220:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 747 00000100:00080000:1.0:1784094257.529235:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094257.529238:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094257.529399:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873024 00000100:00100000:2.0:1784094257.529405:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873024 00000100:00100000:2.0:1784094257.529470:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 896 00000100:00100000:2.0:1784094257.529479:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013873024:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094257.529515:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013873024:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094257.529522:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 896 00000100:00100000:0.0:1784094257.529568:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873152 00000100:00100000:0.0:1784094257.529573:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873152 00000100:00080000:2.0:1784094257.529609:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094257.529631:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 976 00000100:00100000:0.0:1784094257.529641:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013873152:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094257.529686:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013873152:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094257.529694:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 976 00010000:00010000:2.0:1784094257.642101:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094258.153666:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024357632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094258.153675:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094258.153693:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024357760:0@lo:400:kworker.0 00000100:00100000:2.0:1784094258.153741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094258.153841:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357632 00000100:00100000:1.0:1784094258.153848:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357632 00000100:00100000:1.0:1784094258.153897:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1784094258.153907:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024357632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094258.153953:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094258.154199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784094258.154241:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094258.154262:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024357888:0@lo:400:kworker.0 00000100:00100000:0.0:1784094258.154291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094258.154328:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357760 00000100:00100000:0.0:1784094258.154332:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357760 00000100:00100000:0.0:1784094258.154359:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1784094258.154365:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024357760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094258.154400:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024357760:12345-0@lo:400:kworker.0 Request processed in 34us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094258.154406:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1784094258.154520:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024357632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 613us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094258.154527:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1784094258.154536:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024357888 00000100:00100000:3.0:1784094258.154542:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024357888 00000100:00100000:1.0:1784094258.154550:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024358144:0@lo:400:kworker.0 00000100:00100000:3.0:1784094258.154577:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1784094258.154581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094258.154588:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024357888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094258.154615:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094258.154623:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024358016:0@lo:400:kworker.0 00000100:00100000:3.0:1784094258.154656:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024357888:12345-0@lo:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094258.154662:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1784094258.154675:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094258.154686:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358144 00000100:00100000:3.0:1784094258.154691:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358144 00000100:00100000:1.0:1784094258.154732:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237586d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024357888:0@lo:400:kworker.0 00000100:00100000:3.0:1784094258.154749:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1784094258.154750:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094258.154759:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024358272:0@lo:400:kworker.0 00000100:00100000:3.0:1784094258.154763:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024358144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094258.154787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094258.154815:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024358144:12345-0@lo:400:kworker.0 Request processed in 56us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094258.154821:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358016 00000100:00100000:3.0:1784094258.154826:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1784094258.154827:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358016 00000100:00100000:1.0:1784094258.154858:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358272 00000100:00100000:1.0:1784094258.154862:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358272 00000100:00100000:3.0:1784094258.154880:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1784094258.154888:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1784094258.154893:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024358016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094258.154900:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024358272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094258.154929:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024358016:12345-0@lo:400:kworker.0 Request processed in 41us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094258.154937:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1784094258.154957:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024358272:12345-0@lo:400:kworker.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094258.154960:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094258.154966:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094258.154974:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1784094258.155003:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024357760:0@lo:400:kworker.0 00000100:00100000:1.0:1784094258.155014:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024358272:0@lo:400:kworker.0 00000100:00100000:1.0:1784094258.155043:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237586300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024358016:0@lo:400:kworker.0 00000100:00100000:1.0:1784094258.155055:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024358144:0@lo:400:kworker.0 00000100:00100000:2.0:1784094258.155319:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024357632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784094258.667514:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094259.220628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094259.220744:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873536 00000100:00100000:3.0:1784094259.220754:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873536 00000100:00100000:3.0:1784094259.220838:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1071 00000100:00100000:3.0:1784094259.220848:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013873536:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094259.220956:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013873536:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094259.220964:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1071 00000100:00080000:0.0:1784094259.221935:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094259.224366:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094259.224513:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873664 00000100:00100000:1.0:1784094259.224525:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873664 00000100:00080000:0.0:1784094259.224604:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094259.224612:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:1.0:1784094259.224623:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013873664:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094259.225106:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013873664:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 483us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094259.225114:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 544 00000100:00100000:2.0:1784094259.227490:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094259.227628:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873792 00000100:00100000:3.0:1784094259.227638:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873792 00000100:00100000:3.0:1784094259.227720:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00100000:3.0:1784094259.227730:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013873792:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094259.228063:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013873792:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 332us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094259.228071:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 545 00000100:00080000:0.0:1784094259.228519:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094259.230721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094259.230926:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013873920 00000100:00100000:1.0:1784094259.230937:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013873920 00000100:00100000:1.0:1784094259.230996:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1072 00000100:00100000:1.0:1784094259.231007:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013873920:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094259.231591:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013873920:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 573us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094259.231601:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1072 00000100:00100000:2.0:1784094259.233670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094259.233817:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874048 00000100:00100000:1.0:1784094259.233827:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874048 00000100:00100000:1.0:1784094259.233947:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1073 00000100:00100000:1.0:1784094259.233959:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013874048:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094259.234050:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013874048:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 94us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094259.234058:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1073 00000100:00100000:0.0:1784094259.236136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094259.236236:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874176 00000100:00100000:3.0:1784094259.236245:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874176 00000100:00100000:3.0:1784094259.236340:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 546 00000100:00100000:3.0:1784094259.236352:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013874176:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094259.236833:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013874176:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 482us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094259.236842:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 546 00000100:00100000:1.0:1784094259.243921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094259.243956:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874304 00000100:00100000:1.0:1784094259.243966:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874304 00000100:00100000:1.0:1784094259.244015:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 547 00000100:00100000:1.0:1784094259.244025:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013874304:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094259.244369:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58139:x1870757013874304:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 345us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094259.244378:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 547 00000100:00100000:0.0:1784094259.246536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094259.246628:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874432 00000100:00100000:1.0:1784094259.246639:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874432 00000100:00100000:1.0:1784094259.246701:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1074 00000100:00100000:1.0:1784094259.246713:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013874432:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094259.247335:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:58139:x1870757013874432:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 623us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094259.247345:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1074 00010000:00010000:2.0:1784094259.692609:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094260.201729:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024358400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094260.201819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094260.201903:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358400 00000100:00100000:0.0:1784094260.201911:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358400 00000100:00100000:0.0:1784094260.202032:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1784094260.202043:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024358400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094260.202079:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094260.202136:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024358400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094260.202148:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1784094260.202234:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024358400:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094260.202307:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1784094260.461045:0:97614:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb0e763e0 20000000:00000080:1.0:1784094260.461062:0:97614:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e310000 uarg=0000000000000000 00010000:00010000:1.0:1784094260.461636:0:97614:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094260.461665:0:97614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784094260.461669:0:97614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094260.461679:0:97614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc2e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dce expref: 5 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.461700:0:97614:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094260.461715:0:97614:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094260.461728:0:97614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.461738:0:97614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.461745:0:97614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.461775:0:97614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.461785:0:97614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 18 pid: 5772 timeout: 1571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094260.461799:0:97614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97614:1870757024358528:0@lo:104: 00000100:00100000:1.0:1784094260.461847:0:97614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094260.461934:0:97614:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072039169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094260.462026:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358528 00000100:00100000:2.0:1784094260.462034:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358528 00000100:00100000:2.0:1784094260.462083:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784094260.462092:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:97614:x1870757024358528:12345-0@lo:104: 00010000:00010000:2.0:1784094260.462104:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462196:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094260.462203:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:97614:x1870757024358528:12345-0@lo:104: Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094260.462210:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00010000:3.0:1784094260.462283:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094260.462290:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094260.462297:0:97614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97614:1870757024358528:0@lo:104: 00010000:00010000:3.0:1784094260.462298:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094260.462301:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094260.462309:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.462313:0:97614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094260.462316:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094260.462321:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094260.462357:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094260.462365:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094260.462393:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094260.462401:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc2c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc2cb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094260.462412:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024358656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094260.462413:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094260.462415:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094260.462417:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094260.462472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094260.462540:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358656 00000100:00100000:2.0:1784094260.462544:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358656 00010000:00010000:2.0:1784094260.462569:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 19 pid: 5772 timeout: 1571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094260.462667:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1784094260.462675:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024358656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094260.462686:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094260.462691:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 19 pid: 5772 timeout: 1571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462700:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 19 pid: 5772 timeout: 1571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462711:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12c00/0x9ce98053214cc2cb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc2c4 expref: 19 pid: 5772 timeout: 1571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462721:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462729:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462741:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462748:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462754:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462763:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462768:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094260.462772:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462778:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462798:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.462805:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094260.462840:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024358656:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094260.462847:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:1.0:1784094260.462887:0:97614:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094260.462894:0:97614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094260.462895:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024358656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094260.462901:0:97614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214cc33b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094260.713855:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094261.738266:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094261.891643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094261.892247:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874560 00000100:00100000:3.0:1784094261.892257:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874560 00000100:00080000:1.0:1784094261.892313:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094261.892335:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1075 00000100:00100000:3.0:1784094261.892345:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:58225:x1870757013874560:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094261.892363:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094261.892383:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5de3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.892465:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc349 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.892478:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.892491:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094261.892688:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:3.0:1784094261.892692:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094261.892763:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc349 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.892791:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5de3 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.892809:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc349 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5de3 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.892818:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784094261.892821:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094261.892825:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784094261.892940:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:58225:x1870757013874560:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 596us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094261.892949:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1075 00000100:00100000:3.0:1784094261.896105:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094261.896130:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874816 00000100:00100000:3.0:1784094261.896137:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874816 00000100:00100000:3.0:1784094261.896173:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1076 00000100:00100000:3.0:1784094261.896180:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:58225:x1870757013874816:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094261.896217:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094261.896237:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc349 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5de3 expref: 6 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.896248:0:5779:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc2e7) 00010000:00010000:3.0:1784094261.896251:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce900) 00010000:00010000:3.0:1784094261.896258:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094261.896277:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.896286:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094261.896293:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784094261.918290:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967707 is committed 00000004:00010000:3.0:1784094261.918300:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ca162b66 reply state 00000000dc46ef3e transno 4294967707 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094261.918314:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094261.918465:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00080000:3.0:1784094261.918624:0:5779:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784094261.918647:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:58225:x1870757013874816:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 22462us (22540us total) trans 4294967707 rc 0/0 00000100:00100000:3.0:1784094261.918658:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1076 00010000:00010000:2.0:1784094261.918663:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094261.918675:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094261.918684:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094261.918689:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094261.918693:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094261.918706:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094261.918822:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce300) 00010000:00010000:2.0:1784094261.918827:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094261.918833:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094261.918839:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc350 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094262.306135:0:97809:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde14a2a20 20000000:00000080:0.0:1784094262.306152:0:97809:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d69400 uarg=0000000000000000 00010000:00010000:0.0:1784094262.306752:0:97809:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094262.306768:0:97809:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094262.306781:0:97809:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094262.306854:0:97809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306869:0:97809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306880:0:97809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306887:0:97809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306894:0:97809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306901:0:97809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306907:0:97809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094262.306911:0:97809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306919:0:97809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306932:0:97809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306939:0:97809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.306945:0:97809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77800/0x9ce98053214cc357 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094262.505556:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094262.505565:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094262.505571:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094262.505622:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.505633:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.505645:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094262.505671:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024358784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094262.505731:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094262.505848:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210bed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094262.505899:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358784 00000100:00100000:1.0:1784094262.505906:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358784 00000100:00100000:1.0:1784094262.505957:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1784094262.505966:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024358784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094262.505977:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094262.505989:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc35e expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094262.506009:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc35e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094262.506021:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc35e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094262.506030:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13600, rc 0) 00000100:00100000:1.0:1784094262.506104:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024358784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094262.506110:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1784094262.506215:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024358784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094262.506229:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.506238:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094262.506255:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094262.506259:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094262.506267:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094262.650622:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094262.650664:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094262.650711:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094262.650865:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013875328 00000100:00100000:1.0:1784094262.650876:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013875328 00000100:00100000:0.0:1784094262.650913:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013875072 00000100:00100000:0.0:1784094262.650920:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013875072 00000100:00100000:1.0:1784094262.650944:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 749 00000100:00100000:1.0:1784094262.650958:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013875328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094262.650966:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 980 00000100:00100000:0.0:1784094262.650977:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013875072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094262.651039:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013875328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 81us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094262.651040:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013875072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 61us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094262.651055:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 749 00000100:00100000:0.0:1784094262.651056:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 980 00000100:00080000:1.0:1784094262.651086:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094262.651098:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094262.651133:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013875200 00000100:00100000:3.0:1784094262.651137:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013875200 00000100:00100000:2.0:1784094262.651380:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013874944 00000100:00100000:2.0:1784094262.651386:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013874944 00000100:00100000:2.0:1784094262.651446:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 899 00000100:00100000:2.0:1784094262.651456:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013874944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:1.0:1784094262.655412:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094262.655457:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013874944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 3993us (4736us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094262.655470:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 899 00000100:00100000:3.0:1784094262.655797:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 750 00000100:00100000:3.0:1784094262.655812:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013875200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094262.656203:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013875200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 396us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094262.656212:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 750 00010000:00010000:2.0:1784094262.761648:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094263.273564:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094263.273586:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024358912:0@lo:400:kworker.0 00000100:00100000:3.0:1784094263.273617:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024359168:0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.273667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094263.273668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094263.273730:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024359296:0@lo:400:kworker.0 00000100:00100000:1.0:1784094263.274697:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024359424:0@lo:400:kworker.0 00000100:00100000:3.0:1784094263.275882:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784094263.275893:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024359040:0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.275901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094263.275938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094263.275962:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024359552:0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.275967:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024358912 00000100:00100000:3.0:1784094263.275987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094263.276015:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359168 00000100:00100000:3.0:1784094263.276021:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359168 00000100:00100000:3.0:1784094263.276072:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359040 00000100:00100000:3.0:1784094263.276074:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359040 00000100:00100000:3.0:1784094263.276096:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1784094263.276103:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024358912 00000100:00100000:3.0:1784094263.276108:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024359168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.276148:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:2.0:1784094263.276159:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024358912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094263.276166:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024359168:12345-0@lo:400:kworker.0 Request processed in 60us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094263.276172:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1784094263.276190:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1784094263.276197:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024359040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.276214:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024358912:12345-0@lo:400:kworker.0 Request processed in 56us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094263.276223:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1784094263.276232:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024359040:12345-0@lo:400:kworker.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094263.276238:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1784094263.276265:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359296 00000100:00100000:3.0:1784094263.276268:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359296 00000100:00100000:3.0:1784094263.276302:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359552 00000100:00100000:3.0:1784094263.276307:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359552 00000100:00100000:2.0:1784094263.276317:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1784094263.276328:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024359296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094263.276337:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1784094263.276347:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024359552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.276364:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024359296:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094263.276370:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1784094263.276388:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094263.276393:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024359552:12345-0@lo:400:kworker.0 Request processed in 47us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094263.276397:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024359680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094263.276408:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00080000:3.0:1784094263.276447:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094263.276453:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094263.276453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784094263.276458:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094263.276482:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359680 00000100:00100000:2.0:1784094263.276485:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359680 00000100:00100000:3.0:1784094263.276515:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024359040:0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.276521:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1784094263.276532:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024359552:0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.276537:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024359680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094263.276547:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024359168:0@lo:400:kworker.0 00002000:00000024:2.0:1784094263.276569:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094263.276603:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024359296:0@lo:400:kworker.0 00000100:00100000:3.0:1784094263.276617:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024358912:0@lo:400:kworker.0 00000100:00100000:2.0:1784094263.276623:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024359680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094263.276632:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1784094263.276670:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024359680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094263.276775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094263.276812:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359424 00000100:00100000:1.0:1784094263.276816:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359424 00000100:00100000:1.0:1784094263.276844:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1784094263.276851:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024359424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094263.276883:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024359424:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094263.276889:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00080000:1.0:1784094263.276902:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094263.276919:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024359424:0@lo:400:kworker.0 00010000:00010000:1.0:1784094263.787598:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094263.830395:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094263.830700:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013875456 00000100:00100000:1.0:1784094263.830710:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013875456 00000100:00080000:2.0:1784094263.830761:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094263.831072:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1077 00000100:00100000:1.0:1784094263.831084:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58302:x1870757013875456:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094263.831104:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094263.831127:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dea expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831188:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831202:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831215:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831228:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831235:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831242:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831773:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831787:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831794:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094263.831869:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1784094263.831874:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094263.831944:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831957:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831964:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831971:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831977:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094263.831981:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831988:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.831999:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12700) 00010000:00010000:1.0:1784094263.832002:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094263.832007:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832017:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc373 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832026:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832032:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832038:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832043:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094263.832045:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832051:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832057:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12b00) 00010000:00010000:1.0:1784094263.832060:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094263.832062:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832068:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214cc37a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832096:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dea expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832111:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dea expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.832119:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094263.832121:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094263.832123:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784094263.832187:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:58302:x1870757013875456:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1106us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094263.832195:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1077 00000100:00100000:1.0:1784094263.836414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094263.837393:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013875712 00000100:00100000:0.0:1784094263.837403:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013875712 00000100:00100000:0.0:1784094263.837465:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1078 00000100:00100000:0.0:1784094263.837475:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:58302:x1870757013875712:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094263.837504:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094263.837523:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc388 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5df1 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.837895:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.837911:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.837923:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.837937:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.837945:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.837952:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094263.838816:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1784094263.839078:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc39d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839089:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839098:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839129:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839135:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839141:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839147:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094263.839151:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839157:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839169:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12a00) 00010000:00010000:0.0:1784094263.839171:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094263.839175:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839181:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc38f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094263.839191:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c007b644 reply state 000000001b191393 transno 4294967708 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094263.839198:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094263.839226:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc388 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5df1 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839240:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5df1 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.839247:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094263.839250:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094263.839252:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784094263.839317:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:58302:x1870757013875712:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1842us (2908us total) trans 4294967708 rc 0/0 00000100:00100000:0.0:1784094263.839325:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1078 00010000:00010000:1.0:1784094263.841600:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.841615:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.841622:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.841628:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094263.841632:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.841639:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.841651:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907202e6b900) 00010000:00010000:1.0:1784094263.841654:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094263.841658:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.841664:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc396 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094263.842902:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094263.842954:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013875968 00000100:00100000:3.0:1784094263.842963:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013875968 00000100:00100000:3.0:1784094263.843091:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1079 00000100:00100000:3.0:1784094263.843102:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:58302:x1870757013875968:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:3.0:1784094263.843154:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094263.843174:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc39d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5df1 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.843187:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907202e6b000) 00010000:00010000:3.0:1784094263.843195:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094263.843233:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.843246:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.843254:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094263.843368:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000007f6f21d6 reply state 0000000007bf1594 transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094263.843378:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094263.843483:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:58302:x1870757013875968:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 383us (585us total) trans 4294967709 rc 0/0 00000100:00100000:3.0:1784094263.843503:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1079 00010000:00010000:0.0:1784094263.845049:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.845062:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.845069:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.845075:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094263.845084:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.845091:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.845104:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907204fce600) 00010000:00010000:0.0:1784094263.845106:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094263.845110:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.845117:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc3ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094263.845300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094263.845470:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013876096 00000100:00100000:3.0:1784094263.845478:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013876096 00000100:00100000:3.0:1784094263.845532:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1080 00000100:00100000:3.0:1784094263.845543:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:58302:x1870757013876096:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784094263.845560:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094263.845575:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc3b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5df8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.845620:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5df8 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.845633:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5df8 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.845651:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784094263.845653:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784094263.845656:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094263.845712:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:58302:x1870757013876096:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 171us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094263.845719:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1080 00000100:00100000:3.0:1784094263.847754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094263.847816:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013876224 00000100:00100000:0.0:1784094263.847828:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013876224 00000100:00100000:0.0:1784094263.847874:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:0.0:1784094263.847883:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013876224:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:0.0:1784094263.848120:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013876224:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 238us (371us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784094263.848125:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 548 00000100:00100000:0.0:1784094263.852106:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094263.852476:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013876480 00000100:00100000:2.0:1784094263.852486:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013876480 00000100:00100000:2.0:1784094263.852548:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 110 00000100:00100000:2.0:1784094263.852558:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:58302:x1870757013876480:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:2.0:1784094263.852837:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:58302:x1870757013876480:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 279us (737us total) trans 4294967710 rc 0/0 00000100:00100000:2.0:1784094263.852846:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 110 00000100:00100000:1.0:1784094263.892232:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094263.892935:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013876608 00000100:00100000:0.0:1784094263.892945:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013876608 00000100:00100000:0.0:1784094263.893007:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1081 00000100:00100000:0.0:1784094263.893018:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:58306:x1870757013876608:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:0.0:1784094263.893039:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094263.893058:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc3b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5dff expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893118:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893133:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893143:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893156:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893162:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893168:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893261:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893270:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.893276:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094263.896646:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 0 00000004:00200000:0.0:1784094263.896651:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094263.896676:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896693:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896705:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896712:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896719:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896726:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094263.896730:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896738:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896753:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12a00) 00010000:00010000:0.0:1784094263.896758:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094263.896762:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896768:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc3c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896784:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896790:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896796:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896801:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094263.896803:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896810:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896817:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907202e6b200) 00010000:00010000:0.0:1784094263.896819:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094263.896822:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896828:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc3c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896870:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76000/0x9ce98053214cc3b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dff expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896885:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dff expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094263.896891:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907204fce700) 00010000:00010000:0.0:1784094263.896894:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094263.896896:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784094263.896984:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:58306:x1870757013876608:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 3967us (4758us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094263.896992:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1081 00000100:00100000:3.0:1784094263.899650:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094263.899764:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013876736 00000100:00100000:1.0:1784094263.899774:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013876736 00000100:00100000:1.0:1784094263.899842:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 549 00000100:00100000:1.0:1784094263.899853:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013876736:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094263.899870:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094263.899890:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e06 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094263.899917:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a571e38, atime: 0x6a571e38, ctime: 0x6a571e38, blocks: 0x1 00010000:00010000:1.0:1784094263.899937:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1424s v=(0 0) 00010000:00010000:1.0:1784094263.899942:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094263.899951:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.899969:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 7 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.899981:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784094263.900040:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013876736:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 189us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094263.900048:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 549 00000100:00100000:2.0:1784094263.904292:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094263.905620:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013876992 00000100:00100000:3.0:1784094263.905633:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013876992 00000100:00100000:3.0:1784094263.905700:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1082 00000100:00100000:3.0:1784094263.905709:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:58306:x1870757013876992:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:3.0:1784094263.905760:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094263.905786:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc3ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dff expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905817:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc3b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5df8 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905829:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784094263.905840:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094263.905862:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905875:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905885:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905897:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905904:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.905910:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906005:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906012:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906019:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094263.906584:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10368 00000004:00080000:3.0:1784094263.906596:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1424984172649ns, next at 1425984170224ns, rc = 0 00010000:00010000:3.0:1784094263.906649:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906658:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906666:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906673:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906680:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906685:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906709:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094263.906732:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906739:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906744:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906750:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094263.906754:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906761:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906770:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907204fcef00) 00010000:00010000:3.0:1784094263.906772:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094263.906776:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906783:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc3ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906798:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906803:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906808:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906813:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094263.906815:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906820:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906827:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12a00) 00010000:00010000:3.0:1784094263.906830:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094263.906834:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094263.906839:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc3dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094263.906847:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006e631e7c reply state 000000001d641e25 transno 4294967711 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094263.906856:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094263.906938:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:58306:x1870757013876992:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1227us (2653us total) trans 4294967711 rc 0/0 00000100:00100000:3.0:1784094263.906947:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1082 00010000:00010000:2.0:1784094263.907080:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094263.907088:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094263.907094:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094263.907098:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094263.907104:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094263.907115:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff907204fcef00) 00010000:00010000:2.0:1784094263.907117:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094263.907121:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094263.907128:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc3f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094263.907143:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094263.907146:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094263.907147:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094263.909012:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.909028:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.909036:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.909041:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094263.909046:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.909058:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.909070:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907204fce400) 00010000:00010000:1.0:1784094263.909073:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094263.909077:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094263.909082:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc3e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094264.742823:0:98052:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc7438240 20000000:00000080:1.0:1784094264.742837:0:98052:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b33400 uarg=0000000000000000 00010000:00010000:1.0:1784094264.743009:0:98052:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094264.743039:0:98052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12a00) 00010000:00010000:1.0:1784094264.743042:0:98052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094264.743050:0:98052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5dea expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743067:0:98052:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094264.743077:0:98052:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094264.743088:0:98052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743098:0:98052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc35e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743104:0:98052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743131:0:98052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc35e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743140:0:98052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc35e expref: 18 pid: 5770 timeout: 1575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094264.743152:0:98052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98052:1870757024359808:0@lo:104: 00000100:00100000:1.0:1784094264.743202:0:98052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094264.743279:0:98052:0:(client.c:2702:ptlrpc_set_wait()) set ffff907237b79780 going to sleep for 11 seconds 00000100:00100000:2.0:1784094264.743315:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359808 00000100:00100000:2.0:1784094264.743320:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359808 00000100:00100000:2.0:1784094264.743392:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1784094264.743401:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:98052:x1870757024359808:12345-0@lo:104: 00010000:00010000:2.0:1784094264.743410:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094264.743488:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094264.743495:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:98052:x1870757024359808:12345-0@lo:104: Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094264.743503:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1784094264.743580:0:98052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98052:1870757024359808:0@lo:104: 00010000:00010000:1.0:1784094264.743600:0:98052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094264.743618:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094264.743627:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094264.743635:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094264.743640:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094264.743648:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094264.743656:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094264.743662:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094264.743691:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094264.743697:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094264.743732:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094264.743740:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214cc35e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc365 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094264.743747:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024359936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094264.743753:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094264.743757:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094264.743759:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094264.743777:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094264.743830:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024359936 00000100:00100000:1.0:1784094264.743836:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024359936 00010000:00010000:1.0:1784094264.743857:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc35e expref: 19 pid: 5770 timeout: 1575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094264.743886:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1784094264.743892:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024359936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094264.743904:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094264.743909:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc35e expref: 19 pid: 5770 timeout: 1575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743919:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc35e expref: 19 pid: 5770 timeout: 1575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743930:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214cc365 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc35e expref: 19 pid: 5770 timeout: 1575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743940:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743948:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743960:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743967:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743974:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743980:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.743985:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094264.743989:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.744000:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.744026:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094264.744035:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094264.744049:0:98052:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094264.744058:0:98052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094264.744064:0:98052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214cc3f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094264.744073:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024359936:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094264.744081:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784094264.744111:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024359936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094264.810693:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784094265.322822:0:7044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1426400396929ns, next at 1427400394518ns, rc = 0 00000100:00100000:1.0:1784094265.322969:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024360064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094265.323042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094265.323771:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360064 00000100:00100000:0.0:1784094265.323781:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360064 00000100:00100000:0.0:1784094265.323891:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1784094265.323902:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024360064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094265.323938:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094265.323999:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024360064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094265.324009:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1784094265.324047:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024360064:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784094265.324240:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094265.833734:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094266.222281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094266.222480:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013877120 00000100:00100000:1.0:1784094266.222491:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013877120 00000100:00080000:2.0:1784094266.222553:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094266.222570:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1083 00000100:00100000:1.0:1784094266.222584:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:58393:x1870757013877120:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094266.222607:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094266.222632:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc3ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e0d expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.222698:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.222711:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.222729:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094266.222788:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1784094266.222792:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094266.222818:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.222843:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc3ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e0d expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.222863:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e0d expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.222872:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12000) 00010000:00010000:1.0:1784094266.222875:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094266.222879:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784094266.223116:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:58393:x1870757013877120:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 534us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094266.223125:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1083 00000100:00100000:2.0:1784094266.227375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094266.227409:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013877376 00000100:00100000:2.0:1784094266.227436:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013877376 00000100:00100000:2.0:1784094266.227498:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1084 00000100:00100000:2.0:1784094266.227509:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:58393:x1870757013877376:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094266.227558:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094266.227583:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e0d expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.227597:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc381) 00010000:00010000:2.0:1784094266.227602:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12000) 00010000:00010000:2.0:1784094266.227615:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094266.227639:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.227651:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.227659:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094266.259570:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000004:00010000:1.0:1784094266.259570:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000001f0842e7 reply state 0000000077879509 transno 4294967712 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094266.259589:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784094266.259597:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967708 is committed 00000001:00080000:3.0:1784094266.259613:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967712 is committed 00000004:00080000:3.0:1784094266.259622:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00000100:00100000:3.0:1784094266.259754:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094266.259774:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024360192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784094266.259843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:1.0:1784094266.259870:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:2.0:1784094266.259900:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360192 00000100:00100000:2.0:1784094266.259909:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360192 00000100:00100000:2.0:1784094266.259964:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1784094266.259974:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024360192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784094266.260000:0:6572:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:2.0:1784094266.260033:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.260053:0:6572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.260062:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1784094266.260066:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094266.260071:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.260100:0:6572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 6 pid: 6573 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784094266.260103:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1784094266.260122:0:6572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 6 pid: 6573 timeout: 1527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094266.260123:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:58393:x1870757013877376:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 32612us (32749us total) trans 4294967712 rc 0/0 00000100:00100000:1.0:1784094266.260149:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1084 00000100:00100000:2.0:1784094266.260152:0:6572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024360320:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094266.260195:0:6572:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093afa80 going to sleep for 11 seconds 00010000:00010000:0.0:1784094266.260308:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.260318:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.260326:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.260336:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094266.260341:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.260348:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.260363:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff90721a781a00) 00010000:00010000:0.0:1784094266.260366:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094266.260370:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.260376:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc40d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094266.263644:0:6572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6572:1870757024360320:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094266.263675:0:6572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094266.264160:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094266.264214:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013877504 00000100:00100000:3.0:1784094266.264222:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013877504 00010000:00010000:3.0:1784094266.264283:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 7 pid: 6573 timeout: 1527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094266.264320:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 347 00000100:00100000:3.0:1784094266.264330:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013877504:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784094266.264344:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094266.264351:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 7 pid: 6573 timeout: 1527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264365:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 7 pid: 6573 timeout: 1527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264391:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdbebd94/0x9ce98053214cc3d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e06 expref: 7 pid: 6573 timeout: 1527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264407:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094266.264411:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094266.264416:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264475:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264505:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094266.264566:0:6572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094266.264575:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013877504:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 243us (414us total) trans 0 rc 0/0 00010000:00010000:0.0:1784094266.264581:0:6572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094266.264589:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 347 00010000:00010000:0.0:1784094266.264598:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.264607:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784094266.264710:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094266.264711:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094266.264786:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094266.264793:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264808:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094266.264813:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264820:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264829:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264833:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e6fe6c/0x9ce98053214cc414 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.264847:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094266.264848:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094266.264849:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094266.265250:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024360192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5276us (5406us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1784094266.265259:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000004:00080000:3.0:1784094266.265304:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9071026bd880/2, rc 0, transno 4294967365 00000100:00100000:3.0:1784094266.265312:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024360192:0@lo:6:osp-syn-0-0.0 00000020:00000080:3.0:1784094266.698830:0:98248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff078e2ae0 20000000:00000080:3.0:1784094266.698848:0:98248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210e72000 uarg=0000000000000000 00010000:00010000:3.0:1784094266.699329:0:98248:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094266.699344:0:98248:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094266.699357:0:98248:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094266.699376:0:98248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699395:0:98248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699883:0:98248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699891:0:98248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699898:0:98248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699906:0:98248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699912:0:98248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094266.699917:0:98248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699925:0:98248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699940:0:98248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699948:0:98248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.699954:0:98248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc41b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094266.729640:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094266.729646:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094266.729650:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094266.729771:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.729781:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094266.729789:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094266.729812:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024360448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094266.729867:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094266.729910:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486540 going to sleep for 11 seconds 00000100:00100000:2.0:1784094266.729913:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360448 00000100:00100000:2.0:1784094266.729922:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360448 00000100:00100000:2.0:1784094266.729992:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1784094266.730002:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024360448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094266.730016:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094266.730030:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc422 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.730053:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc422 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.730076:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc422 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094266.730273:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784094266.730324:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024360448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 323us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094266.730336:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1784094266.730364:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024360448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094266.730382:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.730394:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094266.730413:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094266.730461:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094266.730472:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094266.857631:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094267.770999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094267.771036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094267.771112:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094267.771146:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094267.771176:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013877632 00000100:00100000:2.0:1784094267.771186:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013877632 00000100:00100000:2.0:1784094267.771256:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:2.0:1784094267.771268:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013877632:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094267.771342:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013877632:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094267.771353:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:2.0:1784094267.771396:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013877888 00000100:00100000:2.0:1784094267.771400:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013877888 00000100:00100000:2.0:1784094267.771610:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878016 00000100:00100000:2.0:1784094267.771615:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878016 00000100:00100000:1.0:1784094267.771714:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 753 00000100:00100000:1.0:1784094267.771725:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013877888:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094267.771759:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013877888:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094267.771766:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 753 00000100:00100000:2.0:1784094267.771971:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 754 00000100:00100000:2.0:1784094267.771980:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013878016:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094267.772010:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013878016:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 32us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094267.772016:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 754 00000100:00100000:2.0:1784094267.772036:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013877760 00000100:00100000:2.0:1784094267.772039:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013877760 00000100:00100000:2.0:1784094267.772140:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 984 00000100:00100000:2.0:1784094267.772147:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013877760:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094267.772179:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013877760:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094267.772186:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 984 00000100:00080000:2.0:1784094267.772326:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784094267.888393:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094268.218838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094268.219804:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878144 00000100:00100000:2.0:1784094268.219816:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878144 00000100:00100000:2.0:1784094268.219992:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1085 00000100:00100000:2.0:1784094268.220004:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58469:x1870757013878144:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784094268.220024:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094268.220045:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e14 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220165:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220179:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220192:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220204:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220211:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220218:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784094268.220300:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784094268.220712:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220726:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220733:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094268.220821:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:2.0:1784094268.220826:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094268.220911:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220924:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220931:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220938:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220945:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094268.220949:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220957:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220969:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784094268.220973:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094268.220978:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220988:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.220999:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221005:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221011:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221017:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094268.221020:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221027:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221035:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff90721a781700) 00010000:00010000:2.0:1784094268.221038:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094268.221041:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221047:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc43e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221086:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e14 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221104:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e14 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094268.221112:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784094268.221115:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094268.221117:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784094268.221188:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:58469:x1870757013878144:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1186us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094268.221197:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1085 00000100:00100000:3.0:1784094268.393569:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024360576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094268.393649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094268.393707:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360576 00000100:00100000:2.0:1784094268.393715:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360576 00000100:00100000:2.0:1784094268.393778:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1784094268.393790:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024360576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094268.393828:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094268.393835:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024360832:0@lo:400:kworker.0 00000100:00100000:1.0:1784094268.393873:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094268.393884:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024360576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094268.393893:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1784094268.393896:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784094268.393903:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024360704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094268.393933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094268.393934:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360832 00000100:00100000:2.0:1784094268.393940:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360832 00000100:00100000:1.0:1784094268.393961:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024361216:0@lo:400:kworker.0 00000100:00100000:2.0:1784094268.393974:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1784094268.393983:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024360832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094268.393989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094268.394033:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024360832:12345-0@lo:400:kworker.0 Request processed in 52us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094268.394034:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361216 00000100:00100000:1.0:1784094268.394040:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361216 00000100:00100000:2.0:1784094268.394045:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:3.0:1784094268.394095:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094268.394101:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094268.394122:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024360960:0@lo:400:kworker.0 00000100:00100000:3.0:1784094268.394125:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024361088:0@lo:400:kworker.0 00000100:00100000:0.0:1784094268.394166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094268.394172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094268.394303:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360960 00000100:00100000:2.0:1784094268.394311:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360960 00000100:00100000:2.0:1784094268.394347:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1784094268.394354:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024361216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094268.394389:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024361216:12345-0@lo:400:kworker.0 Request processed in 36us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094268.394395:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1784094268.394418:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1784094268.394443:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024360960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094268.394475:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024360960:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094268.394481:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1784094268.394523:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024360960:0@lo:400:kworker.0 00000100:00080000:2.0:1784094268.394549:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094268.394730:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024360704 00000100:00100000:0.0:1784094268.394735:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024360704 00000100:00100000:0.0:1784094268.394772:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1784094268.394779:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024360704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094268.394812:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024360704:12345-0@lo:400:kworker.0 Request processed in 34us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094268.394819:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1784094268.394852:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024360704:0@lo:400:kworker.0 00000100:00100000:0.0:1784094268.394863:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024361216:0@lo:400:kworker.0 00000100:00100000:0.0:1784094268.394873:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024360832:0@lo:400:kworker.0 00000100:00100000:3.0:1784094268.396582:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024360576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094268.396646:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361088 00000100:00100000:2.0:1784094268.396654:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361088 00000100:00080000:3.0:1784094268.396827:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094268.396830:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1784094268.396841:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024361088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094268.396915:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024361088:12345-0@lo:400:kworker.0 Request processed in 76us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094268.396922:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1784094268.396963:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024361088:0@lo:400:kworker.0 00010000:00010000:3.0:1784094268.906080:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784094268.948614:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00000001:00080000:1.0:1784094268.948630:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00000020:00000080:1.0:1784094269.200816:0:98494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff86c70f00 20000000:00000080:1.0:1784094269.200830:0:98494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a5ec00 uarg=0000000000000000 00010000:00010000:1.0:1784094269.201001:0:98494:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094269.201059:0:98494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff90721a781200) 00010000:00010000:1.0:1784094269.201062:0:98494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094269.201070:0:98494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e14 expref: 5 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.201088:0:98494:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094269.201099:0:98494:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094269.201109:0:98494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.201118:0:98494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc422 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.201124:0:98494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.201152:0:98494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc422 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.201162:0:98494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc422 expref: 18 pid: 5771 timeout: 1580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094269.201186:0:98494:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98494:1870757024361344:0@lo:104: 00000100:00100000:1.0:1784094269.201236:0:98494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094269.201555:0:98494:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094269.201931:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361344 00000100:00100000:0.0:1784094269.201939:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361344 00000100:00100000:0.0:1784094269.201993:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784094269.202004:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:98494:x1870757024361344:12345-0@lo:104: 00010000:00010000:0.0:1784094269.202018:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094269.202087:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094269.202093:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:98494:x1870757024361344:12345-0@lo:104: Request processed in 92us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094269.202100:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1784094269.202257:0:98494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f6ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98494:1870757024361344:0@lo:104: 00010000:00010000:1.0:1784094269.202275:0:98494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094269.202465:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094269.202474:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094269.202484:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094269.202488:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094269.202508:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094269.202516:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094269.202522:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094269.202565:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094269.202572:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784094269.202635:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024361472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094269.202677:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784094269.202806:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094269.202815:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc422 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc429 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094269.202831:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094269.202833:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094269.202834:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094269.202912:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361472 00000100:00100000:2.0:1784094269.202917:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361472 00010000:00010000:2.0:1784094269.202939:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc422 expref: 19 pid: 5771 timeout: 1580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094269.202969:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1784094269.202978:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024361472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094269.202989:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094269.202995:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc422 expref: 19 pid: 5771 timeout: 1580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203008:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc422 expref: 19 pid: 5771 timeout: 1580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203022:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40a00/0x9ce98053214cc429 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc422 expref: 19 pid: 5771 timeout: 1580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203038:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203046:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203061:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203068:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203075:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203081:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203087:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094269.203091:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203098:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203124:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094269.203130:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094269.203163:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024361472:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094269.203169:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:1.0:1784094269.203215:0:98494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.203221:0:98494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094269.203225:0:98494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214cc44c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094269.203338:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024361472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094269.931298:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094270.250699:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094270.250709:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094270.250714:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094270.250937:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.251005:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.251084:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094270.251113:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024361600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094270.251180:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094270.251234:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210964180 going to sleep for 11 seconds 00000100:00100000:2.0:1784094270.253550:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361600 00000100:00100000:2.0:1784094270.253563:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361600 00000100:00100000:2.0:1784094270.253618:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1784094270.253627:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024361600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094270.253644:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094270.253662:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc453 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094270.253689:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc453 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094270.253702:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc453 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094270.253711:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784094270.253785:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024361600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094270.253793:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1784094270.257541:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024361600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094270.257568:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.257581:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094270.257603:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094270.257608:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.257615:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094270.442038:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024361728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094270.442159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094270.442298:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361728 00000100:00100000:0.0:1784094270.442307:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361728 00000100:00100000:0.0:1784094270.442392:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1784094270.442402:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024361728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094270.442464:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094270.442583:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024361728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094270.442591:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00080000:0.0:1784094270.442632:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094270.442801:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:1.0:1784094270.442806:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9071026bd880, transno 4294967365 00000100:00100000:1.0:1784094270.442835:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024361728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094270.787458:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094270.788306:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878272 00000100:00100000:1.0:1784094270.788317:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878272 00000100:00080000:0.0:1784094270.788388:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094270.788395:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1086 00000100:00100000:1.0:1784094270.788407:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58555:x1870757013878272:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094270.788580:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094270.788706:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e1b expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.788787:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.788801:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.788815:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094270.789009:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1784094270.789111:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094270.789228:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.789255:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e1b expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.789276:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e1b expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094270.789284:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784094270.789287:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094270.789289:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12c00, rc 0) 00000100:00100000:1.0:1784094270.789355:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:58555:x1870757013878272:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 950us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094270.789374:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1086 00000100:00100000:2.0:1784094270.793270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094270.793550:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878528 00000100:00100000:3.0:1784094270.793561:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878528 00000100:00100000:3.0:1784094270.793610:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1087 00000100:00100000:3.0:1784094270.793620:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:58555:x1870757013878528:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094270.793667:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094270.793693:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e1b expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094270.793707:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc445) 00010000:00010000:3.0:1784094270.793711:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12400) 00010000:00010000:3.0:1784094270.793720:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094270.793742:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094270.793754:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094270.793768:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094270.794310:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000001419b8a reply state 00000000e17361ce transno 4294967713 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094270.794322:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094270.794400:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000100:00100000:3.0:1784094270.794626:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:58555:x1870757013878528:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 1005us (1362us total) trans 4294967713 rc 0/0 00000100:00100000:3.0:1784094270.794633:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1087 00010000:00010000:0.0:1784094270.800612:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.800628:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.800636:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.800643:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094270.800648:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.800656:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.800676:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fcea00) 00010000:00010000:0.0:1784094270.800679:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094270.800684:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.800691:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc46f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094270.954488:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094271.239294:0:98689:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefe1e5b90 20000000:00000080:1.0:1784094271.239312:0:98689:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a5cc00 uarg=0000000000000000 00010000:00010000:1.0:1784094271.239637:0:98689:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094271.239652:0:98689:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094271.239663:0:98689:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094271.239681:0:98689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.239696:0:98689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc453 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.239706:0:98689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.239743:0:98689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc453 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.239759:0:98689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc453 expref: 18 pid: 5772 timeout: 1582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094271.239773:0:98689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98689:1870757024361856:0@lo:104: 00000100:00100000:1.0:1784094271.239832:0:98689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094271.239885:0:98689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5840 going to sleep for 11 seconds 00000100:00100000:2.0:1784094271.239900:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361856 00000100:00100000:2.0:1784094271.239909:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361856 00000100:00100000:2.0:1784094271.239959:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784094271.239969:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:98689:x1870757024361856:12345-0@lo:104: 00010000:00010000:2.0:1784094271.239983:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094271.240051:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094271.240057:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:98689:x1870757024361856:12345-0@lo:104: Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094271.240064:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00010000:3.0:1784094271.240273:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094271.240280:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094271.240288:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094271.240292:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094271.240302:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094271.240314:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094271.240321:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094271.240370:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094271.240381:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094271.240411:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094271.240444:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76000/0x9ce98053214cc453 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc45a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094271.240461:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094271.240463:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094271.240465:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094271.240467:0:98689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98689:1870757024361856:0@lo:104: 00000100:00100000:3.0:1784094271.240475:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1784094271.240487:0:98689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094271.240489:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024361984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094271.240530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094271.240707:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024361984 00000100:00100000:1.0:1784094271.240712:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024361984 00010000:00010000:1.0:1784094271.240732:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc453 expref: 19 pid: 5772 timeout: 1582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094271.240760:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784094271.240767:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024361984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094271.240777:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094271.240781:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc453 expref: 19 pid: 5772 timeout: 1582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240791:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc453 expref: 19 pid: 5772 timeout: 1582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240804:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cc45a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc453 expref: 19 pid: 5772 timeout: 1582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240818:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240827:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240839:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240846:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240853:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240860:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240865:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094271.240869:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240875:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240891:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094271.240900:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094271.240914:0:98689:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094271.240924:0:98689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094271.240929:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024361984:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (397us total) trans 0 rc 0/0 00010000:00010000:2.0:1784094271.240939:0:98689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12800/0x9ce98053214cc476 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094271.240943:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784094271.240989:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024361984:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1784094271.489342:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00010000:00010000:2.0:1784094271.982497:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094272.617572:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094272.617581:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094272.617586:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094272.617634:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.617651:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.617662:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094272.617686:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024362112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094272.617753:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094272.617906:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28780 going to sleep for 11 seconds 00000100:00100000:2.0:1784094272.618087:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362112 00000100:00100000:2.0:1784094272.618095:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362112 00000100:00100000:2.0:1784094272.618191:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1784094272.618201:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024362112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094272.618215:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094272.618228:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc47d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.618250:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc47d expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.618280:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc47d expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.618289:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41000, rc 0) 00000100:00100000:2.0:1784094272.618349:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024362112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.618356:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1784094272.618469:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024362112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094272.618484:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.618493:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094272.618510:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094272.618515:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.618523:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094272.827270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094272.827467:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878656 00000100:00100000:1.0:1784094272.827478:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878656 00000100:00100000:1.0:1784094272.827542:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1088 00000100:00100000:1.0:1784094272.827552:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013878656:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094272.827667:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013878656:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 116us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094272.827674:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1088 00000100:00080000:0.0:1784094272.827890:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094272.830520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.830771:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878784 00000100:00100000:2.0:1784094272.830782:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878784 00000100:00100000:2.0:1784094272.830855:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 551 00000100:00100000:2.0:1784094272.830865:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013878784:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:0.0:1784094272.831050:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094272.831717:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013878784:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 851us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.831735:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 551 00000100:00100000:3.0:1784094272.835648:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.835837:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013878912 00000100:00100000:2.0:1784094272.835847:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013878912 00000100:00100000:2.0:1784094272.835940:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00100000:2.0:1784094272.835951:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013878912:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094272.836266:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013878912:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 318us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.836273:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 552 00000100:00080000:0.0:1784094272.838404:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094272.841716:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094272.841942:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879040 00000100:00100000:1.0:1784094272.841956:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879040 00000100:00100000:1.0:1784094272.842079:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1089 00000100:00100000:1.0:1784094272.842101:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879040:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094272.843070:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879040:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 974us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094272.843082:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1089 00000100:00100000:1.0:1784094272.846562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.847088:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879168 00000100:00100000:2.0:1784094272.847103:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879168 00000100:00100000:2.0:1784094272.847736:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1090 00000100:00100000:2.0:1784094272.847777:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879168:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094272.847953:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879168:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 204us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.847963:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1090 00000100:00100000:2.0:1784094272.851056:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094272.851251:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879296 00000100:00100000:0.0:1784094272.851263:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879296 00000100:00100000:3.0:1784094272.851411:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 553 00000100:00100000:3.0:1784094272.851447:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879296:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094272.851769:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879296:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 348us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094272.851851:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 553 00000100:00100000:3.0:1784094272.855090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.855385:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879424 00000100:00100000:2.0:1784094272.855502:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879424 00000100:00100000:2.0:1784094272.855626:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 554 00000100:00100000:2.0:1784094272.855638:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879424:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094272.856067:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879424:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 430us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.856075:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 554 00000100:00100000:1.0:1784094272.859191:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.859255:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879552 00000100:00100000:2.0:1784094272.859264:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879552 00000100:00100000:2.0:1784094272.859313:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1091 00000100:00100000:2.0:1784094272.859334:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879552:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094272.859864:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:58640:x1870757013879552:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 541us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.859873:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1091 00000100:00100000:3.0:1784094272.889680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.889942:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879680 00000100:00100000:2.0:1784094272.889952:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879680 00000100:00100000:2.0:1784094272.890012:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:2.0:1784094272.890022:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013879680:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094272.890100:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013879680:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.890108:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:3.0:1784094272.899125:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094272.899260:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013879808 00000100:00100000:1.0:1784094272.899272:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013879808 00000100:00100000:1.0:1784094272.899352:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1092 00000100:00100000:1.0:1784094272.899364:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58644:x1870757013879808:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784094272.899385:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094272.899410:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc48b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e22 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.899510:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.899526:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.899541:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.899568:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.899576:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.899583:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900011:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc4a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900021:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900028:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094272.900108:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:1.0:1784094272.900112:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094272.900188:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900201:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900208:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900214:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900220:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094272.900224:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900231:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900242:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784094272.900245:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094272.900250:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900260:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900271:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900276:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900281:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900286:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094272.900289:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900295:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900302:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907219c12400) 00010000:00010000:1.0:1784094272.900304:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094272.900307:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900312:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc499 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900353:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc48b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e22 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900368:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e22 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094272.900376:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12c00) 00010000:00010000:1.0:1784094272.900378:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094272.900380:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784094272.900676:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:58644:x1870757013879808:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1313us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094272.900684:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1092 00000100:00100000:1.0:1784094272.903777:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.904049:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880064 00000100:00100000:2.0:1784094272.904059:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880064 00000100:00100000:2.0:1784094272.904927:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1093 00000100:00100000:2.0:1784094272.904938:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:58644:x1870757013880064:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784094272.904957:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094272.904977:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc4a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e29 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.905312:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.905338:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.905350:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.905365:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.905372:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.905378:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094272.906268:0:5777:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1784094272.907874:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc4bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907893:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907904:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907942:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907949:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907956:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907963:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094272.907967:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907975:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.907988:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12c00) 00010000:00010000:2.0:1784094272.907991:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094272.907995:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.908001:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc4ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094272.908014:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004fe641bd reply state 00000000d8ceaf86 transno 4294967714 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094272.908023:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094272.908057:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc4a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e29 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.908071:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e29 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.908079:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784094272.908081:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094272.908084:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094272.908254:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:58644:x1870757013880064:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 3317us (4486us total) trans 4294967714 rc 0/0 00000100:00100000:2.0:1784094272.908264:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1093 00010000:00010000:0.0:1784094272.909828:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.909842:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.909848:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.909854:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094272.909858:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.909865:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.909877:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff90721a781c00) 00010000:00010000:0.0:1784094272.909880:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094272.909883:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094272.909889:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc4b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094272.918729:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.919139:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880192 00000100:00100000:2.0:1784094272.919150:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880192 00000100:00100000:2.0:1784094272.919214:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 555 00000100:00100000:2.0:1784094272.919224:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:58644:x1870757013880192:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784094272.919242:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094272.919264:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e30 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094272.919291:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784094272.919311:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1433s v=(0 0) 00010000:00010000:2.0:1784094272.919315:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094272.919339:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.919364:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094272.919376:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784094272.919513:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:58644:x1870757013880192:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 289us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.919520:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 555 00000100:00100000:2.0:1784094272.945589:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094272.945686:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880320 00000100:00100000:3.0:1784094272.945697:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880320 00002000:00100000:3.0:1784094272.945748:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff907237f5dc00 x1870757013880320/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:593/0 lens 488/0 e 0 to 0 dl 1784094283 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1784094272.945766:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907237f5dc00 with x1870757013880320 ext(0->1048575) 00002000:00010000:3.0:1784094272.945773:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907237f5dc00 00000100:00100000:3.0:1784094272.945807:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 27 00000100:00100000:3.0:1784094272.945817:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013880320:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:0.0:1784094272.967991:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013880320:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 22165us (22400us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784094272.968005:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 27 00002000:00100000:0.0:1784094272.968017:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff907237f5dc00 x1870757013880320/t4294967364(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:593/0 lens 488/448 e 0 to 0 dl 1784094283 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1784094272.968028:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907237f5dc00 with x1870757013880320 ext(0->1048575) 00002000:00010000:0.0:1784094272.968036:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907237f5dc00 00000100:00100000:1.0:1784094272.969971:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094272.970052:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880448 00000100:00100000:2.0:1784094272.970059:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880448 00000100:00100000:2.0:1784094272.970138:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1094 00000100:00100000:2.0:1784094272.970148:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:58644:x1870757013880448:12345-192.168.204.57@tcp:44:dd.60003 00000100:00100000:2.0:1784094272.990556:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:58644:x1870757013880448:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 20399us (20581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094272.990568:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1094 00000001:00080000:3.0:1784094272.990991:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967714 is committed 00000100:00100000:2.0:1784094272.993336:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094272.993476:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880576 00000100:00100000:3.0:1784094272.993485:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880576 00000100:00100000:3.0:1784094272.993543:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 556 00000100:00100000:3.0:1784094272.993559:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2354:x1870757013880576:12345-192.168.204.57@tcp:16:dd.60003 00010000:00010000:3.0:1784094273.002993:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094273.019942:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00000100:00100000:2.0:1784094273.020226:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013880576:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 26663us (26903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094273.020236:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 556 00000100:00100000:0.0:1784094273.022713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094273.022811:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880832 00000100:00100000:2.0:1784094273.022821:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880832 00000100:00100000:2.0:1784094273.022918:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 111 00000100:00100000:2.0:1784094273.022930:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:58644:x1870757013880832:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:2.0:1784094273.023362:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:58644:x1870757013880832:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 432us (654us total) trans 4294967715 rc 0/0 00000100:00100000:2.0:1784094273.023371:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 111 00000100:00100000:3.0:1784094273.515558:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024362240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094273.515654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094273.515748:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362240 00000100:00100000:3.0:1784094273.515758:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362240 00000100:00100000:3.0:1784094273.515893:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1784094273.515904:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024362240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094273.515935:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784094273.515990:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024362240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094273.515999:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00080000:3.0:1784094273.516025:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094273.516084:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024362240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094273.517124:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024362496:0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094273.517219:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094273.517226:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024362624:0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094273.517287:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362496 00000100:00100000:0.0:1784094273.517295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362496 00000100:00100000:0.0:1784094273.517345:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362624 00000100:00100000:0.0:1784094273.517349:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362624 00000100:00100000:0.0:1784094273.517469:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1784094273.517478:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024362496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517521:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024362496:12345-0@lo:400:kworker.0 Request processed in 45us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094273.517527:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024362368:0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517528:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1784094273.517541:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1784094273.517546:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024362624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517584:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024362624:12345-0@lo:400:kworker.0 Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094273.517586:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094273.517591:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1784094273.517622:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024362624:0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517634:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024362496:0@lo:400:kworker.0 00000100:00100000:3.0:1784094273.517635:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024362880:0@lo:400:kworker.0 00000100:00100000:3.0:1784094273.517665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094273.517692:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094273.517698:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362880 00000100:00100000:3.0:1784094273.517701:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024362752:0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517702:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362880 00000100:00100000:0.0:1784094273.517727:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1784094273.517733:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094273.517739:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094273.517775:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362368 00000100:00100000:3.0:1784094273.517779:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362368 00000100:00100000:3.0:1784094273.517813:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1784094273.517822:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024362368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094273.517833:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024362880:12345-0@lo:400:kworker.0 Request processed in 98us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094273.517841:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1784094273.517863:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024362368:12345-0@lo:400:kworker.0 Request processed in 40us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094273.517870:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1784094273.517903:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024362752 00000100:00100000:3.0:1784094273.517907:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024362752 00000100:00100000:3.0:1784094273.517949:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1784094273.517956:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094273.517991:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072373e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024362752:12345-0@lo:400:kworker.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094273.517998:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00080000:3.0:1784094273.518021:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094273.518026:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094273.518044:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024362752:0@lo:400:kworker.0 00000100:00100000:3.0:1784094273.518054:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024362368:0@lo:400:kworker.0 00000100:00100000:3.0:1784094273.518064:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024362880:0@lo:400:kworker.0 00000001:00080000:3.0:1784094273.737516:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967715 is committed 00010000:00010000:0.0:1784094274.025690:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784094274.388386:0:98937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1435465961014ns, next at 1427400394518ns, rc = 0 00000004:00080000:1.0:1784094274.388526:0:98937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1435466103129ns, next at 1400195939038ns, rc = 0 00000004:00080000:3.0:1784094274.392119:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00000004:00080000:3.0:1784094274.392140:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00010000:00010000:1.0:1784094275.050180:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094275.122095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094275.122146:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013880960 00000100:00100000:0.0:1784094275.122158:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013880960 00000100:00080000:1.0:1784094275.122222:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094275.122292:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1095 00000100:00100000:0.0:1784094275.122304:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013880960:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094275.122418:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013880960:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094275.122450:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1095 00000100:00100000:1.0:1784094275.124136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094275.124171:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881088 00000100:00100000:1.0:1784094275.124179:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881088 00000100:00100000:1.0:1784094275.124228:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 557 00000100:00100000:1.0:1784094275.124239:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58836:x1870757013881088:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094275.124646:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:58836:x1870757013881088:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 407us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094275.124654:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 557 00000100:00080000:1.0:1784094275.124679:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094275.126330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094275.126663:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881216 00000100:00100000:2.0:1784094275.126676:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881216 00000100:00100000:3.0:1784094275.126795:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 558 00000100:00100000:3.0:1784094275.126807:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:58836:x1870757013881216:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:0.0:1784094275.126972:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094275.127249:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:58836:x1870757013881216:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 444us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094275.127258:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 558 00000100:00100000:2.0:1784094275.128904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094275.129009:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881344 00000100:00100000:0.0:1784094275.129018:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881344 00000100:00100000:0.0:1784094275.129066:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1096 00000100:00100000:0.0:1784094275.129076:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013881344:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094275.129882:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013881344:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 804us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094275.129891:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1096 00000100:00100000:0.0:1784094275.135237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094275.135297:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881472 00000100:00100000:1.0:1784094275.135308:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881472 00000100:00100000:1.0:1784094275.135368:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1097 00000100:00100000:1.0:1784094275.135379:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013881472:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094275.135497:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013881472:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094275.135506:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1097 00000100:00100000:2.0:1784094275.141540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094275.141653:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881600 00000100:00100000:3.0:1784094275.141664:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881600 00000100:00100000:3.0:1784094275.141748:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 559 00000100:00100000:3.0:1784094275.141759:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58836:x1870757013881600:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094275.142106:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:58836:x1870757013881600:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 348us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094275.142115:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 559 00000100:00100000:2.0:1784094275.144124:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094275.144175:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881728 00000100:00100000:3.0:1784094275.144184:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881728 00000100:00100000:3.0:1784094275.144314:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:3.0:1784094275.144325:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:58836:x1870757013881728:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094275.145198:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:58836:x1870757013881728:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 874us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094275.145208:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 560 00000100:00100000:0.0:1784094275.148761:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094275.148849:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013881856 00000100:00100000:3.0:1784094275.148954:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013881856 00000100:00100000:3.0:1784094275.149004:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1098 00000100:00100000:3.0:1784094275.149014:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013881856:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094275.149523:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:58836:x1870757013881856:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 509us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094275.149531:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1098 00000100:00100000:2.0:1784094275.187379:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094275.187525:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882112 00000100:00100000:0.0:1784094275.187536:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882112 00000100:00100000:0.0:1784094275.187589:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1099 00000100:00100000:0.0:1784094275.187599:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:58840:x1870757013882112:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784094275.187658:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094275.187685:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc4bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e29 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.187704:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff90721a781f00) 00010000:00010000:0.0:1784094275.187714:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094275.187786:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.187801:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.187811:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.187825:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.187832:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.187839:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.188193:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.188203:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.188209:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094275.189043:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10368 00000004:00080000:0.0:1784094275.189054:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1436266631616ns, next at 1437266628738ns, rc = 0 00010000:00010000:0.0:1784094275.189147:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189157:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189166:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189174:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189186:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189192:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189208:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094275.189220:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094275.189227:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189228:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189235:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189240:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189243:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094275.189245:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094275.189247:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189249:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189255:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189255:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189263:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094275.189266:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094275.189270:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189271:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff907202e6b200) 00010000:00010000:2.0:1784094275.189273:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784094275.189287:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc4df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189289:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189295:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc4e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189302:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189307:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094275.189308:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094275.189309:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094275.189311:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094275.189314:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189319:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094275.189322:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189328:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189336:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12c00) 00010000:00010000:0.0:1784094275.189339:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094275.189342:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.189347:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc4d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094275.189357:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005a6a2abf reply state 000000002f6a1dca transno 4294967716 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094275.189365:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094275.189471:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:58840:x1870757013882112:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1871us (2100us total) trans 4294967716 rc 0/0 00000100:00100000:0.0:1784094275.189480:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1099 00010000:00010000:0.0:1784094275.190898:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.190911:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.190918:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.190923:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094275.190928:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.190935:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.190946:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff907202e6ba00) 00010000:00010000:0.0:1784094275.190949:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094275.190953:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094275.190961:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc4d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094275.562561:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024363008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094275.562636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094275.562742:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363008 00000100:00100000:0.0:1784094275.562751:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363008 00000100:00100000:0.0:1784094275.562814:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1784094275.562822:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024363008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094275.562856:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094275.562904:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024363008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094275.562912:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00080000:2.0:1784094275.562960:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094275.562998:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024363008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094276.074880:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784094276.367097:0:99081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1437444672041ns, next at 1427400394518ns, rc = 0 00000004:00080000:3.0:1784094276.367238:0:99081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1437444815768ns, next at 1437266628738ns, rc = 0 00000001:00080000:3.0:1784094276.391230:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967716 is committed 00000004:00080000:3.0:1784094276.391243:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00000004:00080000:3.0:1784094276.391309:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00000004:00080000:3.0:1784094276.391343:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00000100:00100000:0.0:1784094276.391480:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094276.391510:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024363136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784094276.391958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094276.392212:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363136 00000100:00100000:3.0:1784094276.392220:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363136 00000100:00100000:3.0:1784094276.392333:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784094276.392344:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024363136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784094276.392377:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:3.0:1784094276.392410:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784094276.392488:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784094276.392527:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.392537:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784094276.392541:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094276.392546:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.392580:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 5 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.392594:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 5 pid: 8031 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094276.392608:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024363264:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094276.392710:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072103d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094276.396838:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094276.396983:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882240 00000100:00100000:0.0:1784094276.396993:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882240 00010000:00010000:0.0:1784094276.397034:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 6 pid: 8031 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094276.397083:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 350 00000100:00100000:0.0:1784094276.397093:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013882240:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094276.397108:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094276.397114:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 6 pid: 8031 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094276.397120:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6574:1870757024363264:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094276.397126:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 6 pid: 8031 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094276.397207:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e6fe6c/0x9ce98053214cc4ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e30 expref: 6 pid: 8031 timeout: 1537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094276.399024:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094276.399034:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094276.399042:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094276.399055:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094276.399088:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094276.399204:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.399217:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.399225:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.399236:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.399244:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094276.399283:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784094276.399967:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013882240:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 2869us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094276.399980:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 350 00000100:00100000:3.0:1784094276.400018:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024363136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7675us (8058us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1784094276.400032:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000004:00080000:0.0:1784094276.400054:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907210e27480/2, rc 0, transno 4294967365 00000100:00100000:0.0:1784094276.400069:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024363136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784094276.400715:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094276.400724:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094276.400735:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094276.400739:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094276.400749:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094276.400767:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094276.400774:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214cc4ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094276.400793:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094276.400794:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094276.400796:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094277.099037:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094278.009417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094278.009651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094278.009697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094278.009745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094278.009782:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882624 00000100:00100000:2.0:1784094278.009805:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882624 00000100:00100000:2.0:1784094278.009877:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882752 00000100:00100000:2.0:1784094278.009881:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882752 00000100:00100000:2.0:1784094278.009913:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:2.0:1784094278.009925:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013882624:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094278.010071:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882496 00000100:00100000:1.0:1784094278.010077:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882496 00000100:00100000:1.0:1784094278.010140:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 991 00000100:00100000:1.0:1784094278.010149:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013882496:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094278.010181:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013882624:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 236us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094278.010208:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 757 00000100:00100000:1.0:1784094278.010220:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013882496:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 70us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094278.010241:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 991 00000100:00100000:2.0:1784094278.010264:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 758 00000100:00100000:2.0:1784094278.010281:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013882752:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094278.010319:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013882752:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094278.010325:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 758 00000100:00080000:2.0:1784094278.010354:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094278.010360:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094278.010363:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094278.012479:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882368 00000100:00100000:0.0:1784094278.012495:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882368 00000100:00100000:0.0:1784094278.012571:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 908 00000100:00100000:0.0:1784094278.012581:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013882368:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094278.012655:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013882368:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 76us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094278.012662:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 908 00010000:00010000:3.0:1784094278.121720:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094278.633674:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024363392:0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.633735:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024363520:0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.633753:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094278.633773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094278.633809:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024364032:0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.633809:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024363904:0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.633837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094278.633839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094278.633876:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024363648:0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.633883:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024363776:0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.633905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094278.633909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094278.633941:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363520 00000100:00100000:0.0:1784094278.633941:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363392 00000100:00100000:3.0:1784094278.633948:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363520 00000100:00100000:0.0:1784094278.633948:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363392 00000100:00100000:3.0:1784094278.633988:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363904 00000100:00100000:3.0:1784094278.633991:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363904 00000100:00100000:0.0:1784094278.633991:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1784094278.634001:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024363392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634019:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363648 00000100:00100000:3.0:1784094278.634023:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363648 00000100:00100000:3.0:1784094278.634041:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1784094278.634046:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024363520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.634049:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024363392:12345-0@lo:400:kworker.0 Request processed in 51us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094278.634056:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1784094278.634084:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024363520:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094278.634088:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1784094278.634092:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1784094278.634094:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024363904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634103:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1784094278.634109:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024363648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.634120:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024363904:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094278.634126:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1784094278.634149:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024363648:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094278.634155:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1784094278.634167:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024363648:0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634176:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364032 00000100:00100000:3.0:1784094278.634179:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364032 00000100:00100000:0.0:1784094278.634192:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024363904:0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634205:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024363776 00000100:00100000:3.0:1784094278.634208:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024363776 00000100:00100000:0.0:1784094278.634209:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024363392:0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634254:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1784094278.634271:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024364032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634382:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024364032:12345-0@lo:400:kworker.0 Request processed in 45us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094278.634390:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1784094278.634406:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1784094278.634414:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024363776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094278.634468:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024363776:12345-0@lo:400:kworker.0 Request processed in 55us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094278.634474:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00080000:2.0:1784094278.634484:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094278.634489:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094278.634493:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094278.634529:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024363776:0@lo:400:kworker.0 00000100:00100000:2.0:1784094278.634542:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024363520:0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.634547:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094278.634560:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024364032:0@lo:400:kworker.0 00000100:00100000:0.0:1784094278.634616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094278.634759:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364160 00000100:00100000:3.0:1784094278.634762:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364160 00000100:00100000:3.0:1784094278.634786:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1784094278.634794:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024364160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094278.634822:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784094278.634861:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024364160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094278.634867:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1784094278.634883:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024364160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784094279.145679:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094280.172851:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094280.220376:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00000100:00100000:3.0:1784094280.682295:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094280.682367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094280.682597:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364288 00000100:00100000:2.0:1784094280.682605:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364288 00000100:00100000:2.0:1784094280.682703:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1784094280.682714:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024364288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094280.682750:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094280.682839:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024364288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094280.682846:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00080000:0.0:1784094280.682885:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094280.683011:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024364288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094281.193732:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094282.217714:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094283.128683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094283.128747:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883008 00000100:00100000:2.0:1784094283.128755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094283.128761:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883008 00000100:00100000:0.0:1784094283.128785:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013882880 00000100:00100000:0.0:1784094283.128792:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013882880 00000100:00100000:2.0:1784094283.128806:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094283.128856:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 910 00000100:00100000:2.0:1784094283.128857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094283.128857:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 995 00000100:00100000:0.0:1784094283.128875:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013882880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094283.128876:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013883008:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094283.128894:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883264 00000100:00100000:2.0:1784094283.128900:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883264 00000100:00100000:2.0:1784094283.128935:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883136 00000100:00100000:2.0:1784094283.128938:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883136 00000100:00100000:2.0:1784094283.128967:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:2.0:1784094283.128977:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013883264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094283.128992:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013882880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094283.128993:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013883008:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094283.129016:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 910 00000100:00100000:1.0:1784094283.129017:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 995 00000100:00100000:2.0:1784094283.129019:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013883264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094283.129029:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 761 00000100:00100000:3.0:1784094283.129038:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 762 00000100:00100000:3.0:1784094283.129053:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013883136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:1.0:1784094283.129053:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094283.129061:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094283.129066:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094283.129095:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013883136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094283.129104:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 762 00010000:00010000:3.0:1784094283.241771:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094283.755322:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024364416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094283.755390:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024364544:0@lo:400:kworker.0 00000100:00100000:1.0:1784094283.755398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094283.755458:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094283.755529:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364544 00000100:00100000:2.0:1784094283.755535:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364544 00000100:00100000:2.0:1784094283.755577:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1784094283.755590:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024364544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094283.755629:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024364544:12345-0@lo:400:kworker.0 Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094283.755634:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1784094283.755669:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024364544:0@lo:400:kworker.0 00000100:00100000:2.0:1784094283.755694:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364416 00000100:00100000:2.0:1784094283.755697:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364416 00000100:00100000:2.0:1784094283.755728:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1784094283.755735:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024364416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094283.755760:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784094283.755837:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094283.755878:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024364800:0@lo:400:kworker.0 00000100:00100000:0.0:1784094283.755911:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024364672:0@lo:400:kworker.0 00000100:00100000:3.0:1784094283.755923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094283.755952:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094283.755954:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364800 00000100:00100000:3.0:1784094283.755957:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364800 00000100:00100000:3.0:1784094283.755986:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364672 00000100:00100000:3.0:1784094283.755988:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364672 00000100:00100000:3.0:1784094283.756005:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1784094283.756012:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1784094283.756013:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024364800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094283.756024:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024364672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094283.756059:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024364800:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094283.756067:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1784094283.756074:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024364672:12345-0@lo:400:kworker.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094283.756081:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:3.0:1784094283.756084:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094283.756103:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024364800:0@lo:400:kworker.0 00000100:00100000:0.0:1784094283.756135:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024364672:0@lo:400:kworker.0 00000100:00100000:3.0:1784094283.756142:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024365056:0@lo:400:kworker.0 00000100:00100000:3.0:1784094283.756164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094283.756181:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094283.756185:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024364928:0@lo:400:kworker.0 00000100:00100000:3.0:1784094283.756198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094283.756309:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024364416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 574us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094283.756315:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1784094283.756343:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365056 00000100:00100000:2.0:1784094283.756346:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365056 00000100:00100000:2.0:1784094283.756382:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1784094283.756389:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024365056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094283.756408:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:1.0:1784094283.756414:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907210e27480, transno 4294967365 00000100:00100000:1.0:1784094283.756442:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024364416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094283.756443:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024365056:12345-0@lo:400:kworker.0 Request processed in 55us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094283.756449:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1784094283.756471:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024365056:0@lo:400:kworker.0 00000100:00080000:3.0:1784094283.756524:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094283.758131:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024364928 00000100:00100000:0.0:1784094283.758140:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024364928 00000100:00100000:0.0:1784094283.758212:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1784094283.758222:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024364928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094283.758294:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024364928:12345-0@lo:400:kworker.0 Request processed in 73us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094283.758302:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:1.0:1784094283.758348:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024364928:0@lo:400:kworker.0 00000100:00080000:3.0:1784094283.758382:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094284.266009:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094285.289707:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094285.802675:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094285.802702:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024365184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094285.802773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094285.804728:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365184 00000100:00100000:0.0:1784094285.804741:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365184 00000100:00100000:0.0:1784094285.804822:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1784094285.804834:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024365184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094285.804873:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094285.804959:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024365184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094285.804966:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1784094285.805019:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024365184:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094285.805038:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094286.314001:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094287.339324:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094288.249858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094288.249921:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094288.249981:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883392 00000100:00100000:0.0:1784094288.249994:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883392 00000100:00100000:3.0:1784094288.250021:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883520 00000100:00100000:3.0:1784094288.250028:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883520 00000100:00100000:0.0:1784094288.250075:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 912 00000100:00100000:0.0:1784094288.250090:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013883392:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094288.250107:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 999 00000100:00100000:3.0:1784094288.250119:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013883520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094288.250184:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013883392:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 96us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094288.250192:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 912 00000100:00080000:1.0:1784094288.250201:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094288.250329:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013883520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 212us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094288.250338:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 999 00000100:00100000:0.0:1784094288.255965:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094288.256088:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094288.256348:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883648 00000100:00100000:2.0:1784094288.256362:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883648 00000100:00100000:2.0:1784094288.256502:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883776 00000100:00100000:2.0:1784094288.256505:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883776 00000100:00100000:2.0:1784094288.256532:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 764 00000100:00100000:2.0:1784094288.256543:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013883648:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094288.256650:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013883648:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 108us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094288.256659:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 764 00000100:00100000:2.0:1784094288.256676:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00100000:2.0:1784094288.256682:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013883776:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094288.256706:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013883776:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 24us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094288.256712:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 765 00000100:00080000:1.0:1784094288.257144:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094288.257150:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094288.361677:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094288.873639:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094288.873671:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024365696:0@lo:400:kworker.0 00000100:00100000:1.0:1784094288.873671:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024365568:0@lo:400:kworker.0 00000100:00100000:0.0:1784094288.873752:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024365312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094288.873796:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024365824:0@lo:400:kworker.0 00000100:00100000:2.0:1784094288.873856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094288.873919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094288.873927:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024365440:0@lo:400:kworker.0 00000100:00100000:2.0:1784094288.873968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094288.873996:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365696 00000100:00100000:3.0:1784094288.874007:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365696 00000100:00100000:2.0:1784094288.874037:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365440 00000100:00100000:2.0:1784094288.874043:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365440 00000100:00100000:1.0:1784094288.874064:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094288.874098:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024366080:0@lo:400:kworker.0 00000100:00100000:3.0:1784094288.874103:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365568 00000100:00100000:2.0:1784094288.874107:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1784094288.874109:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365568 00000100:00100000:2.0:1784094288.874123:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024365440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094288.874142:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1784094288.874152:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024365696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094288.874184:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024365440:12345-0@lo:400:kworker.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094288.874189:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094288.874197:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1784094288.874209:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024365696:12345-0@lo:400:kworker.0 Request processed in 58us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094288.874218:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1784094288.874236:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1784094288.874244:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024365568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784094288.874264:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094288.874290:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024365696:0@lo:400:kworker.0 00000100:00100000:1.0:1784094288.874483:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024365568:0@lo:400:kworker.0 00000100:00100000:3.0:1784094288.874489:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024365440:0@lo:400:kworker.0 00000100:00100000:1.0:1784094288.874518:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365824 00000100:00100000:1.0:1784094288.874522:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365824 00000100:00100000:3.0:1784094288.874528:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366080 00000100:00100000:3.0:1784094288.874534:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366080 00000100:00100000:1.0:1784094288.874569:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1784094288.874578:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094288.874585:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1784094288.874594:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024366080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094288.874785:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024365568:12345-0@lo:400:kworker.0 Request processed in 541us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094288.874793:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1784094288.874810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094288.874833:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024365824:12345-0@lo:400:kworker.0 Request processed in 255us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094288.874838:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365312 00000100:00100000:1.0:1784094288.874843:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1784094288.874845:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365312 00000100:00100000:0.0:1784094288.874851:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024365952:0@lo:400:kworker.0 00000100:00080000:1.0:1784094288.874866:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094288.874872:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094288.874883:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784094288.874890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094288.874895:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024365312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094288.874902:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024365824:0@lo:400:kworker.0 00000100:00100000:3.0:1784094288.874904:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024366080:12345-0@lo:400:kworker.0 Request processed in 310us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094288.874916:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00002000:00000024:2.0:1784094288.874934:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094288.874953:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024366080:0@lo:400:kworker.0 00000100:00100000:1.0:1784094288.874987:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024365952 00000100:00100000:2.0:1784094288.874988:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024365312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094288.874993:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024365952 00000100:00100000:2.0:1784094288.874999:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1784094288.875011:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024365312:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784094288.875055:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094288.875062:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1784094288.875071:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024365952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094288.875113:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024365952:12345-0@lo:400:kworker.0 Request processed in 44us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094288.875129:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1784094288.875153:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024365952:0@lo:400:kworker.0 00010000:00010000:0.0:1784094289.385641:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094290.410048:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094290.922960:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024366208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094290.923075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094290.923590:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366208 00000100:00100000:2.0:1784094290.923604:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366208 00000100:00100000:2.0:1784094290.923688:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1784094290.923700:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024366208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094290.923750:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094290.923828:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024366208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094290.923836:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1784094290.924662:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024366208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094290.924741:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784094291.434649:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094292.457667:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094293.372100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094293.372142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094293.372175:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094293.372215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094293.372236:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884160 00000100:00100000:3.0:1784094293.372246:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884160 00000100:00080000:0.0:1784094293.372298:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094293.372299:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884288 00000100:00100000:3.0:1784094293.372302:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884288 00000100:00080000:0.0:1784094293.372316:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094293.372327:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 768 00000100:00100000:3.0:1784094293.372335:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013884160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094293.372352:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 769 00000100:00100000:0.0:1784094293.372365:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013884288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094293.372399:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013884160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094293.372406:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013884288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094293.372411:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 768 00000100:00100000:1.0:1784094293.372457:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884032 00000100:00100000:1.0:1784094293.372463:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884032 00000100:00100000:0.0:1784094293.372503:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 769 00000100:00100000:1.0:1784094293.372508:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1003 00000100:00100000:2.0:1784094293.372518:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013883904 00000100:00100000:1.0:1784094293.372520:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013884032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094293.372522:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094293.372526:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013883904 00000100:00100000:2.0:1784094293.372568:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 914 00000100:00100000:1.0:1784094293.372579:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013884032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 60us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094293.372581:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013883904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094293.372594:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1003 00000100:00100000:2.0:1784094293.372623:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013883904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 46us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094293.372632:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 914 00010000:00010000:0.0:1784094293.481589:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094293.993712:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024366336:0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.993774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094293.993829:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366336 00000100:00100000:0.0:1784094293.993836:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366336 00000100:00100000:0.0:1784094293.993878:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1784094293.993886:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024366336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.994111:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024366336:12345-0@lo:400:kworker.0 Request processed in 225us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094293.994119:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1784094293.994172:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024366464:0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.994175:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024366848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094293.994208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094293.994304:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024366592:0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.994360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094293.994367:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024366336:0@lo:400:kworker.0 00000100:00100000:3.0:1784094293.994373:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024366720:0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.994402:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024366976:0@lo:400:kworker.0 00000100:00100000:3.0:1784094293.994406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094293.994442:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366464 00000100:00100000:1.0:1784094293.994447:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366464 00000100:00100000:0.0:1784094293.994465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094293.994493:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094293.994498:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094293.994499:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366976 00000100:00100000:1.0:1784094293.994504:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366976 00000100:00100000:0.0:1784094293.994505:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024367104:0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.994537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094293.994547:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366592 00000100:00100000:1.0:1784094293.994551:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1784094293.994552:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366592 00000100:00100000:1.0:1784094293.994566:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024366464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.994581:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1784094293.994588:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1784094293.994593:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024366976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094293.994600:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024366592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.994620:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024366464:12345-0@lo:400:kworker.0 Request processed in 58us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094293.994627:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1784094293.994647:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024366976:12345-0@lo:400:kworker.0 Request processed in 57us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094293.994654:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024366592:12345-0@lo:400:kworker.0 Request processed in 56us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094293.994656:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366720 00000100:00100000:0.0:1784094293.994661:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:1.0:1784094293.994663:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366720 00000100:00100000:3.0:1784094293.994668:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:0.0:1784094293.994689:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094293.994696:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094293.994706:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024366592:0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.994706:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367104 00000100:00100000:1.0:1784094293.994712:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367104 00000100:00100000:0.0:1784094293.994714:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1784094293.994726:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024366720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094293.994749:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1784094293.994758:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024367104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.994773:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024366720:12345-0@lo:400:kworker.0 Request processed in 50us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094293.994788:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024366848 00000100:00100000:2.0:1784094293.994794:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024366848 00000100:00100000:3.0:1784094293.994795:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024367104:12345-0@lo:400:kworker.0 Request processed in 38us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094293.994825:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1784094293.994833:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024366848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094293.994859:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094293.994902:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024366848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094293.994908:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1784094293.994955:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024366848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094293.994997:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024366720:0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.995225:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024367104:0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.995236:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024366976:0@lo:400:kworker.0 00000100:00100000:1.0:1784094293.995246:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024366464:0@lo:400:kworker.0 00000100:00100000:0.0:1784094293.995254:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1784094293.995263:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00080000:1.0:1784094293.995280:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784094294.506534:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094295.030364:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094295.030565:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884416 00000100:00100000:1.0:1784094295.030580:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884416 00000100:00100000:1.0:1784094295.030738:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1100 00000100:00100000:1.0:1784094295.030750:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013884416:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094295.030850:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013884416:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 103us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094295.030857:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1100 00000100:00080000:0.0:1784094295.030916:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094295.033885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094295.033945:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884544 00000100:00100000:3.0:1784094295.033956:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884544 00000100:00080000:0.0:1784094295.034019:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094295.034031:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 562 00000100:00100000:3.0:1784094295.034041:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013884544:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094295.034397:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013884544:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 357us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094295.034406:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 562 00000100:00100000:3.0:1784094295.036793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094295.036892:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884672 00000100:00100000:1.0:1784094295.036912:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884672 00000100:00100000:1.0:1784094295.037090:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:1.0:1784094295.037101:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013884672:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:0.0:1784094295.037191:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094295.037480:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013884672:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 381us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094295.037488:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 563 00000100:00100000:0.0:1784094295.039168:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094295.039245:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884800 00000100:00100000:3.0:1784094295.039253:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884800 00000100:00100000:3.0:1784094295.039353:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1101 00000100:00100000:3.0:1784094295.039364:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013884800:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094295.039783:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013884800:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 420us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094295.039790:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1101 00000100:00100000:0.0:1784094295.042983:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094295.043114:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013884928 00000100:00100000:2.0:1784094295.043125:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013884928 00000100:00100000:2.0:1784094295.043187:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1102 00000100:00100000:2.0:1784094295.043198:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013884928:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094295.043404:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013884928:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 207us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094295.043412:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1102 00000100:00100000:0.0:1784094295.044845:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094295.044951:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013885056 00000100:00100000:3.0:1784094295.044959:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013885056 00000100:00100000:3.0:1784094295.045009:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 564 00000100:00100000:3.0:1784094295.045018:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013885056:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094295.045403:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013885056:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 385us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094295.045412:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 564 00000100:00100000:0.0:1784094295.047362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094295.047676:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013885184 00000100:00100000:3.0:1784094295.047690:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013885184 00000100:00100000:3.0:1784094295.047748:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 565 00000100:00100000:3.0:1784094295.047757:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013885184:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094295.048068:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:59178:x1870757013885184:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 311us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094295.048076:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 565 00000100:00100000:0.0:1784094295.051718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094295.053650:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013885312 00000100:00100000:2.0:1784094295.053664:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013885312 00000100:00100000:2.0:1784094295.053736:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1103 00000100:00100000:2.0:1784094295.053747:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013885312:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094295.054176:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:59178:x1870757013885312:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 429us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094295.054185:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1103 00000100:00100000:0.0:1784094295.069988:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094295.070178:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013885440 00000100:00100000:2.0:1784094295.070188:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013885440 00000100:00100000:2.0:1784094295.070238:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1104 00000100:00100000:2.0:1784094295.070248:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:59179:x1870757013885440:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094295.070269:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094295.070338:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc4f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e37 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.070506:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc4fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.070529:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.070541:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094295.070886:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00000004:00200000:2.0:1784094295.070890:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094295.071112:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.071139:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc4f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e37 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.071167:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc4fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e37 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.071178:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12c00) 00010000:00010000:2.0:1784094295.071182:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094295.071185:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094295.071235:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:59179:x1870757013885440:12345-192.168.204.57@tcp:101:rm.0 Request processed in 988us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094295.071242:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1104 00000100:00100000:0.0:1784094295.075844:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094295.075933:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013885696 00000100:00100000:2.0:1784094295.075943:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013885696 00000100:00100000:2.0:1784094295.076003:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1105 00000100:00100000:2.0:1784094295.076014:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:59179:x1870757013885696:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094295.076033:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094295.076050:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e3e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094295.076279:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 7680 00010000:00010000:2.0:1784094295.076529:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc502 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e3e expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.076543:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784094295.076547:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784094295.076551:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e3e expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094295.076568:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094295.076615:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:59179:x1870757013885696:12345-192.168.204.57@tcp:101:rm.0 Request processed in 603us (780us total) trans 4294967717 rc 301/301 00000100:00100000:2.0:1784094295.076625:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1105 00000100:00100000:0.0:1784094295.080835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094295.080951:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013885824 00000100:00100000:1.0:1784094295.080962:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013885824 00000100:00100000:1.0:1784094295.081019:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 112 00000100:00100000:1.0:1784094295.081030:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:59179:x1870757013885824:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:1.0:1784094295.084638:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:59179:x1870757013885824:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3600us (3802us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094295.084653:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 112 00000100:00100000:0.0:1784094295.087249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094295.087334:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886080 00000100:00100000:2.0:1784094295.087344:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886080 00000100:00100000:2.0:1784094295.087398:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 113 00000100:00100000:2.0:1784094295.087409:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:59179:x1870757013886080:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:2.0:1784094295.089693:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:59179:x1870757013886080:12345-192.168.204.57@tcp:35:rm.0 Request processed in 2279us (2444us total) trans 4294967718 rc 0/0 00000100:00100000:2.0:1784094295.089704:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 113 00000100:00100000:0.0:1784094295.093743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094295.093815:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886336 00000100:00100000:3.0:1784094295.093823:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886336 00000100:00100000:3.0:1784094295.093874:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1106 00000100:00100000:3.0:1784094295.093884:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:59179:x1870757013886336:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094295.093949:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784094295.093975:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc4fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e37 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.093997:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc4a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e22 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094007:0:8381:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc119) 00010000:00010000:3.0:1784094295.094011:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907219c12c00) 00010000:00010000:3.0:1784094295.094021:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094295.094043:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094055:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094064:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094074:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094080:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094086:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094611:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094622:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094630:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094776:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094782:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094786:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094789:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094295.094792:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094797:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094802:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784094295.094804:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094295.094806:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094809:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc51e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094819:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094824:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094827:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094830:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094295.094831:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094834:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094838:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784094295.094839:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094295.094840:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094843:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc510 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094849:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094852:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094855:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094858:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094295.094860:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094863:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094866:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff907204fceb00) 00010000:00010000:3.0:1784094295.094867:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094295.094869:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.094872:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc517 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094295.094976:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:59179:x1870757013886336:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1092us (1238us total) trans 0 rc -13/-13 00000100:00100000:3.0:1784094295.094981:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1106 00010000:00010000:3.0:1784094295.529645:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094295.753569:0:99438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed1c48370 20000000:00000080:3.0:1784094295.753586:0:99438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210e71000 uarg=0000000000000000 00010000:00010000:3.0:1784094295.756515:0:99438:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094295.756536:0:99438:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094295.756578:0:99438:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094295.756595:0:99438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.756612:0:99438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc47d expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.756621:0:99438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.756663:0:99438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc47d expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.756678:0:99438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc47d expref: 18 pid: 5770 timeout: 1606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094295.756692:0:99438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99438:1870757024367232:0@lo:104: 00000100:00100000:3.0:1784094295.756754:0:99438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094295.756814:0:99438:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de66300 going to sleep for 11 seconds 00000100:00100000:0.0:1784094295.756936:0:5762:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784094295.756949:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367232 00000100:00100000:0.0:1784094295.756955:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367232 00000100:00100000:0.0:1784094295.757036:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784094295.757047:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101df3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:99438:x1870757024367232:12345-0@lo:104: 00010000:00010000:0.0:1784094295.757061:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094295.757128:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094295.757134:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101df3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:99438:x1870757024367232:12345-0@lo:104: Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094295.757141:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1784094295.757235:0:99438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99438:1870757024367232:0@lo:104: 00010000:00010000:3.0:1784094295.757252:0:99438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094295.757665:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094295.757672:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094295.757685:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094295.757689:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094295.757698:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094295.757705:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094295.757711:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094295.757751:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094295.757759:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784094295.757811:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024367360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094295.757847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094295.757957:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094295.757965:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cc47d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc484 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094295.757981:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094295.757983:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094295.757985:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094295.758144:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367360 00000100:00100000:3.0:1784094295.758149:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367360 00010000:00010000:3.0:1784094295.758170:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc47d expref: 19 pid: 5770 timeout: 1606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094295.758237:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784094295.758245:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024367360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094295.758256:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094295.758260:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc47d expref: 19 pid: 5770 timeout: 1606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758270:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc47d expref: 19 pid: 5770 timeout: 1606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758282:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41000/0x9ce98053214cc484 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc47d expref: 19 pid: 5770 timeout: 1606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758295:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758303:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758314:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758320:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758328:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758334:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758338:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094295.758342:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758349:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758370:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094295.758378:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094295.758417:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024367360:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094295.758554:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1784094295.758621:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024367360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094295.758705:0:99438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094295.758713:0:99438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094295.758718:0:99438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214cc525 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094296.043010:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094296.043042:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024367488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094296.043145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094296.043190:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367488 00000100:00100000:0.0:1784094296.043201:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367488 00000100:00080000:1.0:1784094296.043253:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094296.043291:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1784094296.043305:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024367488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094296.043362:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094296.043460:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024367488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094296.043476:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1784094296.043504:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024367488:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1784094296.207015:0:99486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff06bf7560 20000000:00000080:2.0:1784094296.207033:0:99486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723d736000 uarg=0000000000000000 00010000:00010000:2.0:1784094296.207254:0:99486:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094296.207270:0:99486:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094296.207289:0:99486:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094296.207308:0:99486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207324:0:99486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207335:0:99486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207342:0:99486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207349:0:99486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207357:0:99486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207364:0:99486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094296.207368:0:99486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207377:0:99486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207390:0:99486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207397:0:99486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.207404:0:99486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214cc52c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094296.553663:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094296.634831:0:99534:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff0653140 20000000:00000080:2.0:1784094296.634847:0:99534:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d53400 uarg=0000000000000000 00010000:00010000:2.0:1784094296.635063:0:99534:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094296.635077:0:99534:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094296.635094:0:99534:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094296.635113:0:99534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635133:0:99534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635143:0:99534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635151:0:99534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635159:0:99534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635166:0:99534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635172:0:99534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094296.635176:0:99534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635183:0:99534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635195:0:99534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635202:0:99534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094296.635208:0:99534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41a00/0x9ce98053214cc533 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094297.086859:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967718 is committed 10000000:01000000:0.0:1784094297.193545:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094297.193553:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094297.193558:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094297.193607:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094297.193619:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094297.193630:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094297.193655:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024367616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094297.193724:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094297.193790:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367616 00000100:00100000:2.0:1784094297.193799:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367616 00000100:00100000:0.0:1784094297.193800:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094297.193850:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1784094297.193861:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024367616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094297.193886:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094297.193900:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc53a expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094297.193923:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc53a expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094297.193934:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc53a expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094297.193943:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784094297.194750:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024367616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 889us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094297.194759:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1784094297.195955:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024367616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094297.195978:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094297.195991:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094297.196012:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094297.196017:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094297.196025:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094297.578562:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094298.490047:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094298.490118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094298.490139:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094298.490161:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094298.490184:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886848 00000100:00100000:1.0:1784094298.490193:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886848 00000100:00100000:1.0:1784094298.490239:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886720 00000100:00100000:1.0:1784094298.490242:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886720 00000100:00100000:1.0:1784094298.490269:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 772 00000100:00100000:1.0:1784094298.490290:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013886848:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094298.490353:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013886848:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094298.490361:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 772 00000100:00100000:1.0:1784094298.490376:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00100000:1.0:1784094298.490570:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013886720:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094298.490598:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013886720:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 217us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094298.490604:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 773 00000100:00080000:1.0:1784094298.490623:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094298.490626:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094298.490880:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886592 00000100:00100000:3.0:1784094298.490885:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886592 00000100:00100000:3.0:1784094298.490928:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1007 00000100:00100000:3.0:1784094298.490937:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013886592:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094298.490973:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013886592:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094298.490980:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1007 00000100:00100000:3.0:1784094298.491002:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886464 00000100:00100000:3.0:1784094298.491006:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886464 00000100:00100000:3.0:1784094298.491027:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 917 00000100:00100000:3.0:1784094298.491034:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013886464:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094298.491057:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013886464:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 25us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094298.491063:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 917 00000100:00080000:3.0:1784094298.491090:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1784094298.553714:0:99730:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc41094420 20000000:00000080:0.0:1784094298.553730:0:99730:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907102d0ac00 uarg=0000000000000000 00010000:00010000:0.0:1784094298.554178:0:99730:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094298.554192:0:99730:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094298.554209:0:99730:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094298.554226:0:99730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094298.554241:0:99730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc53a expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094298.554250:0:99730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094298.554284:0:99730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc53a expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094298.554298:0:99730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc53a expref: 18 pid: 5772 timeout: 1609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094298.554312:0:99730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99730:1870757024367744:0@lo:104: 00000100:00100000:0.0:1784094298.554366:0:99730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094298.554441:0:99730:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723de666c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094298.554449:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367744 00000100:00100000:3.0:1784094298.554458:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367744 00000100:00100000:3.0:1784094298.554520:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784094298.554531:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:99730:x1870757024367744:12345-0@lo:104: 00010000:00010000:3.0:1784094298.554555:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094298.554622:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094298.554629:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:99730:x1870757024367744:12345-0@lo:104: Request processed in 100us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094298.554638:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784094298.554640:0:99730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99730:1870757024367744:0@lo:104: 00010000:00010000:0.0:1784094298.554663:0:99730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.554710:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094298.554717:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.554725:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094298.554729:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.554738:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094298.554751:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094298.554756:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094298.554784:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.554791:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094298.554824:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.554831:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214cc53a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc541 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.554857:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094298.554858:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094298.554860:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094298.554889:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024367872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094298.554929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094298.554969:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024367872 00000100:00100000:2.0:1784094298.554974:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024367872 00010000:00010000:2.0:1784094298.554994:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc53a expref: 19 pid: 5772 timeout: 1609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094298.555021:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784094298.555028:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024367872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094298.555038:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094298.555043:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc53a expref: 19 pid: 5772 timeout: 1609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555054:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc53a expref: 19 pid: 5772 timeout: 1609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555066:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40800/0x9ce98053214cc541 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc53a expref: 19 pid: 5772 timeout: 1609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555078:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555085:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555097:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555103:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555110:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555115:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555121:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094298.555125:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555131:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555154:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094298.555168:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094298.555206:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024367872:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094298.555214:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:1.0:1784094298.555232:0:99730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094298.555242:0:99730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094298.555250:0:99730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77200/0x9ce98053214cc548 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094298.555301:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024367872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094298.601603:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094299.113764:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024368000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094299.113860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094299.114065:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368000 00000100:00100000:2.0:1784094299.114074:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368000 00000100:00100000:2.0:1784094299.114134:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1784094299.114144:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024368000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094299.114185:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784094299.114442:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094299.114484:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024368384:0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.114518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094299.114553:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024368256:0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.114580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094299.114600:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094299.114605:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024368128:0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.114631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094299.114669:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368384 00000100:00100000:3.0:1784094299.114674:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368384 00000100:00100000:3.0:1784094299.114705:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368256 00000100:00100000:3.0:1784094299.114707:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368256 00000100:00100000:3.0:1784094299.114723:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1784094299.114729:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024368384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.114765:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024368384:12345-0@lo:400:kworker.0 Request processed in 36us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094299.114772:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1784094299.114803:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1784094299.114809:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024368256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.114848:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024368256:12345-0@lo:400:kworker.0 Request processed in 39us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094299.114854:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00080000:3.0:1784094299.114874:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094299.114905:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024368384:0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.115336:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024368256:0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.115370:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368128 00000100:00100000:3.0:1784094299.115374:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368128 00000100:00100000:2.0:1784094299.115386:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024368000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1242us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094299.115396:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1784094299.115409:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1784094299.115433:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094299.115445:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024368128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094299.115446:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024368640:0@lo:400:kworker.0 00000100:00100000:2.0:1784094299.115450:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094299.115461:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024368512:0@lo:400:kworker.0 00000100:00100000:3.0:1784094299.115494:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024368128:12345-0@lo:400:kworker.0 Request processed in 76us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094299.115504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094299.115508:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1784094299.115542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094299.115550:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368512 00000100:00100000:2.0:1784094299.115556:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368512 00000100:00100000:1.0:1784094299.115575:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024368000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094299.115585:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024368128:0@lo:400:kworker.0 00000100:00080000:3.0:1784094299.115595:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094299.115608:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1784094299.115620:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024368512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094299.115621:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368640 00000100:00100000:0.0:1784094299.115627:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368640 00000100:00100000:2.0:1784094299.115671:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024368512:12345-0@lo:400:kworker.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094299.115678:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1784094299.115684:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1784094299.115693:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024368640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784094299.115723:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094299.115744:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024368640:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094299.115751:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1784094299.115888:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024368640:0@lo:400:kworker.0 00000100:00100000:1.0:1784094299.116064:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024368512:0@lo:400:kworker.0 10000000:01000000:1.0:1784094299.626524:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094299.626530:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094299.626534:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094299.626573:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094299.626584:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094299.626597:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094299.626623:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024368768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094299.626692:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094299.626714:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368768 00000100:00100000:3.0:1784094299.626721:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368768 00000100:00100000:1.0:1784094299.626744:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094299.626762:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1784094299.626770:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024368768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094299.626780:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094299.626792:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc54f expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094299.626811:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc54f expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094299.626832:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc54f expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094299.626892:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784094299.626930:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024368768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094299.626938:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1784094299.626965:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024368768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094299.626983:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094299.626998:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094299.627016:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094299.627021:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094299.627029:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094299.627769:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094300.653081:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094301.161622:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094301.161645:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024368896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094301.161711:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094301.161842:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024368896 00000100:00100000:0.0:1784094301.161851:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024368896 00000100:00080000:3.0:1784094301.161901:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094301.161921:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1784094301.161932:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024368896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094301.161969:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094301.162028:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024368896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094301.162036:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:1.0:1784094301.162069:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024368896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094301.673560:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094302.700887:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784094303.377689:0:100073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 01:45:02 (1784094302) 00000100:00100000:3.0:1784094303.609093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094303.609155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094303.609197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094303.609221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094303.609253:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887360 00000100:00100000:3.0:1784094303.609264:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887360 00000100:00100000:3.0:1784094303.609335:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887232 00000100:00100000:3.0:1784094303.609337:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887232 00000100:00100000:3.0:1784094303.609359:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 775 00000100:00100000:3.0:1784094303.609370:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887360:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094303.609488:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887360:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094303.609497:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 775 00000100:00100000:3.0:1784094303.609515:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 776 00000100:00100000:3.0:1784094303.609521:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887232:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094303.609561:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887232:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 34us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094303.609567:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 776 00000100:00100000:3.0:1784094303.609588:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013886976 00000100:00100000:3.0:1784094303.609591:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013886976 00000100:00100000:3.0:1784094303.609618:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 920 00000100:00100000:3.0:1784094303.609623:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013886976:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094303.609647:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013886976:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094303.609653:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 920 00000100:00080000:3.0:1784094303.609683:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094303.609687:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094303.611082:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887104 00000100:00100000:0.0:1784094303.611097:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887104 00000100:00100000:0.0:1784094303.612400:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1011 00000100:00100000:0.0:1784094303.612414:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887104:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094303.612530:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887104:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 118us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094303.612539:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1011 00000100:00080000:1.0:1784094303.612692:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094303.721801:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1784094303.973727:0:100121:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1784094303.979044:0:100121:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:3.0:1784094304.233679:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024369280:0@lo:400:kworker.0 00000100:00100000:3.0:1784094304.233757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094304.233818:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094304.233825:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024369408:0@lo:400:kworker.0 00000100:00100000:3.0:1784094304.233851:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094304.233880:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369280 00000100:00100000:3.0:1784094304.233887:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369280 00000100:00100000:3.0:1784094304.233941:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1784094304.233950:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024369280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094304.234001:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024369280:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094304.234009:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00080000:3.0:1784094304.234031:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094304.234060:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024369280:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234125:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024369152:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094304.234186:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024369664:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094304.234236:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784094304.234242:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024369024:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094304.234290:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024369536:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234316:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094304.234342:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369408 00000100:00100000:0.0:1784094304.234346:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369408 00000100:00100000:0.0:1784094304.234379:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369664 00000100:00100000:0.0:1784094304.234382:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369664 00000100:00100000:0.0:1784094304.234404:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1784094304.234411:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024369408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234500:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024369408:12345-0@lo:400:kworker.0 Request processed in 89us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094304.234507:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1784094304.234527:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1784094304.234533:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024369664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234566:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024369664:12345-0@lo:400:kworker.0 Request processed in 32us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094304.234572:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1784094304.234590:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369024 00000100:00100000:0.0:1784094304.234593:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369024 00000100:00100000:0.0:1784094304.234617:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1784094304.234622:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024369024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234654:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024369024:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094304.234660:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1784094304.234685:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369152 00000100:00100000:0.0:1784094304.234689:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369152 00000100:00100000:0.0:1784094304.234708:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369536 00000100:00100000:0.0:1784094304.234711:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369536 00000100:00100000:0.0:1784094304.234743:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1784094304.234750:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024369152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234780:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024369152:12345-0@lo:400:kworker.0 Request processed in 31us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094304.234786:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1784094304.234798:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1784094304.234804:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024369536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234828:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024369536:12345-0@lo:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094304.234833:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00080000:0.0:1784094304.234859:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094304.234862:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094304.234864:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094304.234881:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024369024:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234891:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024369536:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234900:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024369152:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234908:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024369664:0@lo:400:kworker.0 00000100:00100000:0.0:1784094304.234938:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024369408:0@lo:400:kworker.0 00000100:00100000:2.0:1784094304.237100:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094304.237164:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024369792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094304.237226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094304.237391:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369792 00000100:00100000:3.0:1784094304.237399:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369792 00000100:00100000:3.0:1784094304.237606:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1784094304.237617:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024369792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094304.237651:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094304.237705:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024369792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094304.237713:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1784094304.237763:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024369792:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1784094304.510263:0:100169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2072d320 20000000:00000080:1.0:1784094304.510284:0:100169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb17800 uarg=0000000000000000 10000000:01000000:1.0:1784094304.510967:0:100169:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094304.510987:0:100169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.511006:0:100169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc54f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.511015:0:100169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.511051:0:100169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc54f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.511160:0:100169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc54f expref: 18 pid: 5771 timeout: 1615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094304.511176:0:100169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100169:1870757024369920:0@lo:104: 00000100:00100000:1.0:1784094304.511241:0:100169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094304.511375:0:100169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094304.516548:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024369920 00000100:00100000:0.0:1784094304.516563:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024369920 00000100:00100000:0.0:1784094304.516640:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784094304.516651:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:100169:x1870757024369920:12345-0@lo:104: 00010000:00010000:0.0:1784094304.516669:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094304.516783:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094304.516789:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:100169:x1870757024369920:12345-0@lo:104: Request processed in 142us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094304.516797:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00010000:2.0:1784094304.517314:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094304.517322:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517331:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094304.517336:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517345:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094304.517354:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094304.517360:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094304.517407:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517415:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094304.517467:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517475:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12800/0x9ce98053214cc54f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc556 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094304.517489:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024370048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094304.517495:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094304.517498:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094304.517500:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094304.517539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094304.517666:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370048 00000100:00100000:2.0:1784094304.517672:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370048 00010000:00010000:2.0:1784094304.517698:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc54f expref: 19 pid: 5771 timeout: 1615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094304.517793:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1784094304.517803:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024370048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094304.517814:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094304.517838:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc54f expref: 19 pid: 5771 timeout: 1615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517851:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc54f expref: 19 pid: 5771 timeout: 1615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517870:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517880:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517897:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517904:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517911:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517918:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517924:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094304.517928:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.517934:0:100169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cc556 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc54f expref: 19 pid: 5771 timeout: 1615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517937:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.517957:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094304.517959:0:100169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100169:1870757024369920:0@lo:104: 00010000:00010000:2.0:1784094304.517973:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094304.517984:0:100169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.517995:0:100169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.518002:0:100169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094304.518010:0:100169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214cc55d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094304.518017:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024370048:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094304.518025:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1784094304.518116:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024370048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094304.748233:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094304.998679:0:100217:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8422f240 20000000:00000080:2.0:1784094304.998697:0:100217:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210e72000 uarg=0000000000000000 10000000:01000000:2.0:1784094304.999127:0:100217:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094304.999148:0:100217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999164:0:100217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999175:0:100217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999182:0:100217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999189:0:100217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999198:0:100217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999205:0:100217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094304.999210:0:100217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999218:0:100217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999302:0:100217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999312:0:100217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094304.999319:0:100217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40e00/0x9ce98053214cc564 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094305.462805:0:100265:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd643d7a80 20000000:00000080:0.0:1784094305.462821:0:100265:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907102d0a000 uarg=0000000000000000 10000000:01000000:0.0:1784094305.463130:0:100265:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094305.463157:0:100265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463173:0:100265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463182:0:100265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463189:0:100265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463196:0:100265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463204:0:100265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463211:0:100265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094305.463215:0:100265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463291:0:100265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463306:0:100265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463324:0:100265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.463331:0:100265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214cc56b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.771119:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094305.833586:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094305.833598:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094305.833605:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094305.833672:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.833687:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094305.833720:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094305.833757:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024370176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094305.833855:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094305.833934:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094305.834002:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370176 00000100:00100000:3.0:1784094305.834017:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370176 00000100:00100000:3.0:1784094305.834076:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1784094305.834087:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024370176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094305.834102:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094305.834122:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc572 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094305.834148:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc572 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094305.834159:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc572 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094305.834169:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784094305.834247:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024370176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094305.834254:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1784094305.834417:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024370176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094305.834610:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.834623:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094305.834650:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094305.834656:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.834664:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094305.934682:0:100313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0c0b3d80 20000000:00000080:1.0:1784094305.934715:0:100313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103f800 uarg=0000000000000000 10000000:01000000:1.0:1784094305.934960:0:100313:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094305.934988:0:100313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.935009:0:100313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc572 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.935019:0:100313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.935066:0:100313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc572 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.935083:0:100313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc572 expref: 18 pid: 5771 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094305.935106:0:100313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100313:1870757024370304:0@lo:104: 00000100:00100000:1.0:1784094305.935197:0:100313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094305.935325:0:100313:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094305.935526:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370304 00000100:00100000:3.0:1784094305.935536:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370304 00000100:00100000:3.0:1784094305.935607:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1784094305.935618:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:100313:x1870757024370304:12345-0@lo:104: 00010000:00010000:3.0:1784094305.935635:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094305.935748:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094305.935755:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:100313:x1870757024370304:12345-0@lo:104: Request processed in 139us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094305.935765:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00010000:2.0:1784094305.935774:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094305.935784:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094305.935794:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094305.935799:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094305.935815:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094305.935830:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094305.935836:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1784094305.935871:0:100313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100313:1870757024370304:0@lo:104: 00010000:00010000:2.0:1784094305.935879:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094305.935889:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094305.935898:0:100313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094305.935930:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094305.935940:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cc572 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc579 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094305.935957:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024370432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094305.935960:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094305.935964:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094305.935966:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094305.935991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094305.936064:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370432 00000100:00100000:1.0:1784094305.936068:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370432 00010000:00010000:1.0:1784094305.936087:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc572 expref: 19 pid: 5771 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094305.936118:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1784094305.936125:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024370432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094305.936137:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094305.936143:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc572 expref: 19 pid: 5771 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936155:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc572 expref: 19 pid: 5771 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936169:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cc579 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc572 expref: 19 pid: 5771 timeout: 1617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936182:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936190:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936205:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936213:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936221:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936229:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936235:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094305.936240:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936248:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936269:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094305.936283:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094305.936314:0:100313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094305.936316:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024370432:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094305.936331:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:3.0:1784094305.936332:0:100313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094305.936344:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024370432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094305.936352:0:100313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12600/0x9ce98053214cc580 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094306.282022:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094306.282045:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024370560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094306.282120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094306.282348:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370560 00000100:00100000:2.0:1784094306.282357:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370560 00000100:00080000:0.0:1784094306.282452:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094306.282481:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1784094306.282490:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024370560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094306.282523:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094306.282569:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024370560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094306.282574:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1784094306.282655:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024370560:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1784094306.368147:0:100361:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd4308060 20000000:00000080:3.0:1784094306.368163:0:100361:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90710192ac00 uarg=0000000000000000 10000000:01000000:3.0:1784094306.368351:0:100361:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094306.368372:0:100361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368388:0:100361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368400:0:100361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368407:0:100361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368415:0:100361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368495:0:100361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368502:0:100361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094306.368506:0:100361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368515:0:100361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368528:0:100361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368536:0:100361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094306.368542:0:100361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214cc587 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.794353:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094306.817009:0:100409:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff78d49360 20000000:00000080:2.0:1784094306.817023:0:100409:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210e72400 uarg=0000000000000000 10000000:01000000:2.0:1784094306.817207:0:100409:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094306.817227:0:100409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817243:0:100409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817255:0:100409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817261:0:100409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817267:0:100409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817274:0:100409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817280:0:100409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094306.817285:0:100409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817293:0:100409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817306:0:100409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817314:0:100409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094306.817324:0:100409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214cc58e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094307.179589:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094307.179596:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094307.179602:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094307.179665:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094307.179689:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094307.179700:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094307.179726:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024370688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094307.179798:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094307.179879:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720840 going to sleep for 11 seconds 00000100:00100000:3.0:1784094307.180195:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370688 00000100:00100000:3.0:1784094307.180201:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370688 00000100:00100000:3.0:1784094307.180256:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1784094307.180266:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024370688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094307.180278:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094307.180292:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc595 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094307.180315:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc595 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094307.180331:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc595 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094307.180340:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094307.180386:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024370688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094307.180394:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1784094307.180476:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024370688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094307.180492:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094307.180501:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094307.180518:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094307.180523:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094307.180531:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094307.820722:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094308.215980:0:100558:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd01f44580 20000000:00000080:2.0:1784094308.215996:0:100558:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101391800 uarg=0000000000000000 10000000:01000000:2.0:1784094308.216511:0:100558:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094308.216533:0:100558:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094308.216552:0:100558:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc595 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094308.216561:0:100558:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094308.216601:0:100558:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc595 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094308.216615:0:100558:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc595 expref: 18 pid: 5770 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094308.216630:0:100558:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100558:1870757024370816:0@lo:104: 00000100:00100000:2.0:1784094308.216702:0:100558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094308.216762:0:100558:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071037206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094308.216765:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370816 00000100:00100000:0.0:1784094308.216774:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370816 00000100:00100000:0.0:1784094308.216829:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1784094308.216841:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:100558:x1870757024370816:12345-0@lo:104: 00010000:00010000:0.0:1784094308.216854:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094308.216913:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094308.216920:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:100558:x1870757024370816:12345-0@lo:104: Request processed in 81us (218us total) trans 0 rc 0/0 00010000:00010000:1.0:1784094308.216926:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784094308.216928:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00010000:1.0:1784094308.216935:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.216944:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094308.216948:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.216956:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094308.216963:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094308.216969:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094308.217009:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217015:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094308.217040:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217047:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76a00/0x9ce98053214cc595 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc59c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217061:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094308.217063:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094308.217065:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094308.217077:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024370944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094308.217107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094308.217143:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024370944 00000100:00100000:1.0:1784094308.217147:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024370944 00010000:00010000:1.0:1784094308.217166:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc595 expref: 19 pid: 5770 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094308.217233:0:100558:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100558:1870757024370816:0@lo:104: 00010000:00010000:2.0:1784094308.217251:0:100558:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094308.217299:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1784094308.217307:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024370944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094308.217319:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094308.217324:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc595 expref: 19 pid: 5770 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217334:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc595 expref: 19 pid: 5770 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217345:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68000/0x9ce98053214cc59c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc595 expref: 19 pid: 5770 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217358:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217365:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217377:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217384:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217391:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217397:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217403:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094308.217407:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.217414:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.217889:0:100558:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.217899:0:100558:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.218111:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.218121:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214cc5a3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100558 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094308.218139:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094308.218189:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024370944:12345-0@lo:103:ldlm_bl.0 Request processed in 883us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094308.218199:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1784094308.218243:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024370944:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784094308.648574:0:100606:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa27a4500 20000000:00000080:3.0:1784094308.648592:0:100606:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90710192b800 uarg=0000000000000000 10000000:01000000:3.0:1784094308.648797:0:100606:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094308.648820:0:100606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648837:0:100606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648849:0:100606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648856:0:100606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648863:0:100606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648871:0:100606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648879:0:100606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094308.648884:0:100606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648891:0:100606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648904:0:100606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648913:0:100606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094308.648919:0:100606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69000/0x9ce98053214cc5aa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094308.729039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094308.729129:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094308.729180:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094308.729237:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094308.729295:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887616 00000100:00100000:0.0:1784094308.729308:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887616 00000100:00100000:0.0:1784094308.729402:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1015 00000100:00100000:0.0:1784094308.729466:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887616:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094308.729591:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887616:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 177us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094308.729603:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1015 00000100:00100000:0.0:1784094308.729662:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887488 00000100:00100000:0.0:1784094308.729667:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887488 00000100:00100000:0.0:1784094308.729702:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 924 00000100:00100000:0.0:1784094308.729708:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013887488:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094308.729768:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013887488:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 57us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094308.729782:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 924 00000100:00100000:0.0:1784094308.729836:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887744 00000100:00100000:0.0:1784094308.729841:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887744 00000100:00100000:0.0:1784094308.729899:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013887872 00000100:00100000:0.0:1784094308.729903:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013887872 00000100:00100000:2.0:1784094308.729937:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 779 00000100:00100000:2.0:1784094308.729960:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013887744:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094308.729971:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 780 00000100:00100000:0.0:1784094308.729986:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887872:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094308.730066:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013887872:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 78us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094308.730067:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013887744:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 106us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094308.730092:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 780 00000100:00100000:2.0:1784094308.730103:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 779 00000100:00080000:0.0:1784094308.730133:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094308.730140:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094308.730144:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094308.841864:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094309.353720:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024371200:0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.353754:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024371328:0@lo:400:kworker.0 00000100:00100000:1.0:1784094309.353755:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024371072:0@lo:400:kworker.0 00000100:00100000:2.0:1784094309.353797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094309.353876:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024371456:0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.354948:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371200 00000100:00100000:3.0:1784094309.354958:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371200 00000100:00100000:3.0:1784094309.355007:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1784094309.355015:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024371200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.355075:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024371200:12345-0@lo:400:kworker.0 Request processed in 60us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094309.355082:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1784094309.355109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1784094309.355124:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094309.355129:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094309.355133:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094309.355162:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094309.355171:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094309.355182:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094309.355182:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024371584:0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.355204:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103a88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024371968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094309.355237:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371072 00000100:00100000:1.0:1784094309.355242:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371072 00000100:00100000:3.0:1784094309.355253:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094309.355277:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:2.0:1784094309.355279:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024371200:0@lo:400:kworker.0 00000100:00100000:1.0:1784094309.355279:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371968 00000100:00100000:0.0:1784094309.355282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094309.355285:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371968 00000100:00100000:3.0:1784094309.355305:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1784094309.355309:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024371712:0@lo:400:kworker.0 00000100:00100000:1.0:1784094309.355315:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1784094309.355324:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024371968:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094309.355331:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024371072:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1784094309.355336:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784094309.355340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094309.355353:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc5b1 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094309.355367:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094309.355375:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024371840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094309.355375:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371456 00010000:00010000:1.0:1784094309.355379:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 20 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094309.355381:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+20:3304:x1870757024371072:12345-0@lo:400:kworker.0 Request processed in 65us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094309.355382:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371456 00000100:00100000:3.0:1784094309.355397:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00010000:00010000:1.0:1784094309.355402:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 20 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094309.355407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094309.355414:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:0.0:1784094309.355449:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1784094309.355460:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024371456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.355468:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371840 00000100:00100000:3.0:1784094309.355473:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371840 00000100:00100000:3.0:1784094309.355503:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1784094309.355510:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024371840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094309.355534:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094309.357545:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024371840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2028us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094309.357559:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1784094309.357608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094309.357692:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371712 00000100:00100000:3.0:1784094309.357699:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371712 00000100:00100000:3.0:1784094309.357735:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1784094309.357743:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.357833:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024371712:12345-0@lo:400:kworker.0 Request processed in 92us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094309.357839:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1784094309.357863:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371328 00000100:00100000:3.0:1784094309.357867:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371328 00000100:00100000:3.0:1784094309.357897:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1784094309.357903:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024371328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094309.357936:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024371328:12345-0@lo:400:kworker.0 Request processed in 34us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094309.357943:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1784094309.357981:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024371328:0@lo:400:kworker.0 00000100:00100000:2.0:1784094309.357995:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024371840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094309.358010:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024371712:0@lo:400:kworker.0 00000100:00100000:1.0:1784094309.358021:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024371968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2697us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094309.358029:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00080000:3.0:1784094309.358036:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094309.358043:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094309.358047:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094309.358051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094309.358074:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103a88e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024371968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094309.358083:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024371072:0@lo:400:kworker.0 00010000:00010000:1.0:1784094309.358097:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094309.358103:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024371584 00000100:00100000:2.0:1784094309.358107:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024371584 00010000:00010000:1.0:1784094309.358109:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094309.358126:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094309.358132:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094309.358136:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1784094309.358141:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024371584:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1784094309.358141:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784094309.358164:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094309.358232:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024371584:12345-0@lo:400:kworker.0 Request processed in 90us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094309.358239:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1784094309.358265:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024371584:0@lo:400:kworker.0 00000100:00100000:0.0:1784094309.358304:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024371456:12345-0@lo:400:kworker.0 Request processed in 2846us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094309.358312:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1784094309.358380:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024371456:0@lo:400:kworker.0 00010000:00010000:2.0:1784094309.865677:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094310.680949:0:100803:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2d34e2c0 20000000:00000080:0.0:1784094310.680968:0:100803:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103dc00 uarg=0000000000000000 00010000:00010000:0.0:1784094310.681195:0:100803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094310.681211:0:100803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094310.681225:0:100803:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094310.681245:0:100803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094310.681262:0:100803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094310.681272:0:100803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094310.681314:0:100803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094310.681329:0:100803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 18 pid: 5771 timeout: 1621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094310.681345:0:100803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100803:1870757024372096:0@lo:104: 00000100:00100000:0.0:1784094310.681408:0:100803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094310.681716:0:100803:0:(client.c:2702:ptlrpc_set_wait()) set ffff907226004780 going to sleep for 11 seconds 00000100:00100000:2.0:1784094310.681761:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372096 00000100:00100000:2.0:1784094310.681770:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372096 00000100:00100000:2.0:1784094310.681896:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784094310.681907:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:100803:x1870757024372096:12345-0@lo:104: 00010000:00010000:2.0:1784094310.681923:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094310.681990:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094310.681997:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:100803:x1870757024372096:12345-0@lo:104: Request processed in 93us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094310.682004:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1784094310.682018:0:100803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100803:1870757024372096:0@lo:104: 00010000:00010000:0.0:1784094310.682038:0:100803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682160:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094310.682168:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682495:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094310.682500:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682511:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094310.682518:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094310.682528:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094310.682648:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682656:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094310.682689:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682696:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cc5b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5b8 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682713:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094310.682715:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094310.682717:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094310.682756:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024372224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094310.682795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094310.682870:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372224 00000100:00100000:1.0:1784094310.682876:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372224 00010000:00010000:1.0:1784094310.682898:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 19 pid: 5771 timeout: 1621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094310.682930:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784094310.682939:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024372224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094310.682950:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094310.682956:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 19 pid: 5771 timeout: 1621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682967:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 19 pid: 5771 timeout: 1621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682980:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214cc5b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc5b1 expref: 19 pid: 5771 timeout: 1621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.682994:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683002:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683017:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683024:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683031:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683038:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683043:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094310.683046:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683052:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683060:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.683067:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094310.683102:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024372224:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094310.683109:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784094310.683139:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024372224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094310.683247:0:100803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094310.683256:0:100803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094310.683263:0:100803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76e00/0x9ce98053214cc5bf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094310.889716:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094311.404056:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024372352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094311.404154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094311.404346:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372352 00000100:00100000:1.0:1784094311.404358:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372352 00000100:00100000:1.0:1784094311.404893:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1784094311.404905:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024372352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094311.404961:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094311.405045:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024372352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094311.405054:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00080000:3.0:1784094311.405120:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094311.405262:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024372352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094311.913698:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784094312.490664:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094312.490672:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094312.490676:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094312.490725:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.490737:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.490748:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094312.490785:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024372480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094312.490851:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094312.490953:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26c240 going to sleep for 11 seconds 00000100:00100000:2.0:1784094312.490996:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372480 00000100:00100000:2.0:1784094312.491004:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372480 00000100:00100000:2.0:1784094312.491066:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:2.0:1784094312.491075:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024372480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094312.491088:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094312.491102:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc5c6 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094312.491130:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094312.491141:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094312.491155:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094312.491234:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024372480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094312.491242:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1784094312.491363:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024372480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094312.491378:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.491387:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094312.491404:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094312.491407:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.491412:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094312.653537:0:100999:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff54294dc0 20000000:00000080:0.0:1784094312.653553:0:100999:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103f800 uarg=0000000000000000 00010000:00010000:0.0:1784094312.654041:0:100999:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094312.654056:0:100999:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094312.654069:0:100999:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094312.654087:0:100999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094312.654104:0:100999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094312.654111:0:100999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094312.654150:0:100999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094312.654165:0:100999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 18 pid: 5770 timeout: 1623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094312.654181:0:100999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100999:1870757024372608:0@lo:104: 00000100:00100000:0.0:1784094312.654243:0:100999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094312.654310:0:100999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072308399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094312.654381:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372608 00000100:00100000:3.0:1784094312.654389:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372608 00000100:00100000:3.0:1784094312.654521:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784094312.654531:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:100999:x1870757024372608:12345-0@lo:104: 00010000:00010000:3.0:1784094312.654543:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.654624:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094312.654631:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:100999:x1870757024372608:12345-0@lo:104: Request processed in 102us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094312.654640:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1784094312.654657:0:100999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100999:1870757024372608:0@lo:104: 00010000:00010000:2.0:1784094312.654678:0:100999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.654779:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094312.654787:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.654796:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094312.654800:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.654808:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094312.654815:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094312.654820:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094312.654857:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.654864:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094312.654890:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.654898:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13000/0x9ce98053214cc5c6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5cd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.654915:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094312.654917:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024372736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094312.654918:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094312.654921:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094312.654955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094312.655090:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372736 00000100:00100000:3.0:1784094312.655095:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372736 00010000:00010000:3.0:1784094312.655127:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 19 pid: 5770 timeout: 1623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094312.655158:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784094312.655165:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024372736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094312.655174:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094312.655178:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 19 pid: 5770 timeout: 1623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655186:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 19 pid: 5770 timeout: 1623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655195:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214cc5cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc5c6 expref: 19 pid: 5770 timeout: 1623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655209:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655216:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655229:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655236:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655248:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655409:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655415:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094312.655438:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655446:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655463:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094312.655470:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094312.655498:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024372736:12345-0@lo:103:ldlm_bl.0 Request processed in 334us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094312.655506:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:2.0:1784094312.655523:0:100999:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094312.655527:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024372736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094312.655533:0:100999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094312.655540:0:100999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76800/0x9ce98053214cc5d4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094312.937646:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094313.042141:0:101047:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff78f630c0 20000000:00000080:0.0:1784094313.042159:0:101047:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723103dc00 uarg=0000000000000000 00010000:00010000:0.0:1784094313.042359:0:101047:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094313.042369:0:101047:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094313.042378:0:101047:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094313.042394:0:101047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042406:0:101047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042413:0:101047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042418:0:101047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042476:0:101047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042484:0:101047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042491:0:101047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094313.042495:0:101047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042503:0:101047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042515:0:101047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042523:0:101047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.042530:0:101047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214cc5db lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094313.848841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094313.848928:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094313.848959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094313.848972:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888000 00000100:00100000:1.0:1784094313.848980:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888000 00000100:00100000:2.0:1784094313.848988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094313.849012:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888384 00000100:00100000:0.0:1784094313.849019:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888384 00000100:00100000:1.0:1784094313.849027:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 928 00000100:00100000:1.0:1784094313.849038:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013888000:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094313.849039:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888256 00000100:00100000:2.0:1784094313.849045:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888256 00000100:00100000:0.0:1784094313.849076:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 783 00000100:00100000:2.0:1784094313.849089:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 784 00000100:00100000:0.0:1784094313.849098:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013888384:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094313.849099:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013888000:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094313.849104:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013888256:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094313.849119:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 928 00000100:00100000:2.0:1784094313.849150:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013888256:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094313.849159:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013888384:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094313.849162:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 784 00000100:00100000:0.0:1784094313.849174:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 783 00000100:00080000:2.0:1784094313.849200:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094313.849206:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094313.849275:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888128 00000100:00100000:3.0:1784094313.849279:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888128 00000100:00100000:2.0:1784094313.849567:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1019 00000100:00100000:2.0:1784094313.849575:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013888128:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094313.849610:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013888128:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094313.849617:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1019 00000100:00080000:0.0:1784094313.849689:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1784094313.897492:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094313.897498:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094313.897501:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094313.897537:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094313.897556:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094313.897572:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094313.897598:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024372864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094313.897666:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094313.897720:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486480 going to sleep for 11 seconds 00000100:00100000:0.0:1784094313.897888:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372864 00000100:00100000:0.0:1784094313.897901:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372864 00000100:00100000:0.0:1784094313.897955:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1784094313.897965:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024372864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094313.897978:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094313.897994:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc5e2 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.898017:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.898028:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.898042:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76a00, rc 0) 00000100:00100000:0.0:1784094313.898089:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024372864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094313.898097:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1784094313.898113:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024372864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094313.898128:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094313.898137:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094313.898155:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094313.898160:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094313.898168:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094313.963040:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094314.475015:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024372992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094314.475082:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094314.475156:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024372992 00000100:00100000:0.0:1784094314.475164:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024372992 00000100:00080000:1.0:1784094314.475217:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094314.475222:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1784094314.475234:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024372992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094314.475270:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094314.475332:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024372992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094314.475339:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1784094314.475513:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024372992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094314.478676:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024373120:0@lo:400:kworker.0 00000100:00100000:0.0:1784094314.478726:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024373376:0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.478751:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024373248:0@lo:400:kworker.0 00000100:00100000:0.0:1784094314.478785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094314.478823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094314.478840:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094314.478849:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024373504:0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.478853:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094314.478862:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024373632:0@lo:400:kworker.0 00000100:00100000:0.0:1784094314.478880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094314.478899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094314.478917:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373376 00000100:00100000:0.0:1784094314.478925:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373376 00000100:00100000:2.0:1784094314.478937:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373248 00000100:00100000:2.0:1784094314.478942:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373248 00000100:00100000:0.0:1784094314.478978:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1784094314.478989:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024373376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094314.478996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094314.479045:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024373376:12345-0@lo:400:kworker.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094314.479053:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1784094314.479061:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373504 00000100:00100000:1.0:1784094314.479066:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373504 00000100:00100000:1.0:1784094314.479115:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1784094314.479124:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024373504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094314.479158:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024373504:12345-0@lo:400:kworker.0 Request processed in 35us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094314.479164:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:1.0:1784094314.479184:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094314.479189:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094314.479208:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373632 00000100:00100000:1.0:1784094314.479212:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373632 00000100:00100000:2.0:1784094314.479350:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1784094314.479357:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024373248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.479388:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024373248:12345-0@lo:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094314.479394:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1784094314.479413:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373120 00000100:00100000:2.0:1784094314.479416:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373120 00000100:00100000:2.0:1784094314.479465:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1784094314.479472:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024373120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.479505:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024373120:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094314.479511:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1784094314.479703:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024373120:0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.479738:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024373248:0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.480498:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024373504:0@lo:400:kworker.0 00000100:00100000:2.0:1784094314.480510:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024373376:0@lo:400:kworker.0 00000100:00080000:3.0:1784094314.480570:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094314.481117:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1784094314.481130:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094314.481204:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024373632:12345-0@lo:400:kworker.0 Request processed in 79us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094314.481212:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1784094314.481332:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024373632:0@lo:400:kworker.0 00010000:00010000:0.0:1784094314.985603:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094315.633945:0:101338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc26071eb0 20000000:00000080:0.0:1784094315.633959:0:101338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907202c2d800 uarg=0000000000000000 00010000:00010000:0.0:1784094315.634137:0:101338:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094315.634149:0:101338:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094315.634159:0:101338:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094315.634174:0:101338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094315.634188:0:101338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094315.634195:0:101338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094315.634226:0:101338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094315.634236:0:101338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 18 pid: 5770 timeout: 1626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094315.634247:0:101338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101338:1870757024373760:0@lo:104: 00000100:00100000:0.0:1784094315.634304:0:101338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094315.634352:0:101338:0:(client.c:2702:ptlrpc_set_wait()) set ffff907206b0b300 going to sleep for 11 seconds 00000100:00100000:2.0:1784094315.634368:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784094315.634381:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373760 00000100:00100000:2.0:1784094315.634387:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373760 00000100:00100000:2.0:1784094315.634508:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784094315.634529:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907102d09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:101338:x1870757024373760:12345-0@lo:104: 00010000:00010000:2.0:1784094315.634543:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094315.634597:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094315.634603:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907102d09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:101338:x1870757024373760:12345-0@lo:104: Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094315.634609:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1784094315.634610:0:101338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101338:1870757024373760:0@lo:104: 00010000:00010000:0.0:1784094315.634626:0:101338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.634773:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094315.634781:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.634790:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094315.634794:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.634812:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094315.634820:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094315.634826:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094315.634857:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.634864:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094315.634896:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.634904:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cc5e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc5e9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.634919:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094315.634921:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094315.634922:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094315.634946:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094315.634960:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024373888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094315.634996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094315.635060:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024373888 00000100:00100000:1.0:1784094315.635064:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024373888 00010000:00010000:1.0:1784094315.635122:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 19 pid: 5770 timeout: 1626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094315.635146:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1784094315.635153:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024373888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094315.635163:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094315.635169:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 19 pid: 5770 timeout: 1626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635180:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 19 pid: 5770 timeout: 1626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635192:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214cc5e9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc5e2 expref: 19 pid: 5770 timeout: 1626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635203:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635212:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635225:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635232:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635239:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635245:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635251:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094315.635254:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635261:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094315.635375:0:101338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094315.635381:0:101338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635676:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635685:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76800/0x9ce98053214cc5f0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094315.635696:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094315.635747:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024373888:12345-0@lo:103:ldlm_bl.0 Request processed in 587us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094315.635754:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784094315.635811:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024373888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094316.010054:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094316.048743:0:101387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb92b41b0 20000000:00000080:3.0:1784094316.048768:0:101387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907230e07800 uarg=0000000000000000 00010000:00010000:3.0:1784094316.049059:0:101387:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094316.049077:0:101387:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094316.049093:0:101387:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094316.049119:0:101387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049138:0:101387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049151:0:101387:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049159:0:101387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049172:0:101387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049181:0:101387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049189:0:101387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094316.049193:0:101387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049202:0:101387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049217:0:101387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049226:0:101387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094316.049233:0:101387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68a00/0x9ce98053214cc5f7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094316.521637:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094316.521661:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024374016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094316.521733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094316.521829:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374016 00000100:00100000:0.0:1784094316.521836:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374016 00000100:00100000:0.0:1784094316.521893:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:0.0:1784094316.521900:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024374016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094316.521928:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094316.521977:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024374016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094316.521982:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00080000:3.0:1784094316.522026:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094316.522052:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024374016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094317.033542:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784094317.483258:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094317.483267:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094317.483273:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094317.483320:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.483333:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.483346:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094317.483374:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024374144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094317.483531:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094317.483836:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094317.484093:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374144 00000100:00100000:1.0:1784094317.484104:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374144 00000100:00100000:1.0:1784094317.484177:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1784094317.484189:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024374144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094317.484204:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094317.484218:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc5fe expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.484239:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.484250:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.484258:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13800, rc 0) 00000100:00100000:1.0:1784094317.484818:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024374144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 630us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094317.484827:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1784094317.484941:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024374144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094317.484959:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.484969:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094317.484989:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094317.484994:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.485002:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094317.533321:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094317.533515:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888512 00000100:00100000:0.0:1784094317.533534:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888512 00000100:00080000:3.0:1784094317.533611:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094317.533650:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1107 00000100:00100000:0.0:1784094317.533666:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:60407:x1870757013888512:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094317.533694:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094317.533729:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc60c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e45 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.533828:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc613 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.533846:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.533859:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094317.534138:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094317.534143:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094317.534221:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.534262:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc60c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e45 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.534282:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e45 expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.534291:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094317.534295:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094317.534299:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76e00, rc 0) 00000100:00100000:0.0:1784094317.534380:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:60407:x1870757013888512:12345-192.168.204.57@tcp:101:rm.0 Request processed in 718us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094317.534388:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1107 00000100:00100000:2.0:1784094317.535722:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094317.535776:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888640 00000100:00100000:1.0:1784094317.535786:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888640 00000100:00100000:1.0:1784094317.535844:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1108 00000100:00100000:1.0:1784094317.535855:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:60407:x1870757013888640:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094317.535873:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094317.535889:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc61a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e4c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.535936:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.535955:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.535967:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536028:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536035:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536043:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536280:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536287:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536301:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536307:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094317.536311:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536318:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536330:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:1.0:1784094317.536333:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094317.536338:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536344:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536355:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536359:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536363:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536366:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094317.536367:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536374:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536379:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907219c12700) 00010000:00010000:1.0:1784094317.536380:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094317.536382:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536385:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536407:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc61a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e4c expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536414:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:1.0:1784094317.536415:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094317.536417:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc61a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e4c expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.536467:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094317.536534:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:60407:x1870757013888640:12345-192.168.204.57@tcp:101:rm.0 Request processed in 681us (817us total) trans 0 rc 301/301 00000100:00100000:1.0:1784094317.536542:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1108 00000100:00100000:0.0:1784094317.555984:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094317.556022:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013888768 00000100:00100000:3.0:1784094317.556033:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013888768 00000100:00100000:0.0:1784094317.556072:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094317.556091:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889024 00000100:00100000:3.0:1784094317.556096:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889024 00000100:00100000:0.0:1784094317.556116:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1109 00000100:00100000:3.0:1784094317.556126:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1110 00000100:00100000:0.0:1784094317.556132:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013888768:12345-192.168.204.57@tcp:41:mkdir.0 00000004:00000024:0.0:1784094317.556177:0:8381:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784094317.556183:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:60411:x1870757013889024:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:3.0:1784094317.556226:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094317.556257:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc613 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e45 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094317.556268:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013888768:12345-192.168.204.57@tcp:41:mkdir.0 Request processed in 141us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094317.556279:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1109 00010000:00010000:3.0:1784094317.556280:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:3.0:1784094317.556299:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094317.556579:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.556593:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.556603:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.556615:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.556622:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.556628:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094317.557973:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00010000:00010000:3.0:1784094317.557987:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.557998:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.558005:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.558012:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094317.558016:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.558024:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.558035:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce600) 00010000:00010000:3.0:1784094317.558038:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094317.558042:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.558048:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc62f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094317.558061:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e2668f0a reply state 0000000095c10fd0 transno 4294967719 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094317.558070:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094317.558145:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:60411:x1870757013889024:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 2005us (2072us total) trans 4294967719 rc 0/0 00000100:00100000:3.0:1784094317.558152:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1110 00010000:00010000:2.0:1784094317.561133:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.561145:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.561152:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.561156:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094317.561160:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.561164:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.561177:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fcee00) 00010000:00010000:2.0:1784094317.561178:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094317.561182:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.561185:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc636 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094317.581804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094317.581933:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889152 00000100:00100000:0.0:1784094317.581942:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889152 00000100:00100000:0.0:1784094317.581996:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1111 00000100:00100000:0.0:1784094317.582004:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:60415:x1870757013889152:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:0.0:1784094317.582024:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094317.582043:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc63d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e53 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.582091:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc644 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.582102:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.582110:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094317.582158:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094317.582160:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094317.582175:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc644 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.582191:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc63d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e53 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.582204:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc644 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e53 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.582210:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094317.582212:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094317.582214:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784094317.582276:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:60415:x1870757013889152:12345-192.168.204.57@tcp:101:chown.0 Request processed in 274us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094317.582280:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1111 00000100:00100000:0.0:1784094317.585183:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094317.585245:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889280 00000100:00100000:3.0:1784094317.585256:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889280 00000100:00100000:3.0:1784094317.585319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1112 00000100:00100000:3.0:1784094317.585330:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:60415:x1870757013889280:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784094317.585351:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094317.585375:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc64b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e5a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585463:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585492:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585505:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585520:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585527:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585533:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585632:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc660 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585641:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585649:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094317.585688:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00000004:00200000:3.0:1784094317.585691:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094317.585713:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585725:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585731:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585737:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585743:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094317.585747:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585755:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585765:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6be00) 00010000:00010000:3.0:1784094317.585768:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094317.585772:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585779:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585790:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585800:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585806:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585811:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094317.585814:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585820:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585828:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce600) 00010000:00010000:3.0:1784094317.585830:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094317.585833:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585839:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc659 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585879:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc64b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e5a expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585894:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e5a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.585901:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784094317.585904:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094317.585907:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094317.585989:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:60415:x1870757013889280:12345-192.168.204.57@tcp:101:chown.0 Request processed in 659us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094317.585996:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1112 00000100:00100000:1.0:1784094317.589891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094317.589947:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889536 00000100:00100000:3.0:1784094317.589958:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889536 00000100:00100000:3.0:1784094317.590018:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1113 00000100:00100000:3.0:1784094317.590030:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:60415:x1870757013889536:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:3.0:1784094317.590099:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094317.590133:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc660 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e5a expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.590156:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784094317.590169:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094317.590195:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.590209:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.590220:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094317.590504:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ef8b1fdd reply state 000000004030d979 transno 4294967720 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094317.590515:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094317.590530:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00000100:00100000:3.0:1784094317.590715:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:60415:x1870757013889536:12345-192.168.204.57@tcp:36:chown.0 Request processed in 686us (847us total) trans 4294967720 rc 0/0 00000100:00100000:3.0:1784094317.590724:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1113 00010000:00010000:0.0:1784094317.592803:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.592821:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.592829:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.592835:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094317.592840:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.592849:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.592867:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcef00) 00010000:00010000:0.0:1784094317.592870:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094317.592875:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.592882:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cc667 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094317.964411:0:101584:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff107d4c60 20000000:00000080:1.0:1784094317.964503:0:101584:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a7bc00 uarg=0000000000000000 00010000:00010000:1.0:1784094317.964977:0:101584:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094317.965013:0:101584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784094317.965017:0:101584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094317.965029:0:101584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc644 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e53 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.965052:0:101584:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1784094317.965068:0:101584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094317.965082:0:101584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.965096:0:101584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.965105:0:101584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.965141:0:101584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094317.965155:0:101584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 18 pid: 5770 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094317.965170:0:101584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101584:1870757024374272:0@lo:104: 00000100:00100000:1.0:1784094317.965230:0:101584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094317.965331:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374272 00000100:00100000:1.0:1784094317.965336:0:101584:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208f356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094317.965340:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374272 00000100:00100000:0.0:1784094317.965461:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1784094317.965486:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:101584:x1870757024374272:12345-0@lo:104: 00010000:00010000:0.0:1784094317.965500:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094317.965567:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094317.965574:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:101584:x1870757024374272:12345-0@lo:104: Request processed in 105us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094317.965581:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1784094317.965655:0:101584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101584:1870757024374272:0@lo:104: 00010000:00010000:1.0:1784094317.965672:0:101584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.965726:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094317.965733:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.965741:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094317.965745:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.965754:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094317.965761:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094317.965768:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094317.965835:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.965842:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094317.965872:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.965879:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41a00/0x9ce98053214cc5fe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc605 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094317.965888:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024374400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094317.965894:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094317.965897:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094317.965899:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094317.965923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094317.967169:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374400 00000100:00100000:2.0:1784094317.967178:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374400 00010000:00010000:2.0:1784094317.967205:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 19 pid: 5770 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094317.967240:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784094317.967248:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024374400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094317.967260:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094317.967266:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 19 pid: 5770 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967277:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 19 pid: 5770 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967291:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13800/0x9ce98053214cc605 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc5fe expref: 19 pid: 5770 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967314:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967322:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967337:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967343:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967350:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967357:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967363:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094317.967366:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967374:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967398:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094317.967408:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094317.967488:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024374400:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094317.967496:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1784094317.967611:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024374400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094317.968067:0:101584:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.968079:0:101584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094317.968086:0:101584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12800/0x9ce98053214cc66e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094318.059613:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094318.348478:0:101632:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc49c19920 20000000:00000080:0.0:1784094318.348496:0:101632:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907102d09400 uarg=0000000000000000 00010000:00010000:0.0:1784094318.348783:0:101632:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094318.348798:0:101632:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094318.348811:0:101632:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094318.348829:0:101632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348845:0:101632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348855:0:101632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348862:0:101632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348868:0:101632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348876:0:101632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348883:0:101632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094318.348887:0:101632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348895:0:101632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348907:0:101632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348914:0:101632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094318.348920:0:101632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214cc675 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094318.969290:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094318.969338:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094318.969482:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889664 00000100:00100000:2.0:1784094318.969508:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889664 00000100:00100000:2.0:1784094318.969562:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 932 00000100:00100000:2.0:1784094318.969573:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013889664:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094318.969599:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889792 00000100:00100000:0.0:1784094318.969604:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889792 00000100:00100000:0.0:1784094318.969637:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1023 00000100:00100000:0.0:1784094318.969645:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013889792:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094318.969808:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013889664:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 236us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094318.969812:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013889792:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 166us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094318.969820:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 932 00000100:00100000:0.0:1784094318.969825:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1023 00000100:00100000:1.0:1784094318.979516:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094318.979565:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094318.979633:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013889920 00000100:00100000:2.0:1784094318.979643:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013889920 00000100:00100000:3.0:1784094318.979666:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013890048 00000100:00100000:3.0:1784094318.979672:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013890048 00000100:00080000:1.0:1784094318.979721:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094318.979725:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 566 00000100:00080000:1.0:1784094318.979728:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094318.979744:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013889920:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:2.0:1784094318.979773:0:53396:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cbc9d 00000100:00080000:2.0:1784094318.979782:0:53396:0:(import.c:65:import_set_state_nolock()) ffff90723dc14000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784094318.979810:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 567 00000001:00000004:2.0:1784094318.979819:0:53396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:3.0:1784094318.979821:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013890048:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:3.0:1784094318.979841:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cbdb5 00010000:00010000:0.0:1784094318.979846:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784094318.979849:0:6574:0:(import.c:65:import_set_state_nolock()) ffff90723dc12800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784094318.979861:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784094318.979873:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:3.0:1784094318.980136:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013890048:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 316us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094318.980145:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 567 00000100:00100000:2.0:1784094318.980158:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013889920:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 417us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094318.980168:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 566 00010000:00010000:0.0:1784094319.082597:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094319.082672:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094319.082676:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094319.082682:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094319.082724:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094319.082736:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094319.082747:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094319.082775:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024374528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094319.082850:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094319.082895:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072083a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1784094319.082914:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374528 00000100:00100000:0.0:1784094319.082921:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374528 00000100:00100000:0.0:1784094319.082966:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1784094319.082975:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024374528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094319.082989:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094319.083003:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cc67c expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094319.083027:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cc67c expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094319.083038:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc67c expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094319.083046:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77600, rc 0) 00000100:00100000:0.0:1784094319.083088:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024374528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094319.083096:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1784094319.083125:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024374528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094319.083139:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094319.083146:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094319.083164:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094319.083167:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094319.083172:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094319.593625:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024374656:0@lo:400:kworker.0 00000100:00100000:0.0:1784094319.593642:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024375040:0@lo:400:kworker.0 00000100:00100000:1.0:1784094319.593777:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024374784:0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.594183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094319.594190:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024374912:0@lo:400:kworker.0 00000100:00100000:1.0:1784094319.594228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094319.594253:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024375168:0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.594282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094319.594310:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094319.594317:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024375296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094319.594325:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374912 00000100:00100000:1.0:1784094319.594333:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374912 00000100:00100000:3.0:1784094319.594342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094319.594373:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374656 00000100:00100000:3.0:1784094319.594378:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374656 00000100:00100000:1.0:1784094319.594396:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024375168 00000100:00100000:1.0:1784094319.594401:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024375168 00000100:00100000:3.0:1784094319.594416:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1784094319.594459:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1784094319.594464:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024374656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094319.594471:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024374912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.594520:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024374656:12345-0@lo:400:kworker.0 Request processed in 60us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094319.594528:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024374912:12345-0@lo:400:kworker.0 Request processed in 60us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094319.594529:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1784094319.594541:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1784094319.594559:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024375296 00000100:00100000:1.0:1784094319.594564:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1784094319.594565:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024375296 00000100:00100000:1.0:1784094319.594575:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.594595:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1784094319.594603:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024375296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094319.594618:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024375168:12345-0@lo:400:kworker.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094319.594625:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00002000:00000024:3.0:1784094319.594632:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784094319.594648:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094319.594653:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094319.594694:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024375296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094319.594696:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024374912:0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.594707:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1784094319.595225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094319.595227:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024375296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094319.595248:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024375168:0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.595262:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024374656:0@lo:400:kworker.0 00000100:00100000:1.0:1784094319.595276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094319.595298:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024374784 00000100:00100000:3.0:1784094319.595302:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024374784 00000100:00100000:3.0:1784094319.595334:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024375040 00000100:00100000:3.0:1784094319.595337:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024375040 00000100:00100000:3.0:1784094319.595356:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1784094319.595362:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024374784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094319.595403:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024374784:12345-0@lo:400:kworker.0 Request processed in 40us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094319.595409:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1784094319.595413:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1784094319.595455:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024375040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094319.595501:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024375040:12345-0@lo:400:kworker.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094319.595509:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1784094319.595519:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024375040:0@lo:400:kworker.0 00000100:00080000:1.0:1784094319.595666:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094319.595687:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024374784:0@lo:400:kworker.0 00000100:00100000:1.0:1784094319.751187:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094319.751699:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013890176 00000100:00100000:3.0:1784094319.751711:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013890176 00000100:00080000:1.0:1784094319.751751:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094319.751787:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 17 00000100:00100000:3.0:1784094319.751806:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:5559:x1870757013890176:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784094319.751822:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094319.751826:0:5763:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cc644) 00010000:00010000:3.0:1784094319.751828:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094319.751883:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:5559:x1870757013890176:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 79us (703us total) trans 0 rc 116/116 00000100:00100000:3.0:1784094319.751889:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 17 00010000:00010000:1.0:1784094320.105582:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094320.160563:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094320.160699:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013890304 00000100:00100000:3.0:1784094320.160709:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013890304 00000100:00100000:3.0:1784094320.160765:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1114 00000100:00100000:3.0:1784094320.160776:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:60519:x1870757013890304:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094320.160796:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094320.160820:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc68a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e61 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.160900:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc691 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.160915:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.160928:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094320.160992:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784094320.161005:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094320.161039:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.161065:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc68a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e61 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.161094:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e61 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.161107:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784094320.161110:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094320.161114:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784094320.161183:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:60519:x1870757013890304:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 408us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094320.161192:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1114 00000100:00100000:1.0:1784094320.162716:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094320.162781:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013890432 00000100:00100000:3.0:1784094320.162789:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013890432 00000100:00100000:3.0:1784094320.162869:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1115 00000100:00100000:3.0:1784094320.162879:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:60519:x1870757013890432:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094320.162895:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094320.162909:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e68 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.162955:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.162967:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.162977:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.162991:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.162999:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163011:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163101:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc6ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163109:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163116:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094320.163146:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 512 00000004:00200000:3.0:1784094320.163149:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094320.163167:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163177:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163184:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163191:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163197:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094320.163201:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163208:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163218:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784094320.163220:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094320.163224:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163230:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc69f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163239:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163258:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163264:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163268:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094320.163271:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163277:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163284:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce800) 00010000:00010000:3.0:1784094320.163286:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094320.163288:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163293:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163322:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e68 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163335:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc6ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e68 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.163347:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784094320.163349:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094320.163352:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094320.163408:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:60519:x1870757013890432:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 529us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094320.163415:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1115 00000100:00100000:0.0:1784094320.167185:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094320.168645:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013890688 00000100:00100000:3.0:1784094320.168657:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013890688 00000100:00100000:1.0:1784094320.171616:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1116 00000100:00100000:1.0:1784094320.174143:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:60519:x1870757013890688:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784094320.174196:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094320.174224:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cc6ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e68 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.174359:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784094320.174374:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094320.174403:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.174415:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.174691:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094320.211970:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000304dbbe9 reply state 0000000024365222 transno 4294967721 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.211988:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784094320.212119:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:1.0:1784094320.212216:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:60519:x1870757013890688:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 40585us (45036us total) trans 4294967721 rc 0/0 00000100:00100000:1.0:1784094320.212225:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1116 00000001:00080000:2.0:1784094320.212709:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967721 is committed 00010000:00010000:0.0:1784094320.213057:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.213068:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.213077:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.213084:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.213089:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.213098:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.213115:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12a00) 00010000:00010000:0.0:1784094320.213119:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094320.213125:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.213131:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc6b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094320.240536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094320.240700:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013890816 00000100:00100000:3.0:1784094320.240711:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013890816 00000100:00100000:3.0:1784094320.240809:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1117 00000100:00100000:3.0:1784094320.240820:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:60523:x1870757013890816:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094320.240846:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094320.240867:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc6bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e6f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.240930:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.240945:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.240961:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.240974:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.240982:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.240988:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241381:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241391:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241398:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094320.241523:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1784094320.241526:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094320.241599:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241613:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241619:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241630:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241636:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094320.241640:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241646:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241658:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784094320.241660:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094320.241665:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241670:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc6c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241682:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241689:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241694:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241699:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094320.241702:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241712:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241720:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce800) 00010000:00010000:3.0:1784094320.241722:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094320.241725:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241730:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc6c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241758:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc6bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e6f expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241772:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e6f expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.241780:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784094320.241782:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094320.241784:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094320.241853:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:60523:x1870757013890816:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1034us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094320.241860:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1117 00000100:00100000:2.0:1784094320.244368:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094320.244620:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013891072 00000100:00100000:3.0:1784094320.244631:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013891072 00000100:00100000:3.0:1784094320.244687:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1118 00000100:00100000:3.0:1784094320.244697:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:60523:x1870757013891072:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094320.244721:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094320.244739:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc6d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e76 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.245091:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.245105:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.245116:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.246515:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.246536:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.246547:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094320.249205:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23:0x0], index 0: 0 00010000:00010000:2.0:1784094320.249759:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc6ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249776:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc6ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249789:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc6ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249829:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249836:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249842:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249849:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.249853:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249859:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249871:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094320.249874:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.249878:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249882:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cc6de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094320.249897:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d2a2cd86 reply state 00000000d7cf9300 transno 4294967722 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.249904:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094320.249937:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc6d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e76 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249951:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc6ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e76 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.249957:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff90721a781000) 00010000:00010000:2.0:1784094320.249959:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094320.249961:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784094320.250100:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:60523:x1870757013891072:12345-192.168.204.57@tcp:101:touch.0 Request processed in 5401us (5737us total) trans 4294967722 rc 0/0 00000100:00100000:2.0:1784094320.250109:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1118 00010000:00010000:0.0:1784094320.251417:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.251459:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.251467:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.251474:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.251478:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.251485:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.251661:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907204fce100) 00010000:00010000:0.0:1784094320.251665:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.251670:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.251677:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cc6e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.252262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094320.252497:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013891328 00000100:00100000:1.0:1784094320.252507:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013891328 00000100:00100000:1.0:1784094320.252567:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1119 00000100:00100000:1.0:1784094320.252579:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:60523:x1870757013891328:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:1.0:1784094320.252629:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094320.252648:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc6ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e76 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.252663:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff90721a781000) 00010000:00010000:1.0:1784094320.252671:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094320.252707:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.252720:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.252730:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094320.252852:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000023f4f06e reply state 000000000efdf01c transno 4294967723 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.252862:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094320.252951:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:60523:x1870757013891328:12345-192.168.204.57@tcp:36:touch.0 Request processed in 374us (689us total) trans 4294967723 rc 0/0 00000100:00100000:1.0:1784094320.252959:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1119 00000100:00100000:3.0:1784094320.255950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:0.0:1784094320.255981:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.255994:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.256000:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013891456 00010000:00010000:0.0:1784094320.256002:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.256011:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00000100:00100000:1.0:1784094320.256012:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013891456 00010000:00010000:0.0:1784094320.256017:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.256026:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.256042:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff907219c12d00) 00010000:00010000:0.0:1784094320.256046:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.256051:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.256058:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc6fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.256064:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1120 00000100:00100000:1.0:1784094320.256074:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:60523:x1870757013891456:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:1.0:1784094320.256095:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094320.256111:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e7d expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.256153:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e7d expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.256162:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e7d expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.256176:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff907219c12400) 00010000:00010000:1.0:1784094320.256179:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094320.256182:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094320.256242:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:60523:x1870757013891456:12345-192.168.204.57@tcp:101:touch.0 Request processed in 168us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094320.256249:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1120 00000100:00100000:2.0:1784094320.257970:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094320.259206:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013891584 00000100:00100000:0.0:1784094320.259220:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013891584 00000100:00100000:0.0:1784094320.259260:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 568 00000100:00100000:0.0:1784094320.259269:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2351:x1870757013891584:12345-192.168.204.57@tcp:8:touch.0 00010000:00080000:0.0:1784094320.259298:0:53396:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 1481 last 0 00000020:00000080:0.0:1784094320.259327:0:53396:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214cc708 00002000:00100000:0.0:1784094320.259339:0:53396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff907102d93800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784094320.259365:0:53396:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784094320.259483:0:53396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784094320.259513:0:53396:0:(import.c:65:import_set_state_nolock()) ffff907102d92000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784094320.259584:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013891584:12345-192.168.204.57@tcp:8:touch.0 Request processed in 315us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094320.259592:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 568 00000100:00100000:2.0:1784094320.263653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094320.263733:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013891712 00000100:00100000:3.0:1784094320.263745:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013891712 00000100:00080000:1.0:1784094320.263815:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094320.263824:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 569 00000100:00100000:3.0:1784094320.263836:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:0:x1870757013891712:12345-192.168.204.57@tcp:2:touch.0 00000001:00100000:0.0:1784094320.281319:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000001:00100000:0.0:1784094320.281413:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:0.0:1784094320.281417:0:6598:0:(genops.c:906:class_export_put()) final put ffff90723dc11000/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784094320.281732:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff90723dc11000/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0000 00000020:00000080:2.0:1784094320.281784:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90723dc14000 for lustre-OST0000 00000001:00080000:0.0:1784094320.281843:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000100:00100000:2.0:1784094320.282225:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:0:x1870757013891712:12345-192.168.204.57@tcp:2:touch.0 Request processed in 18386us (18576us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784094320.282235:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 569 00000100:00100000:3.0:1784094320.285515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094320.285570:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013891968 00000100:00100000:0.0:1784094320.285580:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013891968 00000100:00100000:0.0:1784094320.285662:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 114 00000100:00100000:0.0:1784094320.285673:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:60523:x1870757013891968:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:0.0:1784094320.286014:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:60523:x1870757013891968:12345-192.168.204.57@tcp:35:touch.0 Request processed in 343us (519us total) trans 4294967724 rc 0/0 00000100:00100000:0.0:1784094320.286024:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 114 00000100:00100000:0.0:1784094320.320067:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.320171:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013892096 00000100:00100000:2.0:1784094320.320182:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013892096 00000100:00100000:2.0:1784094320.320299:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1121 00000100:00100000:2.0:1784094320.320312:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:60527:x1870757013892096:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094320.320335:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094320.320356:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc70f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e84 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320470:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320486:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320499:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320523:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320530:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320537:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320628:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320650:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320658:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094320.320700:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 0 00000004:00200000:2.0:1784094320.320705:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094320.320722:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320732:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320741:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320746:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320753:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320759:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.320763:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320771:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320783:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094320.320787:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.320791:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320797:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cc716 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320816:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320822:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320828:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320833:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.320836:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320842:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320850:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff90721a781a00) 00010000:00010000:2.0:1784094320.320852:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.320860:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320866:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214cc71d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320897:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214cc70f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e84 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320911:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e84 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.320925:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff907219c12400) 00010000:00010000:2.0:1784094320.320928:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094320.320930:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40800, rc 0) 00000100:00100000:2.0:1784094320.320998:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:60527:x1870757013892096:12345-192.168.204.57@tcp:101:rm.0 Request processed in 689us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094320.321006:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1121 00000100:00100000:2.0:1784094320.327984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094320.328383:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013892224 00000100:00100000:1.0:1784094320.328393:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013892224 00000100:00100000:1.0:1784094320.328519:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 570 00000100:00100000:1.0:1784094320.328530:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013892224:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094320.328549:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094320.328570:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e8b expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094320.328602:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x6a571e70, atime: 0x6a571e70, ctime: 0x6a571e70, blocks: 0x1 00010000:00010000:1.0:1784094320.328622:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=1481s v=(0 0) 00010000:00010000:1.0:1784094320.328627:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094320.328635:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.328652:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.328663:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094320.328728:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013892224:12345-192.168.204.57@tcp:101:rm.0 Request processed in 200us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094320.328734:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 570 00000100:00100000:3.0:1784094320.332129:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094320.332791:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013892480 00000100:00100000:0.0:1784094320.332802:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013892480 00000100:00100000:0.0:1784094320.332870:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1122 00000100:00100000:0.0:1784094320.332881:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:60527:x1870757013892480:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094320.332935:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094320.332964:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214cc724 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e84 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.332996:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e7d expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333007:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff907219c12400) 00010000:00010000:0.0:1784094320.333019:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094320.333040:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333054:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333064:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333092:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333101:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333108:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333213:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333221:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.333229:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094320.335701:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10432 00000004:00080000:0.0:1784094320.335725:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1481413302228ns, next at 1482413296791ns, rc = 0 00010000:00010000:0.0:1784094320.335980:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.335997:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336007:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336016:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336022:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336028:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336055:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094320.336083:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336090:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336097:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.336101:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094320.336104:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.336110:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336111:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.336130:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094320.336132:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.336136:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336147:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094320.336152:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094320.336158:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336158:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336175:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc740 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.336180:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff907202e6b000) 00010000:00010000:2.0:1784094320.336184:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094320.336188:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.336194:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc747 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336197:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336205:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336212:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.336215:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094320.336218:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094320.336220:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.336222:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094320.336225:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336233:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336242:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcea00) 00010000:00010000:0.0:1784094320.336244:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.336248:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.336254:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc732 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094320.336263:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000089ad3ac reply state 0000000034210585 transno 4294967725 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094320.336272:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094320.336356:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:60527:x1870757013892480:12345-192.168.204.57@tcp:36:rm.0 Request processed in 3474us (4232us total) trans 4294967725 rc 0/0 00000100:00100000:0.0:1784094320.336365:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1122 00010000:00010000:0.0:1784094320.340110:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.340127:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.340134:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.340140:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.340146:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.340153:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.340168:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907202e6bf00) 00010000:00010000:0.0:1784094320.340172:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.340176:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.340182:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094320.795285:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094320.796837:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013892608 00000100:00100000:0.0:1784094320.796851:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013892608 00000100:00100000:0.0:1784094320.796914:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1123 00000100:00100000:0.0:1784094320.796924:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:60543:x1870757013892608:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094320.796951:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094320.796973:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc74e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.797034:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.797048:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.797061:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094320.797119:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1784094320.797123:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094320.797146:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.797169:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc74e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e92 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.797185:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e92 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.797195:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcea00) 00010000:00010000:0.0:1784094320.797198:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094320.797202:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77200, rc 0) 00000100:00100000:0.0:1784094320.797268:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:60543:x1870757013892608:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 345us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094320.797276:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1123 00000100:00100000:3.0:1784094320.799317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.799367:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013892864 00000100:00100000:2.0:1784094320.799376:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013892864 00000100:00100000:2.0:1784094320.799461:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1124 00000100:00100000:2.0:1784094320.799472:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:60543:x1870757013892864:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094320.799519:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094320.799548:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e92 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.799577:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e6f expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.799589:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094320.799602:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094320.799627:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.799645:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.799656:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094320.821896:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967725 is committed 00000004:00080000:1.0:1784094320.821906:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00000004:00010000:3.0:1784094320.821910:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ebd2050d reply state 00000000a7d1c89f transno 4294967726 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094320.821925:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784094320.821928:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967726 is committed 00000004:00200000:3.0:1784094320.822093:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00080000:3.0:1784094320.822186:0:5809:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784094320.822189:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024375424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784094320.822234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094320.822272:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024375424 00000100:00100000:0.0:1784094320.822280:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024375424 00000100:00100000:3.0:1784094320.822281:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:60543:x1870757013892864:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 22808us (22968us total) trans 4294967726 rc 0/0 00000100:00100000:3.0:1784094320.822293:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1124 00010000:00010000:3.0:1784094320.822338:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094320.822338:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00010000:00010000:3.0:1784094320.822351:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094320.822351:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024375424:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784094320.822366:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.822373:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094320.822379:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784094320.822380:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:35 count 1 00010000:00010000:3.0:1784094320.822391:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.822402:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.822406:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff90721a781a00) 00010000:00010000:3.0:1784094320.822413:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094320.822458:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.822459:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 5 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.822484:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094320.822486:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc75c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.822494:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094320.822500:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.822530:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 5 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.822551:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 5 pid: 6574 timeout: 1581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094320.822564:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024375552:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784094320.822607:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720133aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784094320.824604:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024375552:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094320.824635:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094320.824768:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094320.825475:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013892992 00000100:00100000:1.0:1784094320.825485:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013892992 00010000:00010000:1.0:1784094320.825519:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 6 pid: 6574 timeout: 1581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.825557:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 360 00000100:00100000:1.0:1784094320.825568:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013892992:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094320.825584:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094320.825590:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 6 pid: 6574 timeout: 1581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825605:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 6 pid: 6574 timeout: 1581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825628:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a723999d/0x9ce98053214cc72b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e8b expref: 6 pid: 6574 timeout: 1581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825643:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094320.825648:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094320.825654:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825664:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825687:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094320.825709:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.825722:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.825732:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013892992:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 163us (962us total) trans 0 rc 0/0 00010000:00010000:0.0:1784094320.825736:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094320.825744:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 360 00010000:00010000:0.0:1784094320.825752:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.825774:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094320.825785:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094320.825792:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825805:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094320.825810:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825819:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825833:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825840:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087c1fe2e/0x9ce98053214cc763 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094320.825854:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094320.825855:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094320.825856:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094320.826377:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024375424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4028us (4141us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1784094320.826391:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000004:00080000:1.0:1784094320.826498:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230a52d80/2, rc 0, transno 4294967367 00000100:00100000:1.0:1784094320.826505:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024375424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784094320.853861:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094320.853917:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013893120 00000100:00100000:0.0:1784094320.853926:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013893120 00000100:00100000:0.0:1784094320.854049:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1125 00000100:00100000:0.0:1784094320.854062:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:60547:x1870757013893120:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094320.854089:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094320.854111:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc76a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5e99 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854167:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854182:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854194:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854209:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854217:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854224:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854673:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc77f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854687:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854694:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094320.854776:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1784094320.854781:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094320.854859:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc77f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854871:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854878:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854884:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854890:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.854894:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854902:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854914:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:0.0:1784094320.854917:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.854922:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854933:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854944:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854950:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854955:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854960:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.854962:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854967:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.854974:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907202e6bf00) 00010000:00010000:0.0:1784094320.854976:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.854979:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.855121:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc778 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.855158:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc76a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e99 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.855172:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc77f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e99 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.855180:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094320.855182:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094320.855185:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784094320.855246:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:60547:x1870757013893120:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1186us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094320.855254:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1125 00000100:00100000:3.0:1784094320.857655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.857741:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013893376 00000100:00100000:2.0:1784094320.857751:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013893376 00000100:00100000:2.0:1784094320.857854:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1126 00000100:00100000:2.0:1784094320.857865:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:60547:x1870757013893376:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784094320.857884:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094320.857904:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc786 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ea0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.858198:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.858213:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.858225:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.858240:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.858248:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.858255:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094320.859078:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:2.0:1784094320.859352:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc79b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859363:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859372:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859404:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859456:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859464:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859471:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.859476:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859483:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859495:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b800) 00010000:00010000:2.0:1784094320.859499:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.859504:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859511:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc78d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094320.859524:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000068b0cd9c reply state 00000000ecca1b5c transno 4294967727 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.859533:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094320.859559:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc786 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ea0 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859572:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc79b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ea0 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.859585:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff90721a781500) 00010000:00010000:2.0:1784094320.859587:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094320.859589:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094320.859659:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:60547:x1870757013893376:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1795us (2011us total) trans 4294967727 rc 0/0 00000100:00100000:2.0:1784094320.859667:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1126 00000100:00100000:3.0:1784094320.861948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:0.0:1784094320.861956:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.861968:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.861976:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.861983:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.861987:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.861995:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.862011:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff90721a781e00) 00010000:00010000:0.0:1784094320.862015:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784094320.862020:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013893632 00010000:00010000:0.0:1784094320.862020:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.862030:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013893632 00010000:00010000:0.0:1784094320.862030:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc794 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.862077:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1127 00000100:00100000:2.0:1784094320.862084:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:60547:x1870757013893632:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:2.0:1784094320.862123:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094320.862137:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc79b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ea0 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.862146:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff90721a781500) 00010000:00010000:2.0:1784094320.862151:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094320.862178:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.862187:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.862192:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094320.862290:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000003886d36f reply state 0000000033b29b16 transno 4294967728 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.862304:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094320.862376:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:60547:x1870757013893632:12345-192.168.204.57@tcp:36:touch.0 Request processed in 292us (433us total) trans 4294967728 rc 0/0 00000100:00100000:2.0:1784094320.862381:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1127 00010000:00010000:0.0:1784094320.863678:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.863691:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.863698:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.863704:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094320.863708:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.863714:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.863725:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff90721a781d00) 00010000:00010000:0.0:1784094320.863728:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094320.863731:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.863737:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cc7a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094320.864709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094320.864746:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013893760 00000100:00100000:0.0:1784094320.864755:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013893760 00000100:00100000:0.0:1784094320.864803:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1128 00000100:00100000:0.0:1784094320.864813:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:60547:x1870757013893760:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094320.864834:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094320.864851:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc7b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ea7 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.864902:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc7b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ea7 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.864916:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc7b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ea7 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.864932:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:0.0:1784094320.864935:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784094320.864938:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784094320.864982:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:60547:x1870757013893760:12345-192.168.204.57@tcp:101:touch.0 Request processed in 170us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094320.864988:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1128 00000100:00100000:3.0:1784094320.866401:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.866461:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013893888 00000100:00100000:2.0:1784094320.866468:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013893888 00000100:00100000:2.0:1784094320.866507:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:2.0:1784094320.866514:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1870757013893888:12345-192.168.204.57@tcp:8:touch.0 00010000:00080000:2.0:1784094320.866605:0:6573:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp t0 exp 0000000000000000 cur 1481 last 0 00000020:00000080:2.0:1784094320.866631:0:6573:0:(genops.c:1406:class_connect()) connect: client d859d42d-5b91-4307-b8c2-f99991427baa, cookie 0x9ce98053214cc7b7 00002000:00100000:2.0:1784094320.866643:0:6573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d859d42d-5b91-4307-b8c2-f99991427baa/ffff90723d245800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 10223616 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784094320.866655:0:6573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784094320.866761:0:6573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784094320.866787:0:6573:0:(import.c:65:import_set_state_nolock()) ffff90723d246000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784094320.866843:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013893888:12345-192.168.204.57@tcp:8:touch.0 Request processed in 327us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094320.866850:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 572 00000100:00100000:3.0:1784094320.868304:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094320.868484:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013894016 00000100:00100000:1.0:1784094320.868583:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013894016 00000100:00080000:2.0:1784094320.868668:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094320.868701:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 573 00000100:00100000:1.0:1784094320.868712:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:0:x1870757013894016:12345-192.168.204.57@tcp:2:touch.0 00000001:00080000:3.0:1784094320.885557:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00000001:00100000:3.0:1784094320.885577:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000001:00100000:3.0:1784094320.885585:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:3.0:1784094320.885654:0:7469:0:(genops.c:906:class_export_put()) final put ffff90723dc12000/d859d42d-5b91-4307-b8c2-f99991427baa 00000100:00100000:1.0:1784094320.885668:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:0:x1870757013894016:12345-192.168.204.57@tcp:2:touch.0 Request processed in 16953us (17363us total) trans 4294967366 rc 0/0 00000020:00000080:3.0:1784094320.885680:0:73479:0:(genops.c:865:class_export_destroy()) destroying export ffff90723dc12000/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0001 00000100:00100000:1.0:1784094320.885683:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 573 00000020:00000080:3.0:1784094320.885718:0:73479:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90723dc12800 for lustre-OST0001 00000100:00100000:3.0:1784094320.887556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094320.887634:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013894272 00000100:00100000:1.0:1784094320.887643:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013894272 00000100:00100000:1.0:1784094320.887782:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 115 00000100:00100000:1.0:1784094320.887792:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:60547:x1870757013894272:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:1.0:1784094320.888082:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:60547:x1870757013894272:12345-192.168.204.57@tcp:35:touch.0 Request processed in 291us (532us total) trans 4294967729 rc 0/0 00000100:00100000:1.0:1784094320.888089:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 115 00000100:00100000:0.0:1784094320.918721:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.918862:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013894400 00000100:00100000:2.0:1784094320.918872:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013894400 00000100:00100000:2.0:1784094320.918935:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1129 00000100:00100000:2.0:1784094320.918946:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:60551:x1870757013894400:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094320.918970:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094320.918989:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5eae expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919051:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919065:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919076:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919089:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919095:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919101:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919192:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919200:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919207:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094320.919240:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5d:0x0]: returning size 0 00000004:00200000:2.0:1784094320.919244:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094320.919262:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919276:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919283:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919289:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919296:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919302:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.919305:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919312:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919323:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b800) 00010000:00010000:2.0:1784094320.919326:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.919330:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919334:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919347:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919353:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919358:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919363:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.919365:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919371:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919377:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff90721a781b00) 00010000:00010000:2.0:1784094320.919379:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.919382:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919387:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214cc7cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919608:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eae expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919626:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eae expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.919632:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:2.0:1784094320.919635:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094320.919638:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094320.919700:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:60551:x1870757013894400:12345-192.168.204.57@tcp:101:rm.0 Request processed in 755us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094320.919711:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1129 00000100:00100000:0.0:1784094320.926161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.926216:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013894528 00000100:00100000:2.0:1784094320.926226:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013894528 00000100:00100000:2.0:1784094320.926292:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 574 00000100:00100000:2.0:1784094320.926303:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013894528:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094320.926321:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094320.926342:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5eb5 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094320.926374:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x6a571e71, atime: 0x6a571e71, ctime: 0x6a571e71, blocks: 0x1 00010000:00010000:2.0:1784094320.926412:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1482s v=(0 0) 00010000:00010000:2.0:1784094320.926462:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094320.926472:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.926492:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.926507:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784094320.926572:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013894528:12345-192.168.204.57@tcp:101:rm.0 Request processed in 271us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094320.926579:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 574 00000100:00100000:3.0:1784094320.929953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094320.930047:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013894784 00000100:00100000:2.0:1784094320.930057:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013894784 00000100:00100000:2.0:1784094320.930145:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1130 00000100:00100000:2.0:1784094320.930156:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:60551:x1870757013894784:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784094320.930208:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094320.930236:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc7d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eae expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930264:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77000/0x9ce98053214cc7b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ea7 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930275:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:2.0:1784094320.930289:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094320.930308:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930319:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930326:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930335:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930339:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930343:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930592:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930600:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.930608:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094320.931117:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10432 00000004:00080000:2.0:1784094320.931128:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1482008705399ns, next at 1483008703294ns, rc = 0 00010000:00010000:2.0:1784094320.931195:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931204:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931212:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931218:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931224:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931230:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931292:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094320.931311:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931318:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931324:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931330:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.931334:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931341:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931349:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784094320.931352:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094320.931355:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931361:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc7ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931376:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931382:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931388:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931393:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094320.931396:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931402:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931413:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b800) 00010000:00010000:2.0:1784094320.931449:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094320.931452:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094320.931458:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cc7e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094320.931468:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000cc05102c reply state 00000000fc0b319e transno 4294967730 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094320.931477:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094320.931560:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:60551:x1870757013894784:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1405us (1613us total) trans 4294967730 rc 0/0 00000100:00100000:2.0:1784094320.931568:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1130 00010000:00010000:0.0:1784094320.931772:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094320.931779:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.931785:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094320.931789:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.931795:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.931803:0:5766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff90721a781600) 00010000:00010000:0.0:1784094320.931805:0:5766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784094320.931809:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.931815:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214cc7f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094320.931827:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094320.931829:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094320.931831:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094320.932924:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.932936:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.932943:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.932949:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094320.932954:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.932961:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.932972:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff90721a781800) 00010000:00010000:3.0:1784094320.932975:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094320.932979:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094320.932985:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214cc7e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.129678:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094321.424737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094321.425341:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013894912 00000100:00100000:0.0:1784094321.425351:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013894912 00000100:00080000:1.0:1784094321.425447:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094321.425502:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1131 00000100:00100000:0.0:1784094321.425514:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:60565:x1870757013894912:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094321.425537:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094321.425557:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ebc expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.425618:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.425632:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.425643:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094321.425701:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1784094321.425706:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094321.425729:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.425754:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ebc expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.425769:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ebc expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.425777:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094321.425780:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094321.425784:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77800, rc 0) 00000100:00100000:0.0:1784094321.425847:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:60565:x1870757013894912:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 336us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094321.425853:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1131 00000100:00100000:0.0:1784094321.428009:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094321.428253:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895168 00000100:00100000:2.0:1784094321.428260:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895168 00000100:00100000:2.0:1784094321.428301:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1132 00000100:00100000:2.0:1784094321.428310:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:60565:x1870757013895168:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:2.0:1784094321.428361:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094321.428386:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ebc expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.428415:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc77f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e99 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.428440:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b800) 00010000:00010000:2.0:1784094321.428453:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094321.428477:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.428488:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.428498:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094321.428731:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f01bc6c7 reply state 0000000030b33388 transno 4294967731 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094321.428741:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784094321.428754:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:2.0:1784094321.428835:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:60565:x1870757013895168:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 525us (832us total) trans 4294967731 rc 0/0 00000100:00100000:2.0:1784094321.428842:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1132 00010000:00010000:0.0:1784094321.430852:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.430866:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.430879:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.430886:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094321.430890:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.430898:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.430912:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff90721a781300) 00010000:00010000:0.0:1784094321.430916:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094321.430921:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.430927:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cc80b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094321.499328:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094321.499487:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895296 00000100:00100000:2.0:1784094321.499496:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895296 00000100:00100000:2.0:1784094321.499557:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1133 00000100:00100000:2.0:1784094321.499567:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013895296:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094321.499710:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013895296:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 143us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094321.499720:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1133 00000100:00100000:2.0:1784094321.501615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.501746:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895424 00000100:00100000:1.0:1784094321.501755:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895424 00000100:00100000:1.0:1784094321.501813:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 575 00000100:00100000:1.0:1784094321.501822:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:60577:x1870757013895424:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094321.502118:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:60577:x1870757013895424:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 296us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094321.502125:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 575 00000100:00100000:3.0:1784094321.504593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.504745:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895552 00000100:00100000:1.0:1784094321.504752:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895552 00000100:00100000:1.0:1784094321.504793:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 576 00000100:00100000:1.0:1784094321.504800:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:60577:x1870757013895552:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094321.505071:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:60577:x1870757013895552:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 270us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094321.505076:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 576 00000100:00100000:2.0:1784094321.507833:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094321.508014:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895680 00000100:00100000:0.0:1784094321.508023:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895680 00000100:00100000:0.0:1784094321.508100:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1134 00000100:00100000:0.0:1784094321.508115:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013895680:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094321.508657:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013895680:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 546us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094321.508666:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1134 00000100:00100000:3.0:1784094321.511680:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094321.511743:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895808 00000100:00100000:2.0:1784094321.511752:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895808 00000100:00100000:2.0:1784094321.511805:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1135 00000100:00100000:2.0:1784094321.511815:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013895808:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094321.512013:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013895808:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 200us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094321.512021:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1135 00000100:00100000:3.0:1784094321.513584:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.513644:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013895936 00000100:00100000:1.0:1784094321.513653:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013895936 00000100:00100000:1.0:1784094321.513707:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 577 00000100:00100000:1.0:1784094321.513717:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:60577:x1870757013895936:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094321.514061:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:60577:x1870757013895936:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 345us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094321.514069:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 577 00000100:00100000:0.0:1784094321.515480:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.515672:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896064 00000100:00100000:1.0:1784094321.515682:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896064 00000100:00100000:1.0:1784094321.515772:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 578 00000100:00100000:1.0:1784094321.515784:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:60577:x1870757013896064:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094321.516102:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:60577:x1870757013896064:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 321us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094321.516118:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 578 00000100:00100000:3.0:1784094321.517813:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094321.518286:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896192 00000100:00100000:2.0:1784094321.518296:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896192 00000100:00100000:2.0:1784094321.518354:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1136 00000100:00100000:2.0:1784094321.518365:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013896192:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094321.519590:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:60577:x1870757013896192:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 1214us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094321.519602:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1136 00000100:00100000:3.0:1784094321.554086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094321.554389:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896320 00000100:00100000:0.0:1784094321.554411:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896320 00000100:00100000:0.0:1784094321.554511:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1137 00000100:00100000:0.0:1784094321.554522:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:60581:x1870757013896320:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:0.0:1784094321.554541:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094321.554562:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ec3 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.554634:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.554648:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.554659:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.554675:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.554682:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094321.554688:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555046:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555056:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555064:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094321.555091:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:1.0:1784094321.555096:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094321.555117:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555128:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555140:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555147:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555153:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094321.555157:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555165:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555176:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:1.0:1784094321.555179:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094321.555183:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555195:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555206:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555213:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555219:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555224:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094321.555227:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555233:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555239:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907202e6b700) 00010000:00010000:1.0:1784094321.555242:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094321.555245:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555251:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc820 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555293:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ec3 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555306:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ec3 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.555314:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12700) 00010000:00010000:1.0:1784094321.555316:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094321.555318:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094321.555387:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:60581:x1870757013896320:12345-192.168.204.57@tcp:101:dd.0 Request processed in 867us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094321.555394:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1137 00000100:00100000:0.0:1784094321.562515:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094321.562630:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896576 00000100:00100000:2.0:1784094321.562640:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896576 00000100:00100000:2.0:1784094321.562699:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1138 00000100:00100000:2.0:1784094321.562710:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:60581:x1870757013896576:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094321.562731:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094321.562751:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc82e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5eca expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.562878:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.562893:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.562905:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.562919:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.562928:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.562934:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094321.563389:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24:0x0], index 0: 0 00010000:00010000:2.0:1784094321.563593:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563602:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563609:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563637:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563645:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563651:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563658:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094321.563662:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563668:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563682:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12700) 00010000:00010000:2.0:1784094321.563685:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094321.563689:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563696:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cc835 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094321.563707:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000582f3a35 reply state 00000000594a9acb transno 4294967732 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094321.563716:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094321.563747:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cc82e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eca expref: 15 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563762:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eca expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.563769:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff90721a781200) 00010000:00010000:2.0:1784094321.563772:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784094321.563774:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094321.563846:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+15:60581:x1870757013896576:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1138us (1338us total) trans 4294967732 rc 0/0 00000100:00100000:2.0:1784094321.563853:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1138 00010000:00010000:3.0:1784094321.565229:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094321.565241:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094321.565248:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094321.565254:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094321.565258:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094321.565266:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094321.565277:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff90721a781400) 00010000:00010000:3.0:1784094321.565280:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094321.565284:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094321.565290:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214cc83c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094321.567484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094321.567562:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896704 00000100:00100000:2.0:1784094321.567572:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896704 00000100:00100000:2.0:1784094321.567694:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:2.0:1784094321.567705:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:60581:x1870757013896704:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094321.567725:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094321.567745:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ed1 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094321.567770:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784094321.567790:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=1482s v=(0 0) 00010000:00010000:2.0:1784094321.567795:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094321.567804:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.567821:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 6 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.567833:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41600, rc 0) 00000100:00100000:2.0:1784094321.567902:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:60581:x1870757013896704:12345-192.168.204.57@tcp:101:dd.0 Request processed in 200us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094321.567910:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 579 00000100:00100000:2.0:1784094321.578164:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.578288:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896832 00000100:00100000:1.0:1784094321.578299:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896832 00002000:00100000:1.0:1784094321.578352:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff90723d23f480 x1870757013896832/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:642/0 lens 488/0 e 0 to 0 dl 1784094332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784094321.578370:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d23f480 with x1870757013896832 ext(0->1048575) 00002000:00010000:1.0:1784094321.578376:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90723d23f480 00000100:00100000:0.0:1784094321.578497:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 28 00000100:00100000:0.0:1784094321.578509:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013896832:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:3.0:1784094321.592658:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013896832:12345-192.168.204.57@tcp:4:dd.0 Request processed in 14140us (14490us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1784094321.592673:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 28 00002000:00100000:3.0:1784094321.592685:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff90723d23f480 x1870757013896832/t4294967368(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:642/0 lens 488/448 e 0 to 0 dl 1784094332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784094321.592696:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d23f480 with x1870757013896832 ext(0->1048575) 00002000:00010000:3.0:1784094321.592702:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90723d23f480 00000100:00100000:2.0:1784094321.595340:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094321.595452:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013896960 00000100:00100000:3.0:1784094321.595461:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013896960 00000100:00100000:3.0:1784094321.595521:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1139 00000100:00100000:3.0:1784094321.595531:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+14:60581:x1870757013896960:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:2.0:1784094321.623349:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967729 is committed 00000001:00080000:0.0:1784094321.623419:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967732 is committed 00000004:00080000:0.0:1784094321.623459:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000100:00100000:2.0:1784094321.623592:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094321.623611:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024375680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094321.623658:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:60581:x1870757013896960:12345-192.168.204.57@tcp:44:dd.0 Request processed in 28124us (28322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094321.623667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094321.623674:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1139 00000100:00100000:2.0:1784094321.623726:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024375680 00000100:00100000:2.0:1784094321.623733:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024375680 00000100:00100000:2.0:1784094321.623787:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1784094321.623796:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024375680:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1784094321.623821:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1784094321.623822:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:2.0:1784094321.623847:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.623867:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 5 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.623876:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094321.623880:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094321.623885:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.623912:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 5 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.623926:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 5 pid: 53396 timeout: 1582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094321.623938:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024375808:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094321.623990:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff907208f6c540 going to sleep for 11 seconds 00000100:00100000:2.0:1784094321.625374:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.625455:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897088 00000100:00100000:1.0:1784094321.625463:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897088 00000100:00100000:2.0:1784094321.625533:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 581 00000100:00100000:2.0:1784094321.625544:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013897088:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:2.0:1784094321.626292:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024375808:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094321.626313:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094321.626494:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094321.626544:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897216 00000100:00100000:1.0:1784094321.626549:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897216 00010000:00010000:1.0:1784094321.626568:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 6 pid: 53396 timeout: 1582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094321.626595:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 361 00000100:00100000:1.0:1784094321.626603:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013897216:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094321.626614:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094321.626620:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 6 pid: 53396 timeout: 1582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.626634:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 6 pid: 53396 timeout: 1582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.626654:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b4dc89/0x9ce98053214cc7da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eb5 expref: 6 pid: 53396 timeout: 1582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.626674:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094321.626678:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094321.626683:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.626693:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094321.626718:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094321.626749:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013897216:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 148us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094321.626754:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 361 00010000:00010000:2.0:1784094321.627154:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627164:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627174:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627182:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627198:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784094321.627788:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024375680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3991us (4120us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1784094321.627798:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00010000:00010000:2.0:1784094321.627825:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094321.627833:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627843:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094321.627848:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627858:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627875:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627883:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934d20c9/0x9ce98053214cc858 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094321.627901:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094321.627903:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094321.627904:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094321.627937:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723d23ea00/2, rc 0, transno 4294967367 00000100:00100000:2.0:1784094321.627943:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024375680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784094321.641576:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024375936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094321.641644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094321.641681:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024375936 00000100:00100000:0.0:1784094321.641689:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024375936 00000100:00080000:1.0:1784094321.641742:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094321.641743:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1784094321.641755:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024375936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094321.641783:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094321.641840:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024375936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094321.641849:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1784094321.641874:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024375936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094321.642976:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013897088:12345-192.168.204.57@tcp:16:dd.0 Request processed in 17430us (17602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094321.642987:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 581 00000001:00080000:0.0:1784094321.643127:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000001:00080000:0.0:1784094321.643143:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000100:00100000:3.0:1784094321.644723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094321.644790:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897472 00000100:00100000:0.0:1784094321.644799:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897472 00000100:00100000:0.0:1784094321.644848:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 116 00000100:00100000:0.0:1784094321.644858:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:60581:x1870757013897472:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:0.0:1784094321.645305:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:60581:x1870757013897472:12345-192.168.204.57@tcp:35:dd.0 Request processed in 448us (587us total) trans 4294967733 rc 0/0 00000100:00100000:0.0:1784094321.645313:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 116 00010000:00010000:1.0:1784094322.155025:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094322.216662:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967733 is committed 00000004:00080000:2.0:1784094322.883847:0:102022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1483961422753ns, next at 1482413296791ns, rc = 0 00000004:00080000:2.0:1784094322.884041:0:102022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1483961617703ns, next at 1483008703294ns, rc = 0 00000004:00080000:0.0:1784094322.886169:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000004:00080000:0.0:1784094322.886204:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00010000:00010000:0.0:1784094323.177552:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094323.633599:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00000100:00100000:1.0:1784094323.682512:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094323.682690:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897600 00000100:00100000:3.0:1784094323.682703:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897600 00000100:00100000:3.0:1784094323.682814:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1140 00000100:00100000:3.0:1784094323.682828:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013897600:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094323.682964:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013897600:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 138us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094323.682978:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1140 00000100:00080000:1.0:1784094323.683053:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094323.686116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094323.686207:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897728 00000100:00100000:0.0:1784094323.686221:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897728 00000100:00100000:0.0:1784094323.686344:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 582 00000100:00100000:0.0:1784094323.686359:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:60773:x1870757013897728:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094323.687056:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:60773:x1870757013897728:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 697us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094323.687066:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 582 00000100:00080000:2.0:1784094323.687288:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094323.694703:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094323.694883:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897856 00000100:00100000:1.0:1784094323.694898:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897856 00000100:00100000:1.0:1784094323.694992:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:1.0:1784094323.695007:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:60773:x1870757013897856:12345-192.168.204.57@tcp:19:lfs.0 00000100:00080000:2.0:1784094323.695270:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094323.695668:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:60773:x1870757013897856:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 661us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094323.695678:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 583 00000100:00100000:1.0:1784094323.700882:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094323.700961:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013897984 00000100:00100000:2.0:1784094323.700975:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013897984 00000100:00100000:1.0:1784094323.701179:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1141 00000100:00100000:1.0:1784094323.701190:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013897984:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094323.701819:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013897984:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 628us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094323.701827:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1141 00000100:00100000:2.0:1784094323.708059:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094323.708178:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013898112 00000100:00100000:1.0:1784094323.708190:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013898112 00000100:00100000:1.0:1784094323.708302:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1142 00000100:00100000:1.0:1784094323.708314:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013898112:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094323.708470:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013898112:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 157us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094323.708479:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1142 00000100:00100000:3.0:1784094323.710332:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094323.710499:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013898240 00000100:00100000:2.0:1784094323.710511:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013898240 00000100:00100000:2.0:1784094323.710570:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 584 00000100:00100000:2.0:1784094323.710580:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:60773:x1870757013898240:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094323.711065:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:60773:x1870757013898240:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 485us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094323.711078:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 584 00000100:00100000:1.0:1784094323.714025:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094323.714114:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013898368 00000100:00100000:2.0:1784094323.714126:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013898368 00000100:00100000:2.0:1784094323.714188:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 585 00000100:00100000:2.0:1784094323.714198:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:60773:x1870757013898368:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094323.714762:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:60773:x1870757013898368:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 564us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094323.714772:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 585 00000100:00100000:1.0:1784094323.717020:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094323.717107:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013898496 00000100:00100000:3.0:1784094323.717122:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013898496 00000100:00100000:3.0:1784094323.717201:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1143 00000100:00100000:3.0:1784094323.717215:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013898496:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094323.718642:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:60773:x1870757013898496:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 1423us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094323.718657:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1143 00000100:00100000:3.0:1784094323.765071:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094323.765740:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013898752 00000100:00100000:1.0:1784094323.765754:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013898752 00000100:00100000:1.0:1784094323.765831:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1144 00000100:00100000:1.0:1784094323.765843:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:60777:x1870757013898752:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:1.0:1784094323.765914:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094323.765951:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cc843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eca expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.765976:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff90721a781200) 00010000:00010000:1.0:1784094323.765989:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094323.766019:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.766035:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.766046:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.766064:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.766071:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.766078:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.767286:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.767304:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.767315:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094323.768622:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10496 00000004:00080000:1.0:1784094323.768638:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1484846214953ns, next at 1485846211541ns, rc = 0 00010000:00010000:1.0:1784094323.768751:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768765:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768776:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768789:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768796:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768803:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768831:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094323.768861:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768868:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768876:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768883:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094323.768888:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768897:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768908:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094323.768911:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784094323.768915:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768926:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc86d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768948:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768955:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768961:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768966:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094323.768969:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768975:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768982:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12700) 00010000:00010000:1.0:1784094323.768984:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094323.768987:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094323.768993:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc85f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094323.769003:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000006f73b4e5 reply state 0000000036a1b394 transno 4294967734 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094323.769012:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094323.769346:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094323.769370:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094323.769384:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094323.769388:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094323.769398:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094323.769417:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff907219c12900) 00010000:00010000:2.0:1784094323.769448:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094323.769454:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094323.769465:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc874 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094323.769493:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094323.769495:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094323.769498:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094323.769602:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:60777:x1870757013898752:12345-192.168.204.57@tcp:36:rm.0 Request processed in 3754us (4539us total) trans 4294967734 rc 0/0 00000100:00100000:1.0:1784094323.769613:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1144 00010000:00010000:0.0:1784094323.772662:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094323.772682:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094323.772691:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094323.772703:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094323.772709:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094323.772718:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094323.772746:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907219c12500) 00010000:00010000:0.0:1784094323.772751:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094323.772755:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094323.772761:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc866 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094324.091575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094324.091652:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013898880 00000100:00100000:2.0:1784094324.091661:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013898880 00000100:00100000:2.0:1784094324.091718:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 934 00000100:00100000:2.0:1784094324.091728:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013898880:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094324.091803:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013898880:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094324.091812:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 934 00010000:00010000:3.0:1784094324.201998:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094324.713699:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024376064:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.713793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094324.714040:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024376576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094324.714072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094324.714097:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094324.714103:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024376448:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.714127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094324.714186:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024376192:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.714229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094324.714250:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094324.714255:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024376320:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.714278:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094324.714313:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376064 00000100:00100000:1.0:1784094324.714319:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376064 00000100:00100000:1.0:1784094324.714382:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1784094324.714391:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024376064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.714474:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024376064:12345-0@lo:400:kworker.0 Request processed in 84us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094324.714481:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1784094324.714515:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376192 00000100:00100000:1.0:1784094324.714530:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376192 00000100:00100000:1.0:1784094324.714557:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376320 00000100:00100000:1.0:1784094324.714561:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376320 00000100:00100000:1.0:1784094324.714592:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1784094324.714600:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024376192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.714638:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024376192:12345-0@lo:400:kworker.0 Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094324.714644:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1784094324.714657:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1784094324.714663:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024376320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.714694:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024376320:12345-0@lo:400:kworker.0 Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094324.714700:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00080000:1.0:1784094324.714722:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094324.714922:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094324.714930:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024376704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.715037:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024376320:0@lo:400:kworker.0 00000100:00100000:0.0:1784094324.715054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094324.715056:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024376192:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.715099:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024376064:0@lo:400:kworker.0 00000100:00100000:0.0:1784094324.715102:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376448 00000100:00100000:0.0:1784094324.715107:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376448 00000100:00100000:1.0:1784094324.715132:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376704 00000100:00100000:1.0:1784094324.715137:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376704 00000100:00100000:0.0:1784094324.715147:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1784094324.715155:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024376448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.715174:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1784094324.715184:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024376704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094324.715189:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024376448:12345-0@lo:400:kworker.0 Request processed in 35us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094324.715194:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00080000:0.0:1784094324.715210:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094324.715212:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094324.715223:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1784094324.715226:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230a52d80, transno 4294967367 00000100:00100000:0.0:1784094324.715233:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024376448:0@lo:400:kworker.0 00000100:00100000:1.0:1784094324.715359:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024376704:12345-0@lo:400:kworker.0 Request processed in 176us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094324.715365:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1784094324.715407:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024376704:0@lo:400:kworker.0 00000100:00100000:0.0:1784094324.715473:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376576 00000100:00100000:0.0:1784094324.715478:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376576 00000100:00100000:0.0:1784094324.715519:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1784094324.715524:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024376576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094324.715546:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094324.715587:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024376576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094324.715591:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00080000:0.0:1784094324.715601:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094324.715622:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1784094324.715627:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723d23ea00, transno 4294967367 00000100:00100000:0.0:1784094324.715643:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024376576:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1784094325.016013:0:102167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1486093587222ns, next at 1485846211541ns, rc = 0 00000004:00080000:0.0:1784094325.049616:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000001:00080000:0.0:1784094325.049686:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967734 is committed 00000004:00080000:0.0:1784094325.049694:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000100:00100000:3.0:1784094325.049819:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024376832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784094325.049916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094325.050143:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024376832 00000100:00100000:3.0:1784094325.050209:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024376832 00000100:00100000:3.0:1784094325.050275:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1784094325.050286:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024376832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784094325.050325:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:36 count 1 00010000:00010000:3.0:1784094325.050370:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094325.050399:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094325.050410:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x24:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1784094325.050415:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094325.050451:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094325.050487:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 5 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094325.050504:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 5 pid: 53396 timeout: 1586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094325.050518:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024376960:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094325.050637:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072093af0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094325.055650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094325.055964:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024376960:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094325.056001:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094325.056469:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899008 00000100:00100000:2.0:1784094325.056480:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899008 00010000:00010000:2.0:1784094325.056542:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 6 pid: 53396 timeout: 1586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094325.056599:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 362 00000100:00100000:2.0:1784094325.056611:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013899008:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784094325.056631:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094325.056638:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 6 pid: 53396 timeout: 1586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784094325.056654:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784094325.056655:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 6 pid: 53396 timeout: 1586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.056690:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eceb1cce/0x9ce98053214cc851 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed1 expref: 6 pid: 53396 timeout: 1586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.056712:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784094325.056717:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784094325.056723:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.056735:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.056775:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094325.056855:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013899008:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 245us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094325.056864:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 362 00010000:00010000:0.0:1784094325.056977:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094325.056987:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094325.057005:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094325.057013:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094325.057039:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094325.057902:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094325.057912:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.057922:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094325.057927:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.057938:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.057953:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.057960:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000569d56aa/0x9ce98053214cc87b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094325.058095:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094325.058097:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094325.058099:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094325.058156:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024376832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7868us (8236us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1784094325.058167:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000004:00080000:3.0:1784094325.058258:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237f67800/2, rc 0, transno 4294967369 00000100:00100000:3.0:1784094325.058318:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024376832:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1784094325.058737:0:102167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1486136314138ns, next at 1483008703294ns, rc = 0 00000004:00080000:3.0:1784094325.062120:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00010000:00010000:0.0:1784094325.225728:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094326.250973:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094326.762129:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024377088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094326.762204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094326.762439:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377088 00000100:00100000:2.0:1784094326.762448:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377088 00000100:00100000:2.0:1784094326.762510:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1784094326.762519:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024377088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094326.762555:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00080000:1.0:1784094326.762959:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094326.763352:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024377088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 832us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094326.763361:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1784094326.763503:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024377088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094327.273761:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094328.298311:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094328.829678:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00000100:00100000:1.0:1784094329.210550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094329.210741:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094329.210779:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094329.210815:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094329.210886:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899136 00000100:00100000:3.0:1784094329.210895:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899136 00000100:00100000:3.0:1784094329.210951:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 936 00000100:00100000:3.0:1784094329.210961:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013899136:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094329.211028:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013899136:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094329.211036:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 936 00000100:00100000:0.0:1784094329.211160:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899520 00000100:00100000:0.0:1784094329.211164:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899520 00000100:00100000:0.0:1784094329.211212:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899392 00000100:00100000:0.0:1784094329.211216:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899392 00000100:00100000:2.0:1784094329.211246:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899264 00000100:00100000:0.0:1784094329.211250:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 789 00000100:00100000:2.0:1784094329.211253:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899264 00000100:00100000:0.0:1784094329.211271:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013899520:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094329.211307:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1030 00000100:00100000:0.0:1784094329.211309:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013899520:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 48us (566us total) trans 0 rc 0/0 00000100:00080000:1.0:1784094329.211385:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094329.211401:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013899264:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094329.211401:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 789 00000100:00080000:1.0:1784094329.211474:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094329.211476:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013899264:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 158us (934us total) trans 0 rc 0/0 00000100:00080000:1.0:1784094329.211478:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094329.211561:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1030 00000100:00100000:3.0:1784094329.211676:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 790 00000100:00100000:3.0:1784094329.211689:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013899392:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094329.211724:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013899392:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094329.211731:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 790 00010000:00010000:0.0:1784094329.321555:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094329.833705:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024377344:0@lo:400:kworker.0 00000100:00100000:0.0:1784094329.833717:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094329.833779:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024377600:0@lo:400:kworker.0 00000100:00100000:1.0:1784094329.833791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094329.833792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094329.833925:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024377728:0@lo:400:kworker.0 00000100:00100000:2.0:1784094329.834083:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377344 00000100:00100000:2.0:1784094329.834092:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377344 00000100:00100000:2.0:1784094329.834143:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1784094329.834153:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024377344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094329.834213:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094329.834220:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024377856:0@lo:400:kworker.0 00000100:00100000:0.0:1784094329.834229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094329.834236:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024377344:12345-0@lo:400:kworker.0 Request processed in 83us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094329.834243:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1784094329.834280:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024377472:0@lo:400:kworker.0 00000100:00100000:0.0:1784094329.834522:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377216 00000100:00100000:0.0:1784094329.834527:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377216 00000100:00100000:0.0:1784094329.834567:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1784094329.834573:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024377216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094329.834604:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094329.834645:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024377216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094329.834652:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1784094329.834674:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377728 00000100:00100000:0.0:1784094329.834677:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377728 00000100:00100000:0.0:1784094329.834706:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1784094329.834713:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024377728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094329.834744:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024377728:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094329.834750:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1784094329.834774:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377600 00000100:00100000:2.0:1784094329.834780:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377600 00000100:00100000:0.0:1784094329.834795:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094329.834810:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:0.0:1784094329.834815:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237f67800, transno 4294967369 00000100:00100000:0.0:1784094329.834827:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024377728:0@lo:400:kworker.0 00000100:00100000:2.0:1784094329.834881:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1784094329.834892:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024377600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094329.834945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094329.834965:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094329.834978:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024377344:0@lo:400:kworker.0 00000100:00100000:3.0:1784094329.834985:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024377984:0@lo:400:kworker.0 00000100:00100000:1.0:1784094329.835000:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377856 00000100:00100000:1.0:1784094329.835004:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377856 00000100:00100000:3.0:1784094329.835011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094329.835036:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377472 00000100:00100000:1.0:1784094329.835039:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377472 00000100:00100000:3.0:1784094329.835045:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024377984 00000100:00100000:3.0:1784094329.835048:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024377984 00000100:00100000:1.0:1784094329.835058:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1784094329.835065:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226373450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024377856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094329.835071:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1784094329.835078:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094329.835103:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226373450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024377856:12345-0@lo:400:kworker.0 Request processed in 39us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094329.835110:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1784094329.835111:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024377984:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094329.835120:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1784094329.835127:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1784094329.835136:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024377472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094329.835145:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024377600:12345-0@lo:400:kworker.0 Request processed in 252us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094329.835154:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1784094329.835163:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024377600:0@lo:400:kworker.0 00000100:00100000:1.0:1784094329.835176:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024377472:12345-0@lo:400:kworker.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094329.835186:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00080000:1.0:1784094329.835406:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094329.835411:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094329.835414:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094329.835690:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024377472:0@lo:400:kworker.0 00000100:00100000:3.0:1784094329.835708:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024377984:0@lo:400:kworker.0 00000100:00100000:0.0:1784094329.835884:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024377856:0@lo:400:kworker.0 00010000:00010000:0.0:1784094330.346604:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094331.371947:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094331.882407:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094331.882444:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024378112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094331.882518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094331.883612:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378112 00000100:00100000:2.0:1784094331.883624:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378112 00000100:00080000:1.0:1784094331.883695:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094331.883708:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1784094331.883720:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024378112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094331.883760:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094331.883836:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024378112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094331.883844:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1784094331.884035:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024378112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094332.393721:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094333.417704:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094334.329655:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094334.329700:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094334.329782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094334.329834:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899904 00000100:00100000:2.0:1784094334.329836:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899776 00000100:00100000:3.0:1784094334.329843:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899904 00000100:00100000:2.0:1784094334.329844:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899776 00000100:00100000:2.0:1784094334.329906:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1034 00000100:00100000:2.0:1784094334.329918:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013899776:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094334.329974:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 793 00000100:00100000:3.0:1784094334.329983:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013899904:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094334.330062:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013899904:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094334.330070:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 793 00000100:00100000:3.0:1784094334.330256:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094334.330321:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900032 00000100:00100000:3.0:1784094334.330326:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900032 00000100:00100000:0.0:1784094334.330336:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013899648 00000100:00100000:0.0:1784094334.330343:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013899648 00000100:00100000:3.0:1784094334.330359:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 794 00000100:00100000:3.0:1784094334.330369:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013900032:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094334.330382:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 938 00000100:00100000:0.0:1784094334.330393:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013899648:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094334.330405:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013900032:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094334.330414:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 794 00000100:00100000:0.0:1784094334.330458:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013899648:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 67us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094334.330466:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 938 00000100:00080000:1.0:1784094334.330549:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094334.330553:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094334.330556:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094334.330760:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013899776:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 844us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094334.330767:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1034 00010000:00010000:0.0:1784094334.441554:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094334.954705:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024378240:0@lo:400:kworker.0 00000100:00100000:0.0:1784094334.954705:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024378368:0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.954734:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024378496:0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.954799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094334.954856:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094334.954863:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024378880:0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.954892:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094334.954906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094334.954939:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378880 00000100:00100000:1.0:1784094334.954944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094334.954947:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378880 00000100:00100000:0.0:1784094334.954965:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378496 00000100:00100000:0.0:1784094334.954970:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378496 00000100:00100000:1.0:1784094334.954979:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024378752:0@lo:400:kworker.0 00000100:00100000:1.0:1784094334.955005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094334.955027:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094334.955034:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024378624:0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.955045:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1784094334.955045:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378368 00000100:00100000:0.0:1784094334.955050:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378368 00000100:00100000:3.0:1784094334.955058:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024378880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094334.955062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094334.955074:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378752 00000100:00100000:0.0:1784094334.955078:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378752 00000100:00100000:1.0:1784094334.955094:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378240 00000100:00100000:1.0:1784094334.955097:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378240 00000100:00100000:0.0:1784094334.955106:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1784094334.955114:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094334.955133:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1784094334.955142:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.955160:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024378880:12345-0@lo:400:kworker.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094334.955169:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024378496:12345-0@lo:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094334.955171:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1784094334.955182:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1784094334.955190:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024378624 00000100:00100000:3.0:1784094334.955195:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024378624 00000100:00100000:0.0:1784094334.955216:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1784094334.955226:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024378368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.955230:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1784094334.955241:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094334.955272:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024378368:12345-0@lo:400:kworker.0 Request processed in 48us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094334.955278:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1784094334.955297:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1784094334.955298:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024378624:12345-0@lo:400:kworker.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094334.955299:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024378240:12345-0@lo:400:kworker.0 Request processed in 156us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094334.955317:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1784094334.955320:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1784094334.955321:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024378752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784094334.955345:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094334.955351:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094334.955356:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094334.955356:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024378752:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094334.955364:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1784094334.955367:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024378624:0@lo:400:kworker.0 00000100:00100000:1.0:1784094334.955380:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024378752:0@lo:400:kworker.0 00000100:00100000:1.0:1784094334.955389:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024378240:0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.955411:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024378880:0@lo:400:kworker.0 00000100:00100000:0.0:1784094334.955416:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024378368:0@lo:400:kworker.0 00000100:00100000:3.0:1784094334.955459:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024378496:0@lo:400:kworker.0 00000100:00100000:0.0:1784094334.956959:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094334.956984:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024379008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094334.957046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094334.957238:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379008 00000100:00100000:1.0:1784094334.957246:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379008 00000100:00100000:1.0:1784094334.957298:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1784094334.957308:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024379008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094334.957341:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094334.957389:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024379008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094334.957397:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1784094334.957546:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024379008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784094335.465675:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094336.490180:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094337.001722:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024379136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094337.001798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094337.001866:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379136 00000100:00100000:2.0:1784094337.001876:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379136 00000100:00080000:3.0:1784094337.001933:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094337.001941:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1784094337.001955:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024379136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094337.001991:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094337.002049:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024379136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094337.002055:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1784094337.002128:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024379136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094337.513591:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094338.537757:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094339.451003:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094339.451060:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094339.451179:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900160 00000100:00100000:0.0:1784094339.451190:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900160 00000100:00100000:0.0:1784094339.451249:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 940 00000100:00100000:0.0:1784094339.451260:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013900160:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094339.451333:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013900160:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094339.451342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094339.451346:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 940 00000100:00100000:3.0:1784094339.451454:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900288 00000100:00100000:0.0:1784094339.451456:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094339.451460:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900288 00000100:00100000:3.0:1784094339.451512:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1038 00000100:00100000:3.0:1784094339.451523:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013900288:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094339.451567:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013900288:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 47us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094339.451576:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1038 00000100:00080000:0.0:1784094339.451593:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094339.451612:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900416 00000100:00100000:0.0:1784094339.451617:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900416 00000100:00080000:3.0:1784094339.451645:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094339.451653:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900544 00000100:00100000:0.0:1784094339.451657:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900544 00000100:00100000:3.0:1784094339.451662:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 797 00000100:00100000:3.0:1784094339.451672:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013900416:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094339.451687:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 798 00000100:00100000:0.0:1784094339.451698:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013900544:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094339.451709:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013900416:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094339.451717:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 797 00000100:00100000:0.0:1784094339.451734:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013900544:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (278us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094339.451739:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094339.451743:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 798 00010000:00010000:2.0:1784094339.561927:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094340.073751:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024379264:0@lo:400:kworker.0 00000100:00100000:2.0:1784094340.073841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094340.073991:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379264 00000100:00100000:0.0:1784094340.074000:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379264 00000100:00100000:0.0:1784094340.074052:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1784094340.074073:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024379264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.074353:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024379520:0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.074390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094340.074419:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094340.074442:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024379392:0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.074466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094340.075967:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024379776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094340.076023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094340.077213:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024379264:12345-0@lo:400:kworker.0 Request processed in 3137us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094340.077226:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:2.0:1784094340.077239:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024379264:0@lo:400:kworker.0 00000100:00100000:2.0:1784094340.077264:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094340.077275:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024379648:0@lo:400:kworker.0 00000100:00100000:0.0:1784094340.077301:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379520 00000100:00100000:0.0:1784094340.077309:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379520 00000100:00100000:2.0:1784094340.077314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094340.077351:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379776 00000100:00100000:2.0:1784094340.077354:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379776 00000100:00100000:0.0:1784094340.077374:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379392 00000100:00100000:0.0:1784094340.077379:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379392 00000100:00100000:2.0:1784094340.077387:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1784094340.077396:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024379776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094340.077409:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1784094340.077419:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024379520:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1784094340.077446:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094340.077493:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024379776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094340.077502:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1784094340.077503:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024379520:12345-0@lo:400:kworker.0 Request processed in 83us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094340.077511:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379648 00000100:00100000:0.0:1784094340.077516:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1784094340.077518:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379648 00000100:00100000:0.0:1784094340.077535:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1784094340.077544:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.077563:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1784094340.077574:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024379648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094340.077582:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024379392:12345-0@lo:400:kworker.0 Request processed in 38us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094340.077591:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1784094340.077594:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024379776:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094340.077624:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094340.077631:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094340.077632:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024379648:12345-0@lo:400:kworker.0 Request processed in 59us (318us total) trans 0 rc 0/0 00000100:00080000:0.0:1784094340.077638:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094340.077639:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024379648:0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.077644:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1784094340.077670:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024379392:0@lo:400:kworker.0 00000100:00100000:0.0:1784094340.077686:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024379520:0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.077777:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094340.077786:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024379904:0@lo:400:kworker.0 00000100:00100000:3.0:1784094340.077814:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094340.078268:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024379904 00000100:00100000:1.0:1784094340.078274:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024379904 00000100:00100000:1.0:1784094340.078340:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1784094340.078349:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024379904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784094340.078385:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094340.078401:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024379904:12345-0@lo:400:kworker.0 Request processed in 53us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094340.078409:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1784094340.078416:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024379904:0@lo:400:kworker.0 00010000:00010000:2.0:1784094340.585699:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094340.627485:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094340.627585:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900672 00000100:00100000:2.0:1784094340.627595:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900672 00000100:00100000:2.0:1784094340.627660:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1145 00000100:00100000:2.0:1784094340.627671:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013900672:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094340.627771:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013900672:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094340.627779:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1145 00000100:00100000:3.0:1784094340.630821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094340.631024:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900800 00000100:00100000:0.0:1784094340.631034:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900800 00000100:00100000:0.0:1784094340.631147:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:0.0:1784094340.631167:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013900800:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094340.631619:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013900800:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 453us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094340.631627:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 587 00000100:00100000:3.0:1784094340.632817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094340.632975:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013900928 00000100:00100000:2.0:1784094340.632984:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013900928 00000100:00100000:2.0:1784094340.633031:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 588 00000100:00100000:2.0:1784094340.633039:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013900928:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094340.633680:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013900928:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 640us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094340.633689:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 588 00000100:00100000:1.0:1784094340.635908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094340.635997:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901056 00000100:00100000:3.0:1784094340.636067:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901056 00000100:00100000:3.0:1784094340.636246:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1146 00000100:00100000:3.0:1784094340.636256:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013901056:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094340.636845:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013901056:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 589us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094340.636864:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1146 00000100:00100000:3.0:1784094340.639687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094340.639818:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901184 00000100:00100000:1.0:1784094340.639829:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901184 00000100:00100000:1.0:1784094340.639963:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1147 00000100:00100000:1.0:1784094340.639975:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013901184:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094340.640078:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013901184:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094340.640086:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1147 00000100:00100000:1.0:1784094340.642119:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094340.642333:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901312 00000100:00100000:3.0:1784094340.642342:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901312 00000100:00100000:3.0:1784094340.642460:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 589 00000100:00100000:3.0:1784094340.642470:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013901312:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094340.642822:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013901312:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 353us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094340.642830:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 589 00000100:00100000:0.0:1784094340.644746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094340.644831:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901440 00000100:00100000:3.0:1784094340.644839:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901440 00000100:00100000:3.0:1784094340.645032:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 590 00000100:00100000:3.0:1784094340.645052:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013901440:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094340.645371:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:61034:x1870757013901440:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 330us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094340.645379:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 590 00000100:00100000:1.0:1784094340.647051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094340.647122:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901568 00000100:00100000:2.0:1784094340.647130:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901568 00000100:00100000:2.0:1784094340.647222:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1148 00000100:00100000:2.0:1784094340.647232:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013901568:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094340.647710:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61034:x1870757013901568:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 478us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094340.647718:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1148 00000100:00100000:1.0:1784094341.529940:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094341.530064:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901696 00000100:00100000:3.0:1784094341.530076:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901696 00000100:00080000:1.0:1784094341.530128:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094341.530153:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1149 00000100:00100000:3.0:1784094341.530164:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61048:x1870757013901696:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094341.530183:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094341.530202:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc882 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ed8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.530263:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.530277:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.530290:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094341.530537:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1784094341.530542:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094341.530614:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.530640:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc882 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed8 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.530656:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed8 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.530665:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12700) 00010000:00010000:3.0:1784094341.530668:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094341.530672:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094341.530737:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61048:x1870757013901696:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 574us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094341.530744:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1149 00000100:00100000:1.0:1784094341.538185:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094341.538290:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013901952 00000100:00100000:3.0:1784094341.538300:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013901952 00000100:00100000:3.0:1784094341.538403:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1150 00000100:00100000:3.0:1784094341.538414:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:61048:x1870757013901952:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094341.538487:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094341.538514:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ed8 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.538536:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214cc827 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ec3 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.538547:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12700) 00010000:00010000:3.0:1784094341.538559:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094341.538585:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.538597:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.538608:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094341.557745:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967735 is committed 00000004:00010000:0.0:1784094341.557760:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000e00b8662 reply state 000000008ab4dfcf transno 4294967735 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094341.557774:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094341.557920:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00080000:0.0:1784094341.558013:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784094341.558045:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61048:x1870757013901952:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 19629us (19865us total) trans 4294967735 rc 0/0 00000100:00100000:0.0:1784094341.558054:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1150 00010000:00010000:0.0:1784094341.558092:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.558113:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.558122:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.558129:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094341.558134:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.558141:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.558158:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fce700) 00010000:00010000:0.0:1784094341.558161:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094341.558167:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.558173:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214cc890 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094341.593729:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094341.593872:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013902080 00000100:00100000:0.0:1784094341.593882:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013902080 00000100:00100000:0.0:1784094341.593974:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1151 00000100:00100000:0.0:1784094341.593985:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:61052:x1870757013902080:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094341.594009:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094341.594055:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc897 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5edf expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.594123:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.594139:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.594151:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.594169:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.594177:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.595516:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596057:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596069:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596078:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094341.596162:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1784094341.596167:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094341.596337:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596351:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596358:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596365:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.596376:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094341.596380:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597092:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597110:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:0.0:1784094341.597113:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094341.597118:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597125:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc89e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597140:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597146:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597153:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597158:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094341.597161:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597167:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597178:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907202e6b000) 00010000:00010000:0.0:1784094341.597497:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094341.597503:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597511:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597560:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc897 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5edf expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597575:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc8ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5edf expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.597583:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094341.597586:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094341.597589:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094341.597666:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61052:x1870757013902080:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 3682us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094341.597676:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1151 00000100:00100000:1.0:1784094341.604528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094341.604569:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013902336 00000100:00100000:1.0:1784094341.604580:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013902336 00000100:00100000:1.0:1784094341.604651:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1152 00000100:00100000:1.0:1784094341.604664:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61052:x1870757013902336:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094341.604687:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094341.604709:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ee6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.605096:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.605113:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.605125:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.605143:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.605153:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.605161:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094341.606075:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:1.0:1784094341.606359:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606370:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606378:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606412:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606859:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606869:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606876:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094341.606880:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606893:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606906:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784094341.606910:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094341.606915:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606921:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12c00/0x9ce98053214cc8ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094341.606933:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000b9c96deb reply state 00000000c9ea159f transno 4294967736 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094341.606942:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784094341.606976:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ee6 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606990:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ee6 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.606997:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094341.607000:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094341.607002:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12a00, rc 0) 00000100:00100000:1.0:1784094341.607133:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:61052:x1870757013902336:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 2472us (2610us total) trans 4294967736 rc 0/0 00000100:00100000:1.0:1784094341.607141:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1152 00010000:00010000:0.0:1784094341.609522:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094341.609614:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.609633:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.609641:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.609647:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094341.609652:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.609660:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.609673:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907219c12b00) 00010000:00010000:3.0:1784094341.609676:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094341.609680:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.609686:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12e00/0x9ce98053214cc8c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094341.611777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094341.611874:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013902592 00000100:00100000:0.0:1784094341.611884:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013902592 00000100:00100000:1.0:1784094341.611963:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1153 00000100:00100000:1.0:1784094341.611979:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:61052:x1870757013902592:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:1.0:1784094341.612052:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094341.612076:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214cc8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ee6 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.612091:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907219c12900) 00010000:00010000:1.0:1784094341.612100:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094341.612140:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.612152:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.612160:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094341.612298:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f84cca21 reply state 00000000c66358ee transno 4294967737 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094341.612310:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094341.612573:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:61052:x1870757013902592:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 599us (804us total) trans 4294967737 rc 0/0 00000100:00100000:1.0:1784094341.612581:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1153 00010000:00010000:0.0:1784094341.613841:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.613854:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.613865:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.613872:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094341.613876:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.613884:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.613895:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907219c12500) 00010000:00010000:0.0:1784094341.613899:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094341.613903:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.613909:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13600/0x9ce98053214cc8d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094341.614158:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094341.614301:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013902720 00000100:00100000:0.0:1784094341.614309:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013902720 00000100:00100000:0.0:1784094341.614357:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1154 00000100:00100000:0.0:1784094341.614367:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:61052:x1870757013902720:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094341.614512:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094341.614530:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5eed expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.614580:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eed expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.614598:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eed expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.614615:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907202e6b000) 00010000:00010000:0.0:1784094341.614618:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784094341.614621:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76e00, rc 0) 00000100:00100000:0.0:1784094341.614665:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:61052:x1870757013902720:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 299us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094341.614673:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1154 00000100:00100000:1.0:1784094341.618959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094341.619168:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013902848 00000100:00100000:2.0:1784094341.619177:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013902848 00000100:00100000:2.0:1784094341.619470:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00100000:2.0:1784094341.619481:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013902848:12345-192.168.204.57@tcp:2:touch.60003 00000100:00100000:2.0:1784094341.619853:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013902848:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 373us (903us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1784094341.619862:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 591 00000100:00080000:1.0:1784094341.619939:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094341.622189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094341.622295:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013903104 00000100:00100000:3.0:1784094341.622306:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013903104 00000100:00100000:3.0:1784094341.622362:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 117 00000100:00100000:3.0:1784094341.622372:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:61052:x1870757013903104:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:3.0:1784094341.622761:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:61052:x1870757013903104:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 389us (578us total) trans 4294967738 rc 0/0 00000100:00100000:3.0:1784094341.622770:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 117 00000100:00100000:3.0:1784094341.650777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094341.651476:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013903232 00000100:00100000:1.0:1784094341.651487:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013903232 00000100:00100000:1.0:1784094341.651546:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1155 00000100:00100000:1.0:1784094341.651558:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:61056:x1870757013903232:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:1.0:1784094341.651582:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094341.651603:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc8e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ef4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.651915:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.651930:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.651942:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.651956:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.651964:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.651971:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652083:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652091:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652098:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094341.652134:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5f:0x0]: returning size 0 00000004:00200000:1.0:1784094341.652139:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094341.652157:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652168:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652851:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652861:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652867:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652873:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094341.652877:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652884:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652896:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784094341.652899:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094341.652903:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652909:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc8eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652925:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652931:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652937:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652941:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094341.652944:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652949:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652955:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907219c12900) 00010000:00010000:1.0:1784094341.652957:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094341.652960:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.652965:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc8f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.653000:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214cc8e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ef4 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.653012:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ef4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.653040:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907202e6b000) 00010000:00010000:1.0:1784094341.653043:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094341.653045:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784094341.653113:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:61056:x1870757013903232:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 1556us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094341.653121:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1155 00000100:00100000:1.0:1784094341.658543:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094341.661271:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013903360 00000100:00100000:3.0:1784094341.661287:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013903360 00000100:00100000:2.0:1784094341.661448:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 592 00000100:00100000:2.0:1784094341.661459:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013903360:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784094341.661477:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094341.661497:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5efb expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094341.661522:0:8031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x6a571e85, atime: 0x6a571e85, ctime: 0x6a571e85, blocks: 0x1 00010000:00010000:2.0:1784094341.661541:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1502s v=(0 0) 00010000:00010000:2.0:1784094341.661545:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094341.661553:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 7 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094341.661571:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 7 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094341.661584:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094341.661655:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013903360:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 197us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094341.661667:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 592 00000100:00100000:2.0:1784094341.667362:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094341.667469:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013903616 00000100:00100000:1.0:1784094341.667480:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013903616 00000100:00100000:1.0:1784094341.667584:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1156 00000100:00100000:1.0:1784094341.667596:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:61056:x1870757013903616:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:1.0:1784094341.667646:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784094341.667685:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214cc8f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ef4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667706:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76e00/0x9ce98053214cc8dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5eed expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667716:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907202e6b000) 00010000:00010000:1.0:1784094341.667730:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094341.667751:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667763:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667773:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667786:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667793:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667800:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667902:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667911:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.667917:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784094341.668511:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 64 off10496 00000004:00080000:1.0:1784094341.668521:0:5777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1502746098294ns, next at 1503746096140ns, rc = 0 00010000:00010000:1.0:1784094341.668580:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668590:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668598:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668606:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668617:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668623:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668648:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094341.668667:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668674:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668681:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668687:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094341.668688:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094341.668693:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668697:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668704:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668709:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094341.668715:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784094341.668719:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784094341.668722:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668724:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668735:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cc915 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668739:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668753:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668754:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff907219c12100) 00010000:00010000:0.0:1784094341.668760:0:11170:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784094341.668765:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668767:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668782:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13000/0x9ce98053214cc91c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668783:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668798:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094341.668803:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668808:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094341.668809:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094341.668813:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094341.668816:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094341.668821:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6be00) 00010000:00010000:1.0:1784094341.668825:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094341.668828:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094341.668833:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13200/0x9ce98053214cc907 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094341.668843:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000fc680f4f reply state 0000000058132b6e transno 4294967739 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094341.668850:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784094341.668927:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+12:61056:x1870757013903616:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1333us (1573us total) trans 4294967739 rc 0/0 00000100:00100000:1.0:1784094341.668935:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1156 00010000:00010000:3.0:1784094341.671146:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.671161:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.671169:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.671175:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094341.671180:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.671187:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.671201:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907219c12900) 00010000:00010000:3.0:1784094341.671204:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094341.671208:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094341.671215:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214cc90e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094342.122202:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024380032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094342.122277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094342.122379:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380032 00000100:00100000:1.0:1784094342.122388:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380032 00000100:00100000:1.0:1784094342.122472:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1784094342.122488:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024380032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094342.122528:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094342.122773:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024380032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094342.122783:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00080000:1.0:1784094342.122806:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094342.122887:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024380032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094342.294918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094342.295034:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013903744 00000100:00100000:3.0:1784094342.295044:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013903744 00000100:00100000:3.0:1784094342.295097:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1157 00000100:00100000:3.0:1784094342.295108:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:61072:x1870757013903744:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094342.295143:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094342.295164:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f02 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.295224:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc92a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.295238:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.295250:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094342.295309:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1784094342.295314:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094342.295337:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.295363:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f02 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.295378:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f02 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.295387:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6be00) 00010000:00010000:3.0:1784094342.295390:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094342.295394:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094342.295779:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:61072:x1870757013903744:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 671us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094342.295787:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1157 00000100:00100000:3.0:1784094342.298591:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094342.298626:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904000 00000100:00100000:3.0:1784094342.298636:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904000 00000100:00100000:3.0:1784094342.298695:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1158 00000100:00100000:3.0:1784094342.298706:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:61072:x1870757013904000:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094342.298754:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094342.298779:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc92a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f02 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.298799:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214cc8ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5edf expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.298808:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6be00) 00010000:00010000:3.0:1784094342.298820:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094342.298856:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.298869:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.298878:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094342.336098:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967739 is committed 00000004:00010000:3.0:1784094342.336106:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000611f0e2f reply state 00000000bc4b1e2a transno 4294967740 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784094342.336111:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000100:00100000:3.0:1784094342.336124:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784094342.336140:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967740 is committed 00000004:00200000:3.0:1784094342.336266:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00080000:3.0:1784094342.336713:0:8381:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784094342.336730:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61072:x1870757013904000:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 38021us (38142us total) trans 4294967740 rc 0/0 00000100:00100000:3.0:1784094342.336739:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1158 00010000:00010000:0.0:1784094342.336805:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.336815:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.336834:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.336842:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094342.336847:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.336856:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.336870:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907204fce100) 00010000:00010000:0.0:1784094342.336873:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094342.336878:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.336883:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214cc931 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094342.337911:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094342.337929:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024380160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784094342.337985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094342.338296:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380160 00000100:00100000:1.0:1784094342.338306:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380160 00000100:00100000:1.0:1784094342.338388:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1784094342.338402:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024380160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784094342.338455:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:36 count 1 00010000:00010000:1.0:1784094342.338478:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.338500:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 6 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.338509:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784094342.338514:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094342.338519:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.338549:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 6 pid: 8031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.338564:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 6 pid: 8031 timeout: 1603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094342.338578:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024380288:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784094342.338639:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1784094342.338831:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094342.343258:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094342.344539:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024380288:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784094342.344572:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094342.344606:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904128 00000100:00100000:1.0:1784094342.344612:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904128 00010000:00010000:1.0:1784094342.344646:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 7 pid: 8031 timeout: 1603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094342.344688:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 363 00000100:00100000:1.0:1784094342.344698:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013904128:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094342.344714:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094342.344720:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 7 pid: 8031 timeout: 1603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344732:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 7 pid: 8031 timeout: 1603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344755:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e74242d4/0x9ce98053214cc900 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5efb expref: 7 pid: 8031 timeout: 1603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344777:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094342.344782:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094342.344788:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344798:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344825:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094342.344874:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013904128:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 177us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094342.344881:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 363 00010000:00010000:1.0:1784094342.344905:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344914:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344924:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.344932:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094342.345061:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784094342.346066:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024380160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7668us (8079us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1784094342.346075:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000004:00080000:1.0:1784094342.346414:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237f69c00/2, rc 0, transno 4294967369 00000100:00100000:1.0:1784094342.346509:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024380160:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784094342.346946:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094342.346956:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.346970:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094342.346974:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.346986:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.347006:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.347025:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa34da80/0x9ce98053214cc938 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.347046:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094342.347048:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094342.347049:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094342.383297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094342.383397:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904256 00000100:00100000:1.0:1784094342.383407:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904256 00000100:00100000:1.0:1784094342.383509:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1159 00000100:00100000:1.0:1784094342.383521:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61076:x1870757013904256:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:0.0:1784094342.383740:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094342.383774:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f09 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.383843:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.383862:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.383872:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.383882:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.383887:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.383891:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384275:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384284:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384292:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094342.384370:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1784094342.384375:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094342.384507:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384526:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384532:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384538:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384545:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094342.384550:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384558:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384573:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:0.0:1784094342.384576:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094342.384585:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384592:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384604:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384610:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384616:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384622:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094342.384624:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384631:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384638:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907202e6b200) 00010000:00010000:0.0:1784094342.384640:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094342.384643:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384648:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77a00/0x9ce98053214cc94d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384772:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cc93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f09 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384783:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f09 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.384789:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094342.384791:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784094342.384793:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76800, rc 0) 00000100:00100000:0.0:1784094342.384852:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61076:x1870757013904256:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1335us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.384858:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1159 00010000:00010000:2.0:1784094342.634106:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094342.887115:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094342.887468:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904384 00000100:00100000:3.0:1784094342.887479:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904384 00000100:00100000:3.0:1784094342.887536:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1160 00000100:00100000:3.0:1784094342.887548:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61090:x1870757013904384:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094342.887569:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094342.887589:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc95b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f10 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.887651:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc962 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.887665:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.887676:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094342.887866:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:3.0:1784094342.887871:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094342.887947:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.887972:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214cc95b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f10 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.887987:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc962 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f10 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094342.887996:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:3.0:1784094342.887999:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094342.888016:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094342.888075:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:61090:x1870757013904384:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 530us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094342.888086:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1160 00000100:00100000:3.0:1784094342.891204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.891275:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904640 00000100:00100000:0.0:1784094342.891285:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904640 00000100:00100000:0.0:1784094342.891338:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1161 00000100:00100000:0.0:1784094342.891348:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:61090:x1870757013904640:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094342.891396:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094342.891457:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214cc962 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f10 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.891487:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f09 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.891499:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094342.891513:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094342.891538:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.891550:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.891561:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094342.891976:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000984858f0 reply state 0000000019112edf transno 4294967741 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094342.891987:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094342.892080:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000100:00100000:0.0:1784094342.892164:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:61090:x1870757013904640:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 817us (966us total) trans 4294967741 rc 0/0 00000100:00100000:0.0:1784094342.892171:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1161 00010000:00010000:0.0:1784094342.893773:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.893796:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.893803:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.893810:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094342.893823:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.893830:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.893846:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094342.893848:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094342.893853:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094342.893859:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc969 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094342.954791:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.955907:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904768 00000100:00100000:0.0:1784094342.955918:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904768 00000100:00100000:0.0:1784094342.955982:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1162 00000100:00100000:0.0:1784094342.955994:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013904768:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094342.956126:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013904768:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 135us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.956134:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1162 00000100:00100000:1.0:1784094342.962223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.962335:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013904896 00000100:00100000:0.0:1784094342.962346:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013904896 00000100:00100000:0.0:1784094342.962570:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 594 00000100:00100000:0.0:1784094342.962583:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:61102:x1870757013904896:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:2.0:1784094342.962594:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094342.963023:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:61102:x1870757013904896:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 443us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.963032:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 594 00000100:00100000:1.0:1784094342.964561:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094342.964732:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905024 00000100:00100000:3.0:1784094342.964744:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905024 00000100:00100000:3.0:1784094342.964799:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 595 00000100:00100000:3.0:1784094342.964809:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:61102:x1870757013905024:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094342.965402:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:61102:x1870757013905024:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 592us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094342.965411:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 595 00000100:00100000:1.0:1784094342.968262:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.968675:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905152 00000100:00100000:0.0:1784094342.968686:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905152 00000100:00100000:0.0:1784094342.968780:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1163 00000100:00100000:0.0:1784094342.968791:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013905152:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094342.969276:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013905152:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 486us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.969285:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1163 00000100:00100000:1.0:1784094342.973796:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.973971:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905280 00000100:00100000:0.0:1784094342.973982:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905280 00000100:00100000:0.0:1784094342.974085:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1164 00000100:00100000:0.0:1784094342.974096:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013905280:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094342.974196:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013905280:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 102us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.974204:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1164 00000100:00100000:1.0:1784094342.977537:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094342.977802:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905408 00000100:00100000:2.0:1784094342.977872:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905408 00000100:00100000:2.0:1784094342.977927:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:2.0:1784094342.977938:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:61102:x1870757013905408:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094342.978485:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:61102:x1870757013905408:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 547us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094342.978494:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 596 00000100:00100000:1.0:1784094342.981321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.981662:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905536 00000100:00100000:0.0:1784094342.981673:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905536 00000100:00100000:0.0:1784094342.982639:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 597 00000100:00100000:0.0:1784094342.982655:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61102:x1870757013905536:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094342.983035:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61102:x1870757013905536:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 384us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.983044:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 597 00000100:00100000:1.0:1784094342.985504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094342.985608:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905664 00000100:00100000:0.0:1784094342.985619:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905664 00000100:00100000:0.0:1784094342.985683:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1165 00000100:00100000:0.0:1784094342.985693:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013905664:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094342.986258:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61102:x1870757013905664:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 565us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094342.986268:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1165 00000100:00100000:1.0:1784094343.020047:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094343.020416:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013905792 00000100:00100000:0.0:1784094343.020578:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013905792 00000100:00100000:1.0:1784094343.020742:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1166 00000100:00100000:1.0:1784094343.020757:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61106:x1870757013905792:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:1.0:1784094343.020779:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094343.020800:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cc970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f17 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.020865:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.020885:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.020898:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784094343.020913:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094343.020915:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.020924:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.020932:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021473:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021483:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021491:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094343.021573:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:1.0:1784094343.021577:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094343.021656:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021668:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021679:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021685:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021691:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094343.021695:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021701:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021714:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:1.0:1784094343.021717:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094343.021721:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021726:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214cc977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021738:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021743:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021748:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021752:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094343.021755:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021761:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021768:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907219c12400) 00010000:00010000:1.0:1784094343.021770:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094343.021773:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021779:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214cc97e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021809:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214cc970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f17 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021822:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f17 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094343.021828:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12d00) 00010000:00010000:1.0:1784094343.021830:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784094343.021832:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13400, rc 0) 00000100:00100000:1.0:1784094343.021904:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:61106:x1870757013905792:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1152us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094343.021912:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1166 00000100:00100000:1.0:1784094343.026022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094343.027073:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906048 00000100:00100000:0.0:1784094343.027085:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906048 00000100:00100000:0.0:1784094343.027148:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1167 00000100:00100000:0.0:1784094343.027156:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61106:x1870757013906048:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784094343.027174:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094343.027198:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc98c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f1e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.027495:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.027516:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.027525:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.027534:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.027539:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.027543:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094343.028213:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25:0x0], index 0: 0 00010000:00010000:0.0:1784094343.028455:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc9a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028466:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028474:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028507:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028514:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028520:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028526:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094343.028530:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028537:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028554:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12d00) 00010000:00010000:0.0:1784094343.028557:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094343.028566:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028573:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214cc993 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094343.028587:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000ab14190b reply state 000000008a6ac86b transno 4294967742 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094343.028595:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094343.028623:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cc98c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f1e expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028638:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f1e expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.028645:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094343.028648:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094343.028650:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77800, rc 0) 00000100:00100000:0.0:1784094343.028773:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:61106:x1870757013906048:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1616us (2761us total) trans 4294967742 rc 0/0 00000100:00100000:0.0:1784094343.028781:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1167 00010000:00010000:0.0:1784094343.030960:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.030975:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.030984:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.030990:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094343.030995:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.031013:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.031027:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907202e6b200) 00010000:00010000:0.0:1784094343.031031:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094343.031035:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094343.031042:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214cc99a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094343.034544:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094343.034799:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906176 00000100:00100000:3.0:1784094343.034810:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906176 00000100:00100000:3.0:1784094343.034860:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 598 00000100:00100000:3.0:1784094343.034870:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:61106:x1870757013906176:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784094343.034890:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094343.034912:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f25 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784094343.034941:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784094343.034964:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=1504s v=(0 0) 00010000:00010000:3.0:1784094343.034969:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094343.034980:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094343.035011:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094343.035025:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094343.035138:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:61106:x1870757013906176:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 268us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094343.035146:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 598 00000100:00100000:3.0:1784094343.049118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094343.049184:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906304 00000100:00100000:1.0:1784094343.049196:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906304 00002000:00100000:1.0:1784094343.049253:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff907230e49500 x1870757013906304/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:664/0 lens 488/0 e 0 to 0 dl 1784094354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1784094343.049264:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230e49500 with x1870757013906304 ext(0->1048575) 00002000:00010000:1.0:1784094343.049270:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907230e49500 00000100:00100000:1.0:1784094343.049303:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 29 00000100:00100000:1.0:1784094343.049314:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013906304:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:0.0:1784094343.062692:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013906304:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 13301us (13502us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1784094343.062711:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 29 00002000:00100000:0.0:1784094343.062727:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff907230e49500 x1870757013906304/t4294967370(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:664/0 lens 488/448 e 0 to 0 dl 1784094354 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1784094343.062739:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230e49500 with x1870757013906304 ext(0->1048575) 00002000:00010000:0.0:1784094343.062745:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff907230e49500 00000100:00100000:2.0:1784094343.065472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094343.065566:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906432 00000100:00100000:0.0:1784094343.065576:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906432 00000100:00100000:0.0:1784094343.065636:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1168 00000100:00100000:0.0:1784094343.065647:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:61106:x1870757013906432:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:2.0:1784094343.088218:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967742 is committed 00000100:00100000:1.0:1784094343.089323:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:61106:x1870757013906432:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 23671us (23853us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094343.089335:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1168 00000100:00100000:1.0:1784094343.093519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094343.093661:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906560 00000100:00100000:2.0:1784094343.093676:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906560 00000100:00100000:2.0:1784094343.093736:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 599 00000100:00100000:2.0:1784094343.093747:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013906560:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:0.0:1784094343.118326:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00000100:00100000:1.0:1784094343.118378:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013906560:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 24626us (24861us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094343.118390:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 599 00000100:00100000:3.0:1784094343.121867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094343.121987:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906816 00000100:00100000:1.0:1784094343.122007:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906816 00000100:00100000:1.0:1784094343.122075:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 118 00000100:00100000:1.0:1784094343.122086:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61106:x1870757013906816:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:1.0:1784094343.122518:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:61106:x1870757013906816:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 432us (659us total) trans 4294967743 rc 0/0 00000100:00100000:1.0:1784094343.122526:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 118 00010000:00010000:0.0:1784094343.658398:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094343.791867:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967743 is committed 00000001:00080000:1.0:1784094344.220751:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00000001:00080000:1.0:1784094344.220769:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000004:00080000:1.0:1784094344.459287:0:102630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1505536861180ns, next at 1485846211541ns, rc = 0 00000004:00080000:1.0:1784094344.459391:0:102630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1505536968370ns, next at 1503746096140ns, rc = 0 00000004:00080000:0.0:1784094344.461981:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000004:00080000:0.0:1784094344.462447:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000100:00100000:3.0:1784094344.569622:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094344.569662:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094344.569691:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094344.569721:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013906944 00000100:00100000:3.0:1784094344.569730:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013906944 00000100:00100000:3.0:1784094344.569904:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 942 00000100:00100000:3.0:1784094344.569916:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013906944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094344.570000:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013906944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 86us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094344.570009:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 942 00000100:00100000:3.0:1784094344.570047:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907200 00000100:00100000:3.0:1784094344.570052:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907200 00000100:00100000:3.0:1784094344.570102:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 800 00000100:00100000:3.0:1784094344.570110:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013907200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094344.570142:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013907200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094344.570148:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 800 00000100:00100000:3.0:1784094344.570168:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907072 00000100:00100000:3.0:1784094344.570172:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907072 00000100:00100000:3.0:1784094344.570277:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1042 00000100:00100000:3.0:1784094344.570287:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013907072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094344.570326:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013907072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 41us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094344.570333:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1042 00000100:00080000:3.0:1784094344.570678:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094344.571750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094344.571826:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907328 00000100:00100000:0.0:1784094344.571834:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907328 00000100:00100000:0.0:1784094344.571898:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 801 00000100:00100000:0.0:1784094344.571908:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013907328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094344.571966:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013907328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094344.571984:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 801 00000100:00080000:1.0:1784094344.572276:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784094344.681650:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094345.194649:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024380416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094345.194725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094345.194918:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380416 00000100:00100000:2.0:1784094345.194927:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380416 00000100:00100000:2.0:1784094345.195036:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1784094345.195045:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024380416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094345.195079:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094345.195125:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024380416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094345.195131:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1784094345.195167:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:2.0:1784094345.195172:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237f69c00, transno 4294967369 00000100:00100000:2.0:1784094345.195187:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024380416:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784094345.195583:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094345.195643:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024380544:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094345.195700:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024381056:0@lo:400:kworker.0 00000100:00100000:3.0:1784094345.195713:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380544 00000100:00100000:3.0:1784094345.195717:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380544 00000100:00100000:0.0:1784094345.195722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094345.195741:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094345.195747:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024380672:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094345.195798:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381056 00000100:00100000:3.0:1784094345.195800:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1784094345.195801:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381056 00000100:00100000:3.0:1784094345.195808:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024380544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195832:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380672 00000100:00100000:0.0:1784094345.195835:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380672 00000100:00100000:3.0:1784094345.195847:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024380544:12345-0@lo:400:kworker.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.195852:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1784094345.195854:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1784094345.195857:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024381056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195887:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024381056:12345-0@lo:400:kworker.0 Request processed in 30us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.195893:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1784094345.195906:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1784094345.195911:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024380672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195935:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024380672:12345-0@lo:400:kworker.0 Request processed in 24us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.195941:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1784094345.195981:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024380672:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195989:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024380544:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.195995:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024381056:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.196014:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024380800:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.196035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094345.196059:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094345.196064:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024380928:0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.196085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094345.196110:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380928 00000100:00100000:0.0:1784094345.196114:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380928 00000100:00100000:0.0:1784094345.196143:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:0.0:1784094345.196149:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024380928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094345.196181:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024380928:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.196187:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:0.0:1784094345.196211:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024380928:0@lo:400:kworker.0 00000100:00080000:0.0:1784094345.196223:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094345.196227:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094345.196807:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024380800 00000100:00100000:3.0:1784094345.196813:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024380800 00000100:00100000:3.0:1784094345.197016:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1784094345.197025:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024380800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094345.197072:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024380800:12345-0@lo:400:kworker.0 Request processed in 48us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094345.197081:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00080000:1.0:1784094345.198262:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094345.201647:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024380800:0@lo:400:kworker.0 00000100:00100000:3.0:1784094345.238074:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094345.238214:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907456 00000100:00100000:0.0:1784094345.238224:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907456 00000100:00080000:1.0:1784094345.238288:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094345.238329:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1169 00000100:00100000:0.0:1784094345.238340:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013907456:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094345.238443:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013907456:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 105us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.238451:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1169 00000100:00100000:0.0:1784094345.239398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094345.239540:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907584 00000100:00100000:3.0:1784094345.239547:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907584 00000100:00100000:3.0:1784094345.239621:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:3.0:1784094345.239631:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:61298:x1870757013907584:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094345.240024:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:61298:x1870757013907584:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 395us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094345.240032:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 600 00000100:00100000:1.0:1784094345.241085:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094345.241138:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907712 00000100:00100000:0.0:1784094345.241146:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907712 00000100:00100000:0.0:1784094345.241189:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 601 00000100:00100000:0.0:1784094345.241198:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61298:x1870757013907712:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094345.241594:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61298:x1870757013907712:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 397us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.241601:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 601 00000100:00100000:3.0:1784094345.248234:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094345.248338:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907840 00000100:00100000:0.0:1784094345.248349:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907840 00000100:00100000:0.0:1784094345.248616:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1170 00000100:00100000:0.0:1784094345.248628:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013907840:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094345.249077:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013907840:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 450us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094345.249086:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1170 00000100:00100000:3.0:1784094345.251646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094345.251683:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013907968 00000100:00100000:1.0:1784094345.251692:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013907968 00000100:00100000:1.0:1784094345.251826:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1171 00000100:00100000:1.0:1784094345.251839:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013907968:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094345.252173:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013907968:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 336us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094345.252182:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1171 00000100:00100000:1.0:1784094345.257479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094345.257516:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908096 00000100:00100000:1.0:1784094345.257527:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908096 00000100:00100000:1.0:1784094345.257582:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 602 00000100:00100000:1.0:1784094345.257591:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61298:x1870757013908096:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:1.0:1784094345.259015:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61298:x1870757013908096:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 1419us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094345.259027:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 602 00000100:00100000:3.0:1784094345.262918:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094345.262953:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908224 00000100:00100000:3.0:1784094345.262973:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908224 00000100:00100000:3.0:1784094345.263035:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 603 00000100:00100000:3.0:1784094345.263047:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:61298:x1870757013908224:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094345.265398:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:61298:x1870757013908224:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 2344us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094345.265886:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 603 00000100:00100000:0.0:1784094345.270074:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094345.270152:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908352 00000100:00100000:3.0:1784094345.270161:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908352 00000100:00100000:3.0:1784094345.270300:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1172 00000100:00100000:3.0:1784094345.270310:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013908352:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094345.270746:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:61298:x1870757013908352:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 437us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094345.270754:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1172 00000100:00100000:0.0:1784094345.304357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094345.304409:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908608 00000100:00100000:3.0:1784094345.304449:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908608 00000100:00100000:0.0:1784094345.304609:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1173 00000100:00100000:0.0:1784094345.304621:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:61302:x1870757013908608:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:0.0:1784094345.304677:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094345.304707:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214cc9a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f1e expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.304729:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094345.304742:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094345.304766:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.304779:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.304789:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.304802:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.304810:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.304815:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.305188:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.305201:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.305207:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784094345.306754:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off10560 00000004:00080000:0.0:1784094345.306765:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1506384342692ns, next at 1507384340607ns, rc = 0 00010000:00010000:0.0:1784094345.306864:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.306875:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.306884:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.306893:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.306899:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.306905:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.306989:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784094345.307016:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307022:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307029:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307035:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094345.307039:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307047:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307057:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff907202e6b200) 00010000:00010000:0.0:1784094345.307060:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094345.307064:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307070:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214cc9c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307086:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307092:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307097:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307101:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094345.307104:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307112:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307119:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12d00) 00010000:00010000:0.0:1784094345.307121:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094345.307124:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.307130:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094345.307152:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000abf75e9b reply state 000000009828ed0f transno 4294967744 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094345.307162:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094345.307252:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:61302:x1870757013908608:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 2631us (2902us total) trans 4294967744 rc 0/0 00000100:00100000:0.0:1784094345.307261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1173 00010000:00010000:3.0:1784094345.307312:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094345.307319:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094345.307324:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094345.307328:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094345.307334:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094345.307343:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff907202e6b200) 00010000:00010000:3.0:1784094345.307346:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784094345.307349:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094345.307355:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214cc9cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094345.307372:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094345.307374:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094345.307375:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094345.308923:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.308937:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.308944:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.308948:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094345.308952:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.308975:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.308987:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff907202e6bd00) 00010000:00010000:0.0:1784094345.308990:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094345.308994:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094345.308999:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094345.706633:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094346.485303:0:102775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1507562877517ns, next at 1507384340607ns, rc = 0 00000001:00080000:0.0:1784094346.503194:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967744 is committed 00000004:00080000:0.0:1784094346.503208:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000004:00080000:0.0:1784094346.503229:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000100:00100000:2.0:1784094346.503448:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094346.503476:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024381184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784094346.503557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094346.503608:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381184 00000100:00100000:0.0:1784094346.503618:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381184 00000100:00100000:0.0:1784094346.503672:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1784094346.503681:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024381184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784094346.503708:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:37 count 1 00010000:00010000:0.0:1784094346.503732:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.503756:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 5 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.503765:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x25:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1784094346.503770:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094346.503775:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.503805:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 5 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.503822:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 5 pid: 6574 timeout: 1607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094346.503835:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230a50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024381312:192.168.204.57@tcp:104: 00000100:00100000:0.0:1784094346.504078:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720240 going to sleep for 11 seconds 00000100:00100000:1.0:1784094346.506760:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094346.506789:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230a50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:53396:1870757024381312:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094346.506812:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094346.507352:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908736 00000100:00100000:2.0:1784094346.507360:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908736 00010000:00010000:2.0:1784094346.507416:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 6 pid: 6574 timeout: 1607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094346.507471:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 364 00000100:00100000:2.0:1784094346.507482:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013908736:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784094346.507496:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094346.507503:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 6 pid: 6574 timeout: 1607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507521:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 6 pid: 6574 timeout: 1607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507547:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c916881/0x9ce98053214cc9af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f25 expref: 6 pid: 6574 timeout: 1607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507564:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784094346.507569:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784094346.507575:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507585:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507619:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094346.507679:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013908736:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 199us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094346.507687:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 364 00010000:00010000:0.0:1784094346.507752:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.507764:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.507776:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.507785:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094346.507813:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1784094346.507830:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784094346.507916:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094346.507923:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507944:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094346.507949:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507964:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507977:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.507986:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e83757b/0x9ce98053214cc9d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094346.508126:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094346.508129:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094346.508131:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094346.508557:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024381184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4875us (4998us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784094346.508566:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000004:00080000:2.0:1784094346.508631:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907237f69f80/2, rc 0, transno 4294967371 00000100:00100000:2.0:1784094346.508699:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024381184:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1784094346.508909:0:102775:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1507586486144ns, next at 1503746096140ns, rc = 0 00000004:00080000:0.0:1784094346.510533:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00010000:00010000:0.0:1784094346.729551:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094347.241715:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094347.241738:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024381440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094347.241806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094347.241968:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381440 00000100:00100000:1.0:1784094347.241977:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381440 00000100:00100000:1.0:1784094347.242044:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1784094347.242054:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024381440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094347.242094:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00080000:0.0:1784094347.242102:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094347.242153:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024381440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094347.242163:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1784094347.242190:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024381440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094347.753624:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094348.777859:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094349.689592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094349.689689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094349.689731:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094349.689756:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909120 00000100:00100000:0.0:1784094349.689768:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909120 00000100:00100000:1.0:1784094349.689786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094349.689815:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909248 00000100:00100000:1.0:1784094349.689820:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909248 00000100:00100000:0.0:1784094349.689839:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 803 00000100:00100000:0.0:1784094349.689851:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909120:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094349.689907:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908992 00000100:00100000:2.0:1784094349.689912:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908992 00000100:00100000:0.0:1784094349.689937:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909120:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094349.689954:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1046 00000100:00100000:2.0:1784094349.689976:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013908992:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094349.690015:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013908992:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094349.690023:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1046 00000100:00080000:2.0:1784094349.690073:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094349.690076:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094349.690078:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094349.691978:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013908864 00000100:00100000:3.0:1784094349.691993:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013908864 00000100:00100000:3.0:1784094349.692113:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 944 00000100:00100000:3.0:1784094349.692124:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013908864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094349.692198:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013908864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094349.692205:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 944 00000100:00100000:1.0:1784094349.692304:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00100000:1.0:1784094349.692328:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909248:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094349.692371:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909248:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 59us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094349.692378:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 804 00000100:00100000:0.0:1784094349.692632:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 803 00010000:00010000:2.0:1784094349.801686:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094350.314152:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024381568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094350.314271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094350.314400:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381568 00000100:00100000:3.0:1784094350.314406:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381568 00000100:00100000:2.0:1784094350.314528:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024381696:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.314556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094350.314579:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024382208:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.314602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094350.314616:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094350.314620:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024381824:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.314634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094350.314652:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024382080:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.314669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094350.314680:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094350.314683:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024381952:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.314694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094350.314719:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382208 00000100:00100000:2.0:1784094350.314721:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382208 00000100:00100000:0.0:1784094350.314750:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382080 00000100:00100000:0.0:1784094350.314756:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382080 00000100:00100000:3.0:1784094350.315160:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1784094350.315171:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024381568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094350.315238:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381824 00000100:00100000:2.0:1784094350.315243:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381824 00002000:00000024:3.0:1784094350.315246:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094350.315260:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381952 00000100:00100000:2.0:1784094350.315263:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381952 00000100:00100000:2.0:1784094350.315279:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1784094350.315285:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024382208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094350.315298:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024381568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094350.315305:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1784094350.315318:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024382208:12345-0@lo:400:kworker.0 Request processed in 33us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094350.315331:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1784094350.315337:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1784094350.315338:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024381824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.315350:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1784094350.315356:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024381952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094350.315366:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024381824:12345-0@lo:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094350.315372:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1784094350.315382:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024381952:12345-0@lo:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094350.315387:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00080000:3.0:1784094350.315391:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094350.315395:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094350.315403:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024381696 00000100:00100000:2.0:1784094350.315406:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024381696 00000100:00100000:2.0:1784094350.315453:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1784094350.315460:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024381696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.315492:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024381696:12345-0@lo:400:kworker.0 Request processed in 33us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094350.315499:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1784094350.315652:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024381824:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.315662:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024381696:0@lo:400:kworker.0 00000100:00100000:2.0:1784094350.315671:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024382208:0@lo:400:kworker.0 00000100:00100000:3.0:1784094350.315686:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024381952:0@lo:400:kworker.0 00000100:00100000:3.0:1784094350.315709:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024381568:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784094350.315753:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094350.315782:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1784094350.315794:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024382080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094350.316128:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1870757024382080:12345-0@lo:400:kworker.0 Request processed in 337us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094350.316135:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1784094350.316152:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024382080:0@lo:400:kworker.0 00000001:00080000:0.0:1784094350.358367:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00010000:00010000:0.0:1784094350.825795:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094351.849802:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094352.361666:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024382336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094352.362162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094352.362372:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382336 00000100:00100000:1.0:1784094352.362379:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382336 00000100:00100000:1.0:1784094352.362476:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1784094352.362487:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024382336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094352.362525:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094352.362573:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024382336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094352.362581:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:0.0:1784094352.362609:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:0.0:1784094352.362615:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907237f69f80, transno 4294967371 00000100:00080000:3.0:1784094352.362646:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094352.362683:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024382336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094352.874303:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094353.898255:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094354.810326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094354.810355:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094354.810444:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909376 00000100:00100000:3.0:1784094354.810454:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909376 00000100:00100000:3.0:1784094354.810523:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 946 00000100:00100000:3.0:1784094354.810538:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013909376:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094354.810607:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013909376:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094354.810615:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 946 00000100:00100000:1.0:1784094354.810826:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094354.810861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094354.810930:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909632 00000100:00100000:2.0:1784094354.810935:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909632 00000100:00100000:3.0:1784094354.810978:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909504 00000100:00100000:3.0:1784094354.810982:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909504 00000100:00100000:3.0:1784094354.811017:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1050 00000100:00100000:3.0:1784094354.811024:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013909504:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094354.811063:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013909504:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 39us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094354.811069:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1050 00000100:00100000:2.0:1784094354.811158:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909760 00000100:00100000:2.0:1784094354.811163:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909760 00000100:00080000:1.0:1784094354.811170:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094354.811175:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094354.811177:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094354.811199:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 806 00000100:00100000:3.0:1784094354.811246:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 807 00000100:00100000:0.0:1784094354.811250:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909632:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094354.811253:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909760:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094354.811278:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909760:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094354.811285:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 807 00000100:00100000:0.0:1784094354.811494:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013909632:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 246us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094354.811501:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 806 00010000:00010000:0.0:1784094354.922171:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094355.433662:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024382592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094355.433699:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024382464:0@lo:400:kworker.0 00000100:00100000:3.0:1784094355.433749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094355.433750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094355.433830:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024382976:0@lo:400:kworker.0 00000100:00100000:3.0:1784094355.433840:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024383104:0@lo:400:kworker.0 00000100:00100000:3.0:1784094355.433883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094355.433940:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024382848:0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.433975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094355.433998:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784094355.434004:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024382720:0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.434028:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094355.434043:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382464 00000100:00100000:0.0:1784094355.434049:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024383232:0@lo:400:kworker.0 00000100:00100000:2.0:1784094355.434052:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382464 00000100:00100000:0.0:1784094355.434082:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383104 00000100:00100000:0.0:1784094355.434087:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383104 00000100:00100000:2.0:1784094355.434103:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1784094355.434116:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024382464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.434129:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382848 00000100:00100000:0.0:1784094355.434133:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382848 00000100:00100000:0.0:1784094355.434156:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382720 00000100:00100000:0.0:1784094355.434159:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382720 00000100:00100000:2.0:1784094355.434170:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024382464:12345-0@lo:400:kworker.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094355.434177:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1784094355.434180:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1784094355.434188:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094355.434220:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1784094355.434230:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024382848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.434252:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024383104:12345-0@lo:400:kworker.0 Request processed in 65us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094355.434261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1784094355.434279:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024382848:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094355.434286:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1784094355.434288:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382592 00000100:00100000:3.0:1784094355.434293:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382592 00000100:00100000:0.0:1784094355.434298:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024382720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094355.434303:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1784094355.434339:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1784094355.434348:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024382592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094355.434358:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024382720:12345-0@lo:400:kworker.0 Request processed in 62us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094355.434365:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00002000:00000024:3.0:1784094355.434376:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094355.434394:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024383104:0@lo:400:kworker.0 00000100:00080000:0.0:1784094355.434400:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094355.434406:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094355.434443:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024382592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094355.434446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094355.434456:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1784094355.434457:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024382592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094355.434487:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024382976 00000100:00100000:0.0:1784094355.434493:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024382976 00000100:00100000:1.0:1784094355.434502:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024382464:0@lo:400:kworker.0 00000100:00100000:3.0:1784094355.434507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784094355.434533:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094355.434546:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024382848:0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.434547:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383232 00000100:00100000:1.0:1784094355.434553:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1784094355.434554:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383232 00000100:00100000:1.0:1784094355.434567:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024382976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094355.434571:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024382720:0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.434587:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1784094355.434599:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024383232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094355.434616:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024382976:12345-0@lo:400:kworker.0 Request processed in 53us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094355.434625:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1784094355.434638:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024382976:0@lo:400:kworker.0 00000100:00100000:0.0:1784094355.435634:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024383232:12345-0@lo:400:kworker.0 Request processed in 1037us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094355.435642:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1784094355.435689:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024383232:0@lo:400:kworker.0 00010000:00010000:2.0:1784094355.945641:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094356.969748:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094357.481668:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024383360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094357.481761:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094357.481832:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383360 00000100:00100000:1.0:1784094357.481847:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383360 00000100:00080000:2.0:1784094357.481899:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094357.481923:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1784094357.481933:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024383360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094357.481983:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094357.482037:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024383360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094357.482045:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1784094357.482089:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024383360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094357.993617:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094359.017725:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094359.928983:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094359.929040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094359.929284:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013909888 00000100:00100000:0.0:1784094359.929295:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013909888 00000100:00100000:0.0:1784094359.929363:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 948 00000100:00100000:0.0:1784094359.929374:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013909888:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094359.929485:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013909888:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 111us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094359.929495:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 948 00000100:00100000:2.0:1784094359.929608:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910016 00000100:00100000:2.0:1784094359.929625:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910016 00000100:00100000:2.0:1784094359.929675:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1054 00000100:00100000:2.0:1784094359.929695:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013910016:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094359.929727:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013910016:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 45us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094359.929734:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1054 00000100:00080000:0.0:1784094359.930174:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094359.931096:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094359.931391:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094359.932744:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910144 00000100:00100000:3.0:1784094359.932757:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910144 00000100:00080000:2.0:1784094359.932813:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094359.932831:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910272 00000100:00100000:3.0:1784094359.932835:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910272 00000100:00100000:3.0:1784094359.932875:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 810 00000100:00080000:2.0:1784094359.932876:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094359.932887:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013910144:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094359.932962:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013910144:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 77us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094359.932970:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 810 00000100:00100000:3.0:1784094359.932990:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 811 00000100:00100000:3.0:1784094359.932997:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013910272:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094359.933024:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013910272:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 28us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094359.933030:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 811 00010000:00010000:2.0:1784094360.041637:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094360.553846:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024383488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094360.553933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094360.554025:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383488 00000100:00100000:3.0:1784094360.554033:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383488 00000100:00100000:3.0:1784094360.554101:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1784094360.554113:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024383488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094360.554149:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094360.554201:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024383488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094360.554207:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024383744:0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554211:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1784094360.554249:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024383616:0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094360.554392:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024384128:0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094360.554485:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094360.554493:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024384000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784094360.554554:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094360.554572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094360.554595:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024383488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094360.554601:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094360.554609:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024383872:0@lo:400:kworker.0 00000100:00100000:2.0:1784094360.554632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094360.554656:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384128 00000100:00100000:3.0:1784094360.554660:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384128 00000100:00100000:2.0:1784094360.554687:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383744 00000100:00100000:2.0:1784094360.554693:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383744 00000100:00100000:3.0:1784094360.554715:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383872 00000100:00100000:3.0:1784094360.554721:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383872 00000100:00100000:2.0:1784094360.554731:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1784094360.554742:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554752:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1784094360.554764:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094360.554796:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024384128:12345-0@lo:400:kworker.0 Request processed in 57us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094360.554805:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1784094360.554824:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024383744:12345-0@lo:400:kworker.0 Request processed in 61us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094360.554828:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1784094360.554837:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1784094360.554842:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024383872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784094360.554860:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094360.554881:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024383872:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094360.554887:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024383616 00000100:00100000:2.0:1784094360.554890:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1784094360.554893:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024383616 00000100:00100000:3.0:1784094360.554930:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1784094360.554934:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024384128:0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554941:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094360.554968:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024383872:0@lo:400:kworker.0 00000100:00100000:2.0:1784094360.554984:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024383744:0@lo:400:kworker.0 00000100:00100000:3.0:1784094360.554992:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024383616:12345-0@lo:400:kworker.0 Request processed in 52us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094360.555001:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1784094360.555037:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384000 00000100:00100000:1.0:1784094360.555043:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384000 00000100:00080000:3.0:1784094360.555071:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094360.555093:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1784094360.555123:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024384000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094360.555171:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024384000:12345-0@lo:400:kworker.0 Request processed in 65us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094360.555178:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1784094360.555352:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907231084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024384000:0@lo:400:kworker.0 00000100:00100000:2.0:1784094360.555361:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024383616:0@lo:400:kworker.0 00010000:00010000:3.0:1784094361.065596:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094362.090793:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094362.601712:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094362.602330:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024384256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094362.602401:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094362.602614:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384256 00000100:00100000:1.0:1784094362.602622:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384256 00000100:00080000:3.0:1784094362.602667:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094362.602695:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1784094362.602705:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024384256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094362.602739:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094362.602795:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024384256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094362.602802:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1784094362.603192:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024384256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094363.113807:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094363.550905:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094363.551014:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910400 00000100:00100000:3.0:1784094363.551025:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910400 00000100:00100000:3.0:1784094363.551153:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1174 00000100:00100000:3.0:1784094363.551162:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013910400:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094363.551252:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013910400:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094363.551257:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1174 00000100:00080000:0.0:1784094363.551623:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094363.554110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094363.554370:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910528 00000100:00100000:0.0:1784094363.554380:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910528 00000100:00080000:3.0:1784094363.554482:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094363.554737:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 605 00000100:00100000:0.0:1784094363.554748:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013910528:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094363.555116:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013910528:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 369us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094363.555124:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 605 00000100:00100000:1.0:1784094363.558372:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094363.558643:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910656 00000100:00100000:2.0:1784094363.558653:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910656 00000100:00100000:2.0:1784094363.558800:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 606 00000100:00100000:2.0:1784094363.558812:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013910656:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:3.0:1784094363.559252:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094363.559341:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013910656:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 531us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094363.559350:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 606 00000100:00100000:2.0:1784094363.562550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094363.562632:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910784 00000100:00100000:0.0:1784094363.562649:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910784 00000100:00100000:0.0:1784094363.562700:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1175 00000100:00100000:0.0:1784094363.562709:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013910784:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094363.563748:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013910784:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 1037us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094363.563760:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1175 00000100:00100000:1.0:1784094363.567227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094363.567371:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013910912 00000100:00100000:3.0:1784094363.567381:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013910912 00000100:00100000:3.0:1784094363.567467:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1176 00000100:00100000:3.0:1784094363.567477:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013910912:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094363.567961:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013910912:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 476us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094363.567969:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1176 00000100:00100000:1.0:1784094363.571600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094363.572329:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013911040 00000100:00100000:0.0:1784094363.572341:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013911040 00000100:00100000:0.0:1784094363.572399:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:0.0:1784094363.572410:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013911040:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094363.572808:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013911040:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 399us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094363.572816:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:2.0:1784094363.574844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094363.575026:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013911168 00000100:00100000:0.0:1784094363.575035:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013911168 00000100:00100000:3.0:1784094363.575218:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 608 00000100:00100000:3.0:1784094363.575230:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013911168:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094363.575748:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:61600:x1870757013911168:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 519us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094363.575757:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 608 00000100:00100000:1.0:1784094363.578786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094363.580089:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013911296 00000100:00100000:2.0:1784094363.580102:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013911296 00000100:00100000:2.0:1784094363.580173:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1177 00000100:00100000:2.0:1784094363.580184:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013911296:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094363.580906:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61600:x1870757013911296:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 722us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094363.580916:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1177 00000100:00100000:1.0:1784094363.598732:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094363.599665:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013911424 00000100:00100000:0.0:1784094363.599679:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013911424 00000100:00100000:0.0:1784094363.599750:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1178 00000100:00100000:0.0:1784094363.599759:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61601:x1870757013911424:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094363.599781:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094363.599803:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f2c expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094363.599869:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094363.599883:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094363.599895:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094363.600102:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00000004:00200000:0.0:1784094363.600107:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094363.600191:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094363.600220:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214cc9d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f2c expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094363.600244:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f2c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094363.600252:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12d00) 00010000:00010000:0.0:1784094363.600255:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094363.600258:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77400, rc 0) 00000100:00100000:0.0:1784094363.600337:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:61601:x1870757013911424:12345-192.168.204.57@tcp:101:rm.0 Request processed in 578us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094363.600344:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1178 00000100:00100000:1.0:1784094363.603729:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094363.603820:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013911680 00000100:00100000:3.0:1784094363.603830:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013911680 00000100:00100000:3.0:1784094363.603889:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1179 00000100:00100000:3.0:1784094363.603900:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61601:x1870757013911680:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094363.603923:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094363.603944:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc9e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f33 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094363.604196:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00010000:3.0:1784094363.604455:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc9e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f33 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.604471:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:3.0:1784094363.604475:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784094363.604480:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cc9e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f33 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.604492:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784094363.604796:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:61601:x1870757013911680:12345-192.168.204.57@tcp:101:rm.0 Request processed in 897us (1075us total) trans 4294967745 rc 301/301 00000100:00100000:3.0:1784094363.604805:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1179 00000100:00100000:1.0:1784094363.610825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094363.611000:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013911808 00000100:00100000:0.0:1784094363.611011:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013911808 00000100:00100000:0.0:1784094363.611072:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 119 00000100:00100000:0.0:1784094363.611083:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:61601:x1870757013911808:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784094363.615632:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:61601:x1870757013911808:12345-192.168.204.57@tcp:37:rm.0 Request processed in 4530us (4800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094363.615647:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 119 00000100:00100000:1.0:1784094363.618595:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094363.618725:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912064 00000100:00100000:3.0:1784094363.618737:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912064 00000100:00100000:3.0:1784094363.618895:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 120 00000100:00100000:3.0:1784094363.618907:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:61601:x1870757013912064:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:3.0:1784094363.619737:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:61601:x1870757013912064:12345-192.168.204.57@tcp:35:rm.0 Request processed in 830us (1150us total) trans 4294967746 rc 0/0 00000100:00100000:3.0:1784094363.619750:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 120 00000100:00100000:1.0:1784094363.623268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094363.623378:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912320 00000100:00100000:2.0:1784094363.623389:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912320 00000100:00100000:2.0:1784094363.623474:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1180 00000100:00100000:2.0:1784094363.623486:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:61601:x1870757013912320:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784094363.623547:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784094363.623576:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77400/0x9ce98053214cc9e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f2c expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623599:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cc985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f17 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623623:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff907219c12d00) 00010000:00010000:2.0:1784094363.623640:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cc691 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5e61 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623648:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fcec00) 00010000:00010000:2.0:1784094363.623656:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094363.623678:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623691:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623700:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623711:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623717:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.623724:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.626117:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.626134:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.626146:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094363.627011:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 7680 00010000:00010000:2.0:1784094363.627029:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627037:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627044:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627050:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094363.627054:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627062:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627073:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784094363.627076:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094363.627080:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627089:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214cca03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627113:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627119:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627124:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627129:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094363.627131:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627137:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627145:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781e00) 00010000:00010000:2.0:1784094363.627148:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094363.627150:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094363.627156:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214cc9f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094363.627171:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000f530d0fb reply state 00000000f4b9f7c1 transno 4294967747 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094363.627180:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094363.627280:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:61601:x1870757013912320:12345-192.168.204.57@tcp:36:rm.0 Request processed in 3794us (4018us total) trans 4294967747 rc 0/0 00000100:00100000:2.0:1784094363.627290:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1180 00010000:00010000:3.0:1784094363.632694:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.632713:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.632721:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.632728:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094363.632732:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.632740:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.632759:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff90721a781000) 00010000:00010000:3.0:1784094363.632762:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094363.632768:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094363.632774:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41400/0x9ce98053214cc9fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094364.137593:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094365.049717:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094365.049754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094365.049782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094365.049809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094365.049835:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912832 00000100:00100000:1.0:1784094365.049848:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912832 00000100:00100000:3.0:1784094365.049867:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912704 00000100:00100000:3.0:1784094365.049877:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912704 00000100:00100000:1.0:1784094365.049909:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 813 00000100:00100000:3.0:1784094365.049918:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 814 00000100:00100000:1.0:1784094365.049924:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013912832:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094365.049932:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013912704:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094365.050016:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912448 00000100:00100000:0.0:1784094365.050022:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912448 00000100:00100000:0.0:1784094365.050057:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 950 00000100:00100000:0.0:1784094365.050065:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013912448:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094365.050116:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912576 00000100:00100000:2.0:1784094365.050121:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912576 00000100:00100000:2.0:1784094365.050165:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1058 00000100:00100000:2.0:1784094365.050177:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013912576:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094365.050243:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013912832:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 324us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094365.050253:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 813 00000100:00100000:3.0:1784094365.051151:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013912704:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1217us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094365.051161:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 814 00000100:00100000:0.0:1784094365.051168:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013912448:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1101us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094365.051178:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 950 00000100:00080000:3.0:1784094365.051194:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094365.051201:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094365.051204:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094365.051358:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013912576:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1184us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094365.051365:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1058 00010000:00010000:3.0:1784094365.161677:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094365.264708:0:103185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa0663fb0 20000000:00000080:0.0:1784094365.264725:0:103185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a78c00 uarg=0000000000000000 00010000:00010000:0.0:1784094365.265298:0:103185:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094365.265315:0:103185:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094365.265330:0:103185:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094365.265348:0:103185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094365.265365:0:103185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cc67c expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094365.265373:0:103185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094365.265413:0:103185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cc67c expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094365.265747:0:103185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cc67c expref: 18 pid: 5770 timeout: 1676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094365.265765:0:103185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103185:1870757024384384:0@lo:104: 00000100:00100000:0.0:1784094365.265829:0:103185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094365.265917:0:103185:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094365.265960:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384384 00000100:00100000:1.0:1784094365.265968:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384384 00000100:00100000:1.0:1784094365.266048:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1784094365.266059:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:103185:x1870757024384384:12345-0@lo:104: 00010000:00010000:1.0:1784094365.266073:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266150:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094365.266157:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:103185:x1870757024384384:12345-0@lo:104: Request processed in 100us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094365.266164:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784094365.266244:0:103185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103185:1870757024384384:0@lo:104: 00010000:00010000:3.0:1784094365.266268:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094365.266268:0:103185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094365.266280:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094365.266293:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094365.266298:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094365.266308:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094365.266316:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094365.266323:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094365.266369:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094365.266377:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094365.266407:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094365.266415:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76400/0x9ce98053214cc67c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cc683 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094365.266451:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1784094365.266463:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094365.266466:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094365.266467:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024384512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094365.266470:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094365.266503:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094365.266637:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384512 00000100:00100000:1.0:1784094365.266642:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384512 00010000:00010000:1.0:1784094365.266662:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc67c expref: 19 pid: 5770 timeout: 1676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094365.266689:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784094365.266695:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024384512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094365.266705:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094365.266710:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cc67c expref: 19 pid: 5770 timeout: 1676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266721:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cc67c expref: 19 pid: 5770 timeout: 1676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266732:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214cc683 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cc67c expref: 19 pid: 5770 timeout: 1676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266750:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266758:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266771:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266778:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266784:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266791:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266796:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094365.266800:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.266808:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094365.266989:0:103185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094365.266998:0:103185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.268118:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.268130:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214cca0a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094365.268148:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094365.268301:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024384512:12345-0@lo:103:ldlm_bl.0 Request processed in 1603us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094365.268309:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784094365.268366:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024384512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094365.673653:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024384768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094365.673706:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024384896:0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.673741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094365.673747:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024384640:0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.673798:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094365.673805:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024385024:0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.673832:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094365.673872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094365.673873:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385024 00000100:00100000:0.0:1784094365.673881:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385024 00000100:00100000:3.0:1784094365.673900:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024385152:0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.673927:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094365.673952:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094365.673957:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1784094365.673961:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024385280:0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.673970:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024385024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.673986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094365.674025:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384896 00000100:00100000:3.0:1784094365.674031:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384896 00000100:00100000:2.0:1784094365.674031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094365.674031:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024385024:12345-0@lo:400:kworker.0 Request processed in 64us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094365.674039:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1784094365.674057:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385280 00000100:00100000:0.0:1784094365.674061:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385280 00000100:00100000:3.0:1784094365.674086:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384640 00000100:00100000:0.0:1784094365.674092:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1784094365.674098:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024385280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.674101:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384640 00000100:00100000:3.0:1784094365.674130:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385152 00000100:00100000:3.0:1784094365.674133:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385152 00000100:00100000:0.0:1784094365.674138:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024385280:12345-0@lo:400:kworker.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094365.674145:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1784094365.674153:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1784094365.674162:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024384896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.674187:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024385024:0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.674203:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024384896:0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.674208:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024384896:12345-0@lo:400:kworker.0 Request processed in 45us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094365.674216:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1784094365.674234:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1784094365.674243:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024384640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.674259:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1784094365.674270:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024385152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.674281:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024384640:12345-0@lo:400:kworker.0 Request processed in 39us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094365.674289:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1784094365.674308:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024385152:12345-0@lo:400:kworker.0 Request processed in 41us (380us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094365.674311:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094365.674317:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00080000:3.0:1784094365.674330:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094365.674333:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094365.674358:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024384768 00000100:00100000:3.0:1784094365.674362:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024384768 00000100:00100000:3.0:1784094365.674404:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1784094365.674412:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024384768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094365.674471:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094365.674511:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024384768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094365.674516:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1784094365.674893:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024385280:0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.674903:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024384640:0@lo:400:kworker.0 00000100:00100000:3.0:1784094365.674908:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024385152:0@lo:400:kworker.0 00000100:00100000:0.0:1784094365.675037:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024384768:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1784094365.706520:0:103233:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd54ee93b0 20000000:00000080:2.0:1784094365.706536:0:103233:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b37800 uarg=0000000000000000 00010000:00010000:2.0:1784094365.706773:0:103233:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094365.706787:0:103233:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094365.706800:0:103233:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094365.706820:0:103233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706836:0:103233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706849:0:103233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706856:0:103233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706864:0:103233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706871:0:103233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706878:0:103233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094365.706882:0:103233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706890:0:103233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706901:0:103233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706908:0:103233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094365.706914:0:103233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214cca11 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094366.186222:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094366.633519:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094366.633527:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094366.633531:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094366.633587:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094366.633600:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094366.633610:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094366.633637:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024385408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094366.633706:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094366.633767:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784094366.633872:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385408 00000100:00100000:3.0:1784094366.633881:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385408 00000100:00100000:3.0:1784094366.633940:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1784094366.633950:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024385408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094366.633968:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094366.633982:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cca18 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094366.634006:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cca18 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094366.634017:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cca18 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094366.634031:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784094366.634079:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024385408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094366.634087:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1784094366.634145:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024385408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094366.634160:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094366.634168:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094366.634186:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094366.634192:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094366.634200:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.214682:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784094367.245529:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967747 is committed 00000100:00100000:0.0:1784094367.566191:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094367.566291:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013912960 00000100:00100000:3.0:1784094367.566303:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013912960 00000100:00080000:0.0:1784094367.567640:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094367.567719:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1181 00000100:00100000:2.0:1784094367.567735:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:61713:x1870757013912960:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094367.567756:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094367.567781:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cca26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f3a expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.567848:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cca2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.567862:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cca2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.567882:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cca2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094367.568089:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784094367.568094:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094367.568170:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cca2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.568196:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cca26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f3a expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.568215:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cca2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f3a expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.568223:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:2.0:1784094367.568226:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094367.568230:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784094367.568299:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:61713:x1870757013912960:12345-192.168.204.57@tcp:101:rm.0 Request processed in 570us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094367.568312:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1181 00000100:00100000:1.0:1784094367.571025:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094367.571087:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013913088 00000100:00100000:3.0:1784094367.571097:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013913088 00000100:00100000:3.0:1784094367.571157:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1182 00000100:00100000:3.0:1784094367.571168:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:61713:x1870757013913088:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094367.571186:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094367.571205:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f41 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571256:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571269:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571280:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571293:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571300:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571306:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571607:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571615:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571621:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571627:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094367.571630:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571640:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571650:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784094367.571652:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094367.571656:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571661:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571672:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571676:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571681:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571685:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094367.571687:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571692:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571698:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce400) 00010000:00010000:3.0:1784094367.571700:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094367.571702:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.571710:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.572524:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f41 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.572545:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784094367.572547:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094367.572551:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f41 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.572560:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784094367.572626:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:61713:x1870757013913088:12345-192.168.204.57@tcp:101:rm.0 Request processed in 1459us (1607us total) trans 0 rc 301/301 00000100:00100000:3.0:1784094367.572633:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1182 00000100:00100000:1.0:1784094367.599224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094367.599784:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013913344 00000100:00100000:3.0:1784094367.599798:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013913344 00000100:00100000:3.0:1784094367.599881:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1183 00000100:00100000:3.0:1784094367.599892:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61717:x1870757013913344:12345-192.168.204.57@tcp:36:mkdir.0 00010000:00010000:3.0:1784094367.599951:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094367.599994:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214cca2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f3a expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.600019:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781600) 00010000:00010000:3.0:1784094367.600033:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094367.600711:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.600728:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.600739:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.600752:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.600825:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.600833:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094367.602014:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 512 00010000:00010000:3.0:1784094367.602028:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.602037:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.602044:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.602050:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094367.602054:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.602061:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.602079:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce400) 00010000:00010000:3.0:1784094367.602082:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094367.602086:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.602093:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094367.602109:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008ed56007 reply state 0000000017962135 transno 4294967748 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094367.602119:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094367.602218:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61717:x1870757013913344:12345-192.168.204.57@tcp:36:mkdir.0 Request processed in 2326us (3004us total) trans 4294967748 rc 0/0 00000100:00100000:3.0:1784094367.602226:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1183 00010000:00010000:1.0:1784094367.604602:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.604619:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.604626:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.604632:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094367.604636:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.604643:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.604658:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce900) 00010000:00010000:1.0:1784094367.604661:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094367.604665:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094367.604671:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094367.634996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094367.635155:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013913472 00000100:00100000:2.0:1784094367.635164:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013913472 00000100:00100000:2.0:1784094367.635231:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1184 00000100:00100000:2.0:1784094367.635242:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:61721:x1870757013913472:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:2.0:1784094367.635267:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094367.635290:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cca57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f48 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.635418:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cca5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.635461:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cca5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.635472:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cca5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094367.635543:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784094367.635547:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094367.635573:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cca5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.635598:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214cca57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f48 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.635618:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cca5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f48 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.635627:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784094367.635630:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094367.635634:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784094367.635697:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61721:x1870757013913472:12345-192.168.204.57@tcp:101:chown.0 Request processed in 457us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094367.635704:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1184 00000100:00100000:0.0:1784094367.638244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094367.638307:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013913600 00000100:00100000:3.0:1784094367.638322:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013913600 00000100:00100000:3.0:1784094367.638374:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1185 00000100:00100000:3.0:1784094367.638384:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61721:x1870757013913600:12345-192.168.204.57@tcp:101:chown.0 00010000:00010000:3.0:1784094367.638403:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094367.638450:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f4f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638509:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638520:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638532:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638555:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638561:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638566:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638640:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638645:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638649:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094367.638674:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 512 00000004:00200000:3.0:1784094367.638677:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094367.638691:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638700:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638704:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638712:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638716:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094367.638965:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638972:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638981:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781a00) 00010000:00010000:3.0:1784094367.638983:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094367.638985:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638989:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cca6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.638998:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639001:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639005:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639008:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094367.639010:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639019:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639027:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce400) 00010000:00010000:3.0:1784094367.639030:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094367.639033:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639038:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cca73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639066:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69800/0x9ce98053214cca65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f4f expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639080:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f4f expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.639087:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784094367.639089:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094367.639091:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094367.639151:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:61721:x1870757013913600:12345-192.168.204.57@tcp:101:chown.0 Request processed in 769us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094367.639159:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1185 00000100:00100000:1.0:1784094367.641805:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094367.641885:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013913856 00000100:00100000:3.0:1784094367.641895:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013913856 00000100:00100000:3.0:1784094367.641985:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1186 00000100:00100000:3.0:1784094367.641996:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+8:61721:x1870757013913856:12345-192.168.204.57@tcp:36:chown.0 00010000:00010000:3.0:1784094367.642049:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094367.642073:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cca7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f4f expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.642091:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784094367.642101:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094367.642123:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.642136:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094367.642145:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784094367.665488:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967749 is committed 00000004:00010000:3.0:1784094367.665589:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000047102203 reply state 0000000035b652f2 transno 4294967749 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094367.665604:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094367.665774:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:3.0:1784094367.665882:0:5777:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784094367.665908:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:61721:x1870757013913856:12345-192.168.204.57@tcp:36:chown.0 Request processed in 23909us (24106us total) trans 4294967749 rc 0/0 00000100:00100000:3.0:1784094367.665918:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1186 00010000:00010000:2.0:1784094367.666381:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.666393:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.666401:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.666408:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094367.666413:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.666455:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.666472:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fce100) 00010000:00010000:2.0:1784094367.666476:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784094367.666480:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094367.666487:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214cca81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094367.721813:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094367.722086:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024385536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094367.722141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094367.722333:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385536 00000100:00100000:2.0:1784094367.722342:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385536 00000100:00080000:0.0:1784094367.722387:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094367.722415:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1784094367.722455:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024385536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094367.722497:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094367.722567:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024385536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094367.722575:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1784094367.722661:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024385536:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1784094368.130335:0:103431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc72f3b2d0 20000000:00000080:2.0:1784094368.130352:0:103431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b36800 uarg=0000000000000000 00010000:00010000:2.0:1784094368.130844:0:103431:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784094368.130880:0:103431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90721a781a00) 00010000:00010000:2.0:1784094368.130884:0:103431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094368.130898:0:103431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214cca5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f48 expref: 5 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.130920:0:103431:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1784094368.130935:0:103431:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094368.130949:0:103431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.130962:0:103431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cca18 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.130971:0:103431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.131006:0:103431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cca18 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.131020:0:103431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cca18 expref: 18 pid: 5770 timeout: 1679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094368.131035:0:103431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103431:1870757024385664:0@lo:104: 00000100:00100000:2.0:1784094368.131096:0:103431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094368.131143:0:103431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784094368.131221:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385664 00000100:00100000:0.0:1784094368.131228:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385664 00000100:00100000:0.0:1784094368.131275:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1784094368.131284:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:103431:x1870757024385664:12345-0@lo:104: 00010000:00010000:0.0:1784094368.131297:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.131359:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094368.131365:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:103431:x1870757024385664:12345-0@lo:104: Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094368.131373:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00010000:00010000:3.0:1784094368.131444:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094368.131452:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094368.131461:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094368.131465:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094368.131475:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094368.131484:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094368.131490:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094368.131542:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094368.131550:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784094368.131564:0:103431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103431:1870757024385664:0@lo:104: 00010000:00010000:3.0:1784094368.131577:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094368.131583:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024385792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094368.131587:0:103431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094368.131590:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76600/0x9ce98053214cca18 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cca1f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094368.131618:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094368.131621:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094368.131624:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094368.131629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094368.131752:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385792 00000100:00100000:1.0:1784094368.131756:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385792 00010000:00010000:1.0:1784094368.131777:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cca18 expref: 19 pid: 5770 timeout: 1679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094368.131811:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1784094368.131820:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024385792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094368.131832:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094368.131837:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cca18 expref: 19 pid: 5770 timeout: 1679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131849:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cca18 expref: 19 pid: 5770 timeout: 1679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131863:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cca1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cca18 expref: 19 pid: 5770 timeout: 1679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131880:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131889:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131902:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131909:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131916:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131922:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131927:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094368.131931:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131939:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131959:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094368.131968:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094368.131986:0:103431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.131996:0:103431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094368.132014:0:103431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41600/0x9ce98053214cca88 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094368.132017:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024385792:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094368.132028:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1784094368.132887:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024385792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094368.233978:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094368.663627:0:103479:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4a43eaf0 20000000:00000080:0.0:1784094368.663646:0:103479:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907103a7bc00 uarg=0000000000000000 00010000:00010000:0.0:1784094368.663858:0:103479:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094368.663873:0:103479:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094368.663885:0:103479:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094368.663905:0:103479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663921:0:103479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663933:0:103479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663940:0:103479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663946:0:103479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663952:0:103479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663959:0:103479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094368.663963:0:103479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663969:0:103479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663984:0:103479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.663993:0:103479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094368.664000:0:103479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214cca8f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094369.258101:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094369.449508:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094369.449516:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094369.449521:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094369.449568:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094369.449580:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094369.449592:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094369.449618:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024385920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094369.449690:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094369.449736:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024385920 00000100:00100000:3.0:1784094369.449744:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024385920 00000100:00100000:0.0:1784094369.449748:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094369.449818:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1784094369.449829:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024385920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094369.449842:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094369.449857:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cca96 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094369.449886:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cca96 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094369.449896:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cca96 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094369.449905:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69800, rc 0) 00000100:00100000:3.0:1784094369.449964:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024385920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094369.449972:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1784094369.450120:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024385920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094369.450137:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094369.450149:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094369.450166:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094369.450171:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094369.450178:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094370.171637:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094370.171926:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094370.171950:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094370.171970:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094370.171992:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013914112 00000100:00100000:0.0:1784094370.172000:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013914112 00000100:00100000:3.0:1784094370.172035:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013914240 00000100:00100000:3.0:1784094370.172040:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013914240 00000100:00100000:3.0:1784094370.172069:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013914368 00000100:00100000:3.0:1784094370.172071:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013914368 00000100:00100000:0.0:1784094370.172073:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1062 00000100:00100000:0.0:1784094370.172083:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013914112:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094370.172089:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 817 00000100:00100000:3.0:1784094370.172099:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013914240:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094370.172154:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013914240:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094370.172161:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 817 00000100:00100000:3.0:1784094370.172177:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 818 00000100:00100000:3.0:1784094370.172184:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013914368:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094370.172563:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013913984 00000100:00100000:2.0:1784094370.172568:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013913984 00000100:00100000:2.0:1784094370.172598:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 953 00000100:00100000:2.0:1784094370.172604:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013913984:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094370.172675:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013914112:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 592us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094370.172682:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1062 00000100:00080000:0.0:1784094370.172706:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094370.172709:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094370.172712:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094370.174852:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013914368:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 2658us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094370.174868:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 818 00000100:00100000:2.0:1784094370.174880:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2354:x1870757013913984:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 2271us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094370.174892:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 953 00010000:00010000:1.0:1784094370.282030:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094370.486594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094370.486743:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013914496 00000100:00100000:0.0:1784094370.486753:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013914496 00000100:00100000:0.0:1784094370.486819:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 18 00000100:00100000:0.0:1784094370.486831:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013914496:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094370.486846:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094370.486850:0:11171:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 9ce98053214cca5e) 00010000:00010000:0.0:1784094370.486852:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094370.486915:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:5559:x1870757013914496:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 86us (332us total) trans 0 rc 116/116 00000100:00100000:0.0:1784094370.486923:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 18 00000100:00100000:3.0:1784094370.793623:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024386176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094370.793689:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024386048:0@lo:400:kworker.0 00000100:00100000:0.0:1784094370.793768:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024386432:0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.793895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094370.793948:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024386560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.793974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094370.793998:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094370.794003:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024386688:0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.794025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094370.794054:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386048 00000100:00100000:1.0:1784094370.794061:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386048 00000100:00100000:1.0:1784094370.794109:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1784094370.794118:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024386048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.794166:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024386048:12345-0@lo:400:kworker.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094370.794173:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1784094370.794204:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386560 00000100:00100000:1.0:1784094370.794207:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386560 00000100:00100000:1.0:1784094370.794243:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1784094370.794249:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024386560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.794279:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024386560:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094370.794286:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1784094370.794302:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386688 00000100:00100000:1.0:1784094370.794305:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386688 00000100:00100000:1.0:1784094370.794335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1784094370.794341:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024386688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.794370:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024386688:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094370.794376:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:1.0:1784094370.794395:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094370.794399:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094370.796344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094370.796388:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784094370.796399:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024386304:0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.796408:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024386688:0@lo:400:kworker.0 00000100:00100000:2.0:1784094370.796750:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386432 00000100:00100000:2.0:1784094370.796757:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386432 00000100:00100000:2.0:1784094370.797622:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1784094370.797635:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024386432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094370.798087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094370.798091:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024386048:0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.798107:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024386560:0@lo:400:kworker.0 00000100:00080000:1.0:1784094370.798149:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094370.798182:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386176 00000100:00100000:3.0:1784094370.798187:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386176 00000100:00100000:3.0:1784094370.798223:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1784094370.798230:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024386176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094370.798258:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094370.798310:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024386176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094370.798317:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00080000:3.0:1784094370.798338:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094370.798564:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024386176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094370.802298:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024386432:12345-0@lo:400:kworker.0 Request processed in 4655us (5950us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094370.802317:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1784094370.802641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094370.802709:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024386816:0@lo:400:kworker.0 00000100:00100000:1.0:1784094370.802744:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094370.802791:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024386432:0@lo:400:kworker.0 00000100:00100000:2.0:1784094370.802849:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386816 00000100:00100000:2.0:1784094370.802856:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386816 00000100:00100000:2.0:1784094370.802906:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1784094370.802914:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024386816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094370.802970:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024386816:12345-0@lo:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094370.802977:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1784094370.803003:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024386816:0@lo:400:kworker.0 00000100:00100000:0.0:1784094370.803079:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386304 00000100:00100000:0.0:1784094370.803084:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386304 00000100:00100000:0.0:1784094370.803151:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1784094370.803158:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024386304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094370.803238:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024386304:12345-0@lo:400:kworker.0 Request processed in 81us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094370.803245:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1784094370.803310:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024386304:0@lo:400:kworker.0 00000100:00100000:3.0:1784094371.044071:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094371.044408:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013914624 00000100:00100000:0.0:1784094371.044452:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013914624 00000100:00100000:0.0:1784094371.044522:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1187 00000100:00100000:0.0:1784094371.044533:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:61826:x1870757013914624:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:0.0:1784094371.044555:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094371.044578:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ccaa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f56 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.044657:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ccaab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.044671:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ccaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.044686:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ccaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094371.044880:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784094371.044886:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1784094371.044956:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ccaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.044980:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77200/0x9ce98053214ccaa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f56 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.044992:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ccaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f56 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.045000:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094371.045003:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094371.045006:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77c00, rc 0) 00000100:00100000:0.0:1784094371.045071:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:61826:x1870757013914624:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 539us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094371.045079:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1187 00000100:00100000:0.0:1784094371.048460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094371.048591:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013914752 00000100:00100000:1.0:1784094371.048600:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013914752 00000100:00100000:1.0:1784094371.048656:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1188 00000100:00100000:1.0:1784094371.048666:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:61826:x1870757013914752:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094371.048688:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094371.048710:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ccab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f5d expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.048777:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.048798:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.048811:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.048826:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.048833:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.048839:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049169:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049179:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049186:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094371.049277:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1784094371.049281:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094371.049354:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049367:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049378:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049385:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049392:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.049396:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049403:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049414:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:1.0:1784094371.049416:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094371.049466:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049483:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049498:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049504:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049510:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049515:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.049519:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049526:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049533:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907219c12000) 00010000:00010000:1.0:1784094371.049536:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094371.049539:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049544:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccac0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049576:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ccab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f5d expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049591:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f5d expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.049598:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907219c12300) 00010000:00010000:1.0:1784094371.049601:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094371.049603:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784094371.049663:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61826:x1870757013914752:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 998us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094371.049670:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1188 00000100:00100000:1.0:1784094371.054530:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.054670:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013915008 00000100:00100000:3.0:1784094371.054682:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013915008 00000100:00100000:3.0:1784094371.054763:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1189 00000100:00100000:3.0:1784094371.054776:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61826:x1870757013915008:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094371.054826:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094371.054852:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f5d expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.054873:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907219c12300) 00010000:00010000:3.0:1784094371.054885:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094371.054910:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.054923:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.054937:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094371.083270:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967750 is committed 00000004:00010000:3.0:1784094371.083291:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000066a0f75 reply state 000000008f84e4b9 transno 4294967750 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.083303:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094371.083455:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00080000:3.0:1784094371.083669:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784094371.083689:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61826:x1870757013915008:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 28912us (29166us total) trans 4294967750 rc 0/0 00000100:00100000:3.0:1784094371.083699:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1189 00010000:00010000:1.0:1784094371.083700:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.083713:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.083719:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.083725:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.083730:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.083738:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.083753:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fce700) 00010000:00010000:1.0:1784094371.083756:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784094371.083761:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.083766:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccace lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094371.116445:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.116557:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013915136 00000100:00100000:3.0:1784094371.116568:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013915136 00000100:00100000:3.0:1784094371.116636:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1190 00000100:00100000:3.0:1784094371.116648:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:61830:x1870757013915136:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094371.116671:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094371.116692:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f64 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.117760:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.117778:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.117789:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.117808:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.117825:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.117841:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118261:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccaea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118268:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccaea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118274:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccaea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094371.118378:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:3.0:1784094371.118383:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094371.118510:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccaea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118525:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118532:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118539:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118550:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.118554:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118562:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118575:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:3.0:1784094371.118578:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.118583:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118589:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccadc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118599:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118605:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118611:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118616:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.118619:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118625:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118637:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce800) 00010000:00010000:3.0:1784094371.118639:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.118642:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118648:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118684:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f64 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118699:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccaea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f64 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.118706:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094371.118708:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784094371.118711:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094371.118780:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61830:x1870757013915136:12345-192.168.204.57@tcp:101:touch.0 Request processed in 2134us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094371.118789:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1190 00000100:00100000:0.0:1784094371.123892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.124723:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013915392 00000100:00100000:3.0:1784094371.124777:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013915392 00000100:00100000:3.0:1784094371.124833:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1191 00000100:00100000:3.0:1784094371.124845:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61830:x1870757013915392:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094371.124868:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094371.124893:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccaf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f6b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.125311:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.125327:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.125339:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.125354:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.125361:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.125367:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094371.126386:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25:0x0], index 1: 0 00010000:00010000:3.0:1784094371.128236:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128260:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128272:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128309:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128321:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128326:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128332:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.128337:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128344:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128355:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094371.128358:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.128362:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128368:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccaf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094371.128379:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000bad26185 reply state 00000000e713e7d4 transno 4294967751 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.128387:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094371.128436:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccaf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f6b expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128450:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f6b expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.128459:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784094371.128461:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094371.128463:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69400, rc 0) 00000100:00100000:3.0:1784094371.128554:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:61830:x1870757013915392:12345-192.168.204.57@tcp:101:touch.0 Request processed in 3702us (4660us total) trans 4294967751 rc 0/0 00000100:00100000:3.0:1784094371.128563:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1191 00010000:00010000:0.0:1784094371.133278:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.133298:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.133306:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.133313:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094371.133318:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.133328:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.133344:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce800) 00010000:00010000:0.0:1784094371.133347:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094371.133352:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.133359:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccaff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094371.135135:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.135228:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013915648 00000100:00100000:3.0:1784094371.135240:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013915648 00000100:00100000:3.0:1784094371.135306:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1192 00000100:00100000:3.0:1784094371.135435:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:61830:x1870757013915648:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:3.0:1784094371.135504:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094371.135531:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f6b expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.135547:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907204fce200) 00010000:00010000:3.0:1784094371.135557:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094371.135598:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.135611:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.135619:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094371.135750:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000009929cbd9 reply state 0000000001225315 transno 4294967752 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.135764:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094371.135862:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:61830:x1870757013915648:12345-192.168.204.57@tcp:36:touch.0 Request processed in 547us (735us total) trans 4294967752 rc 0/0 00000100:00100000:3.0:1784094371.135868:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1192 00010000:00010000:3.0:1784094371.141188:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.141207:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.141215:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.141222:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.141227:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094371.141235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:3.0:1784094371.141242:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.141260:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784094371.141264:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.141269:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.141276:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094371.141637:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013915776 00000100:00100000:0.0:1784094371.141648:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013915776 00000100:00100000:0.0:1784094371.141742:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1193 00000100:00100000:0.0:1784094371.141753:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:61830:x1870757013915776:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094371.141777:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094371.141795:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ccb1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f72 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.141860:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ccb1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f72 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.141875:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ccb1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f72 expref: 10 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.141897:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907202e6b300) 00010000:00010000:0.0:1784094371.141900:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784094371.141903:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094371.141970:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+10:61830:x1870757013915776:12345-192.168.204.57@tcp:101:touch.0 Request processed in 218us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094371.141977:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1193 00000100:00100000:0.0:1784094371.144573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.145941:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013915904 00000100:00100000:3.0:1784094371.145955:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013915904 00000100:00100000:3.0:1784094371.146026:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 609 00000100:00100000:3.0:1784094371.146037:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013915904:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:3.0:1784094371.146338:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013915904:12345-192.168.204.57@tcp:2:touch.0 Request processed in 304us (1774us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1784094371.146343:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 609 00000100:00100000:3.0:1784094371.149290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094371.149389:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013916160 00000100:00100000:1.0:1784094371.149399:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013916160 00000100:00100000:1.0:1784094371.149503:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 121 00000100:00100000:1.0:1784094371.149514:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:61830:x1870757013916160:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:1.0:1784094371.149861:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:61830:x1870757013916160:12345-192.168.204.57@tcp:35:touch.0 Request processed in 347us (580us total) trans 4294967753 rc 0/0 00000100:00100000:1.0:1784094371.149873:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 121 00000100:00100000:1.0:1784094371.178271:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.178406:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013916288 00000100:00100000:3.0:1784094371.178417:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013916288 00000100:00100000:3.0:1784094371.178615:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1194 00000100:00100000:3.0:1784094371.178629:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:61834:x1870757013916288:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:3.0:1784094371.178653:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094371.178674:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f79 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178757:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178771:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178783:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178798:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178870:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178881:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178970:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178980:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.178987:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094371.179018:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x62:0x0]: returning size 0 00000004:00200000:3.0:1784094371.179022:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094371.179041:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179053:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179061:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179068:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179075:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179082:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.179085:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179091:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179100:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094371.179102:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.179106:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179109:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccb29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179118:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179121:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179124:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179127:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.179129:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179132:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179136:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce000) 00010000:00010000:3.0:1784094371.179137:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.179138:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179141:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179166:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f79 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179174:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f79 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.179178:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907202e6b300) 00010000:00010000:3.0:1784094371.179180:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094371.179181:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69600, rc 0) 00000100:00100000:3.0:1784094371.179231:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:61834:x1870757013916288:12345-192.168.204.57@tcp:101:rm.0 Request processed in 608us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094371.179236:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1194 00000100:00100000:0.0:1784094371.180963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094371.181011:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013916416 00000100:00100000:1.0:1784094371.181018:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013916416 00000100:00100000:1.0:1784094371.181058:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 610 00000100:00100000:1.0:1784094371.181065:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013916416:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094371.181077:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094371.181090:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f80 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784094371.181109:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x6a571ea3, atime: 0x6a571ea3, ctime: 0x6a571ea3, blocks: 0x1 00010000:00010000:1.0:1784094371.181124:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=1532s v=(0 0) 00010000:00010000:1.0:1784094371.181127:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094371.181134:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.181147:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.181155:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094371.181196:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013916416:12345-192.168.204.57@tcp:101:rm.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094371.181200:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 610 00000100:00100000:0.0:1784094371.183793:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.183886:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013916672 00000100:00100000:3.0:1784094371.183896:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013916672 00000100:00100000:3.0:1784094371.184071:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1195 00000100:00100000:3.0:1784094371.184083:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:61834:x1870757013916672:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094371.184136:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094371.184165:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f79 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184187:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76600/0x9ce98053214ccb1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f72 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184198:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907202e6b300) 00010000:00010000:3.0:1784094371.184212:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094371.184234:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184247:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184256:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184270:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184292:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184300:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184409:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184417:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.184455:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094371.185054:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off10560 00000004:00080000:3.0:1784094371.185066:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1532262643560ns, next at 1533262641105ns, rc = 0 00010000:00010000:3.0:1784094371.185129:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185138:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185150:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185157:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185163:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185169:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185196:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094371.185216:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185224:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185230:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185236:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.185239:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185246:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185255:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907204fce500) 00010000:00010000:3.0:1784094371.185258:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094371.185262:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185268:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185283:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185289:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185294:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185300:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.185303:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185308:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185316:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094371.185318:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.185321:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.185327:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094371.185337:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000008bf38a9c reply state 00000000862bdba3 transno 4294967754 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.185350:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094371.185454:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:61834:x1870757013916672:12345-192.168.204.57@tcp:36:rm.0 Request processed in 1373us (1668us total) trans 4294967754 rc 0/0 00000100:00100000:3.0:1784094371.185462:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1195 00010000:00010000:2.0:1784094371.185542:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094371.185549:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.185556:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094371.185559:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.185565:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.185575:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff907204fce500) 00010000:00010000:2.0:1784094371.185577:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094371.185581:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.185587:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccb5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.185606:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094371.185608:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094371.185609:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094371.192056:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.192076:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.192085:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.192091:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094371.192097:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.192109:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.192127:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce200) 00010000:00010000:0.0:1784094371.192130:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094371.192134:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.192140:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccb4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.305625:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094371.755684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.755741:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013916800 00000100:00100000:3.0:1784094371.755753:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013916800 00000100:00100000:3.0:1784094371.755817:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1196 00000100:00100000:3.0:1784094371.755828:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+11:61849:x1870757013916800:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:3.0:1784094371.755852:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094371.755875:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f87 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.755940:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.756013:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.756027:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094371.756093:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:3.0:1784094371.756097:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094371.756121:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.756147:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccb61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f87 expref: 13 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.756169:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f87 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.756179:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fceb00) 00010000:00010000:3.0:1784094371.756182:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094371.756186:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784094371.756256:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:61849:x1870757013916800:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 429us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094371.756264:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1196 00000100:00100000:3.0:1784094371.761859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094371.762083:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013917056 00000100:00100000:0.0:1784094371.762092:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013917056 00000100:00100000:0.0:1784094371.762150:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1197 00000100:00100000:0.0:1784094371.762162:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:61849:x1870757013917056:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094371.762213:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094371.762242:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccb68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f87 expref: 12 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.762261:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccaea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f64 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.762269:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fceb00) 00010000:00010000:0.0:1784094371.762277:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094371.762298:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.762310:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.762317:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094371.795601:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000090045204 reply state 000000000e715dad transno 4294967755 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094371.795621:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094371.795808:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:0.0:1784094371.795921:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:61849:x1870757013917056:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 33757us (34070us total) trans 4294967755 rc 0/0 00000100:00100000:0.0:1784094371.795931:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1197 00000001:00080000:0.0:1784094371.795979:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967755 is committed 00000004:00080000:0.0:1784094371.795996:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00010000:00010000:3.0:1784094371.798794:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.798811:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.798819:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.798826:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.798832:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.798840:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.798857:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907202e6b000) 00010000:00010000:3.0:1784094371.798861:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094371.798867:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.798874:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccb6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094371.799060:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094371.799077:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024386944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784094371.799143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094371.800844:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024386944 00000100:00100000:3.0:1784094371.800856:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024386944 00000100:00100000:3.0:1784094371.801275:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1784094371.801287:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024386944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784094371.801316:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:37 count 1 00010000:00010000:3.0:1784094371.801338:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.801359:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.801368:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094371.801372:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094371.801376:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.801406:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.801833:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 6 pid: 53396 timeout: 1632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.801856:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024387072:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094371.801952:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094371.806510:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8031:1870757024387072:192.168.204.57@tcp:104: 00010000:00010000:3.0:1784094371.806545:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094371.808855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.808947:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013917184 00000100:00100000:3.0:1784094371.808958:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013917184 00010000:00010000:3.0:1784094371.809000:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 7 pid: 53396 timeout: 1632 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.809134:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 367 00000100:00100000:3.0:1784094371.809146:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013917184:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784094371.809162:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094371.809169:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 7 pid: 53396 timeout: 1632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.809183:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 7 pid: 53396 timeout: 1632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.809208:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac8a4942/0x9ce98053214ccb3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f80 expref: 7 pid: 53396 timeout: 1632 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.809229:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094371.809234:0:7457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094371.809241:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.809262:0:7457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.809299:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094371.809360:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013917184:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 217us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094371.809367:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 367 00010000:00010000:3.0:1784094371.810205:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.810218:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.810228:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.810235:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.810502:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784094371.810714:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094371.810721:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.810731:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094371.810735:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.810744:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.810760:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.810767:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f1a097/0x9ce98053214ccb76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.810789:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094371.810791:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094371.810792:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094371.811597:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024386944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10310us (12451us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1784094371.811608:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000004:00080000:1.0:1784094371.811627:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230cbf100/2, rc 0, transno 4294967371 00000100:00100000:1.0:1784094371.811634:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024386944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784094371.840719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.840832:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013917312 00000100:00100000:3.0:1784094371.840845:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013917312 00000100:00100000:3.0:1784094371.840959:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1198 00000100:00100000:3.0:1784094371.840972:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:61853:x1870757013917312:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:3.0:1784094371.841002:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094371.841023:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f8e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.841095:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.841110:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.841122:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.841136:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.841143:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.841150:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.841887:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.841901:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.841910:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094371.841995:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094371.841999:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094371.842074:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842087:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842094:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842101:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842107:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094371.842111:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842118:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842130:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:2.0:1784094371.842133:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094371.842138:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842144:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccb84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842155:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842161:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842167:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842172:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094371.842175:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842181:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842188:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907204fce000) 00010000:00010000:2.0:1784094371.842190:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094371.842192:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842210:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccb8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842254:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccb7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f8e expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842269:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f8e expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.842277:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784094371.842292:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094371.842295:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094371.842400:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61853:x1870757013917312:12345-192.168.204.57@tcp:101:touch.0 Request processed in 1432us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094371.842409:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1198 00000100:00100000:3.0:1784094371.845665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094371.845814:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013917568 00000100:00100000:0.0:1784094371.845830:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013917568 00000100:00100000:0.0:1784094371.846170:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1199 00000100:00100000:0.0:1784094371.846183:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:61853:x1870757013917568:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:0.0:1784094371.846204:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094371.846226:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccb99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f95 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.846621:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.846637:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.846648:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.846662:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.846669:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.846676:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784094371.848054:0:5779:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26:0x0], index 0: 0 00010000:00010000:0.0:1784094371.848774:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ccbae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.848998:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ccbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849011:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ccbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849058:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849070:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849077:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849083:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094371.849088:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849096:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849108:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781f00) 00010000:00010000:0.0:1784094371.849111:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094371.849116:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849123:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76800/0x9ce98053214ccba0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094371.849137:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000348e41e2 reply state 00000000d1efb2eb transno 4294967756 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094371.849146:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784094371.849183:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccb99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f95 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849199:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ccbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f95 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.849212:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094371.849215:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784094371.849217:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76c00, rc 0) 00000100:00100000:0.0:1784094371.852635:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:61853:x1870757013917568:12345-192.168.204.57@tcp:101:touch.0 Request processed in 6438us (6963us total) trans 4294967756 rc 0/0 00000100:00100000:0.0:1784094371.852656:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1199 00010000:00010000:3.0:1784094371.858951:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.858970:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.858978:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.858983:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.858989:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.858997:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.859014:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907202e6ba00) 00010000:00010000:3.0:1784094371.859017:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.859022:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.859029:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76a00/0x9ce98053214ccba7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.859598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094371.859659:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013917824 00000100:00100000:0.0:1784094371.859670:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013917824 00000100:00100000:0.0:1784094371.859729:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1200 00000100:00100000:0.0:1784094371.859739:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:61853:x1870757013917824:12345-192.168.204.57@tcp:36:touch.0 00010000:00010000:0.0:1784094371.859851:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094371.859875:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214ccbae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f95 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.859889:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff907202e6b800) 00010000:00010000:0.0:1784094371.859899:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094371.860010:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.860023:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.860034:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094371.860169:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000def7edc8 reply state 00000000cc1c5d0f transno 4294967757 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094371.860184:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094371.860662:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:61853:x1870757013917824:12345-192.168.204.57@tcp:36:touch.0 Request processed in 922us (1066us total) trans 4294967757 rc 0/0 00000100:00100000:0.0:1784094371.860670:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1200 00010000:00010000:3.0:1784094371.861925:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.861938:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.861945:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.861956:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094371.861962:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.861969:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.861982:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff907202e6bf00) 00010000:00010000:3.0:1784094371.861985:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094371.861989:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094371.861995:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214ccbbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094371.862958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094371.863026:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013917952 00000100:00100000:2.0:1784094371.863035:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013917952 00000100:00100000:2.0:1784094371.863089:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1201 00000100:00100000:2.0:1784094371.863099:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:61853:x1870757013917952:12345-192.168.204.57@tcp:101:touch.0 00010000:00010000:2.0:1784094371.863124:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094371.863151:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccbc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5f9c expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.863205:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccbc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f9c expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.863220:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccbc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f9c expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.863245:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784094371.863248:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784094371.863250:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784094371.863731:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:61853:x1870757013917952:12345-192.168.204.57@tcp:101:touch.0 Request processed in 632us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094371.863739:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1201 00000100:00100000:1.0:1784094371.866622:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094371.866711:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013918080 00000100:00100000:3.0:1784094371.866720:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013918080 00000100:00100000:3.0:1784094371.866840:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:3.0:1784094371.866852:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013918080:12345-192.168.204.57@tcp:2:touch.0 00000100:00100000:3.0:1784094371.867176:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013918080:12345-192.168.204.57@tcp:2:touch.0 Request processed in 326us (562us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1784094371.867183:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 612 00000100:00100000:1.0:1784094371.868731:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094371.868828:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013918336 00000100:00100000:0.0:1784094371.868837:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013918336 00000100:00100000:0.0:1784094371.868889:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 122 00000100:00100000:0.0:1784094371.868899:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:61853:x1870757013918336:12345-192.168.204.57@tcp:35:touch.0 00000100:00100000:0.0:1784094371.869194:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:61853:x1870757013918336:12345-192.168.204.57@tcp:35:touch.0 Request processed in 295us (468us total) trans 4294967758 rc 0/0 00000100:00100000:0.0:1784094371.869202:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 122 00000100:00100000:0.0:1784094371.890756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094371.891811:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013918464 00000100:00100000:1.0:1784094371.891823:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013918464 00000100:00100000:1.0:1784094371.891882:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1202 00000100:00100000:1.0:1784094371.891896:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:61857:x1870757013918464:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:1.0:1784094371.891924:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094371.891945:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ccbca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fa3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892009:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892024:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892035:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892050:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892056:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892060:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892136:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892141:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892145:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094371.892171:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x63:0x0]: returning size 0 00000004:00200000:1.0:1784094371.892175:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094371.892189:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892198:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892203:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892207:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892211:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892215:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.892217:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892224:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892234:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781f00) 00010000:00010000:1.0:1784094371.892237:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094371.892241:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892247:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13800/0x9ce98053214ccbd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892258:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892281:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892286:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892290:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.892292:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892298:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892315:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907219c12700) 00010000:00010000:1.0:1784094371.892318:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784094371.892321:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892326:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214ccbd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892355:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12a00/0x9ce98053214ccbca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fa3 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892369:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fa3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.892377:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff90721a781400) 00010000:00010000:1.0:1784094371.892378:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784094371.892380:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12200, rc 0) 00000100:00100000:1.0:1784094371.892496:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:61857:x1870757013918464:12345-192.168.204.57@tcp:101:rm.0 Request processed in 604us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094371.892505:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1202 00000100:00100000:1.0:1784094371.894602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094371.894677:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013918592 00000100:00100000:0.0:1784094371.894687:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013918592 00000100:00100000:0.0:1784094371.894741:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 613 00000100:00100000:0.0:1784094371.894753:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2354:x1870757013918592:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094371.894771:0:53396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094371.894789:0:53396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5faa expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784094371.894814:0:53396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x6a571ea4, atime: 0x6a571ea4, ctime: 0x6a571ea4, blocks: 0x1 00010000:00010000:0.0:1784094371.894831:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=1532s v=(0 0) 00010000:00010000:0.0:1784094371.894835:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094371.894843:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.894868:0:53396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 7 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.894881:0:53396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77a00, rc 0) 00000100:00100000:0.0:1784094371.894938:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013918592:12345-192.168.204.57@tcp:101:rm.0 Request processed in 187us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094371.894944:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 613 00000100:00100000:0.0:1784094371.899198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094371.899399:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013918848 00000100:00100000:2.0:1784094371.899410:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013918848 00000100:00100000:2.0:1784094371.899498:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1203 00000100:00100000:2.0:1784094371.899510:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:61857:x1870757013918848:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:2.0:1784094371.899562:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094371.899589:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12200/0x9ce98053214ccbdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fa3 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899610:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccbc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f9c expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899705:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff90721a781400) 00010000:00010000:2.0:1784094371.899717:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094371.899738:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899751:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899761:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899774:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899780:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899786:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899879:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899886:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.899893:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094371.901039:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off10624 00000004:00080000:2.0:1784094371.901051:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1532978627715ns, next at 1533978625345ns, rc = 0 00010000:00010000:2.0:1784094371.901110:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901120:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901128:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901136:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901147:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901152:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901174:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094371.901195:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901201:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901208:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901209:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094371.901219:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.901220:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901224:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901235:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094371.901239:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901241:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901257:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff90721a781d00) 00010000:00010000:2.0:1784094371.901262:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094371.901266:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901266:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901282:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccbfb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901288:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff90721a781d00) 00010000:00010000:1.0:1784094371.901292:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784094371.901296:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901301:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901303:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccc02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901321:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901328:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094371.901331:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094371.901334:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094371.901336:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:1.0:1784094371.901337:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094371.901343:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901350:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901358:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784094371.901361:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094371.901364:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094371.901370:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccbed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094371.901380:0:5809:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000007f6f21d6 reply state 0000000045fb17f1 transno 4294967759 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094371.901388:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094371.901526:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:61857:x1870757013918848:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2016us (2335us total) trans 4294967759 rc 0/0 00000100:00100000:2.0:1784094371.901534:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1203 00010000:00010000:0.0:1784094371.903181:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.903196:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.903203:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.903210:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094371.903214:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.903222:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.903236:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff90721a781000) 00010000:00010000:0.0:1784094371.903238:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094371.903241:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094371.903246:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccbf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.331001:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094372.399744:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.399883:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013918976 00000100:00100000:2.0:1784094372.399894:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013918976 00000100:00100000:2.0:1784094372.399965:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1204 00000100:00100000:2.0:1784094372.399978:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:61871:x1870757013918976:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784094372.400001:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094372.400022:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccc09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fb1 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.400080:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccc10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.400094:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.400108:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094372.400166:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094372.400170:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094372.400193:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.400220:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccc09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fb1 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.400236:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccc10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fb1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.400245:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781f00) 00010000:00010000:2.0:1784094372.400248:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094372.400252:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784094372.400322:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:61871:x1870757013918976:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 347us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094372.400329:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1204 00000100:00080000:3.0:1784094372.400381:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094372.409514:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094372.412397:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013919232 00000100:00100000:1.0:1784094372.412415:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013919232 00000100:00100000:1.0:1784094372.412598:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1205 00000100:00100000:1.0:1784094372.412612:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:61871:x1870757013919232:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:1.0:1784094372.412675:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784094372.412706:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccc10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fb1 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.412728:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f8e expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.412740:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781f00) 00010000:00010000:1.0:1784094372.412753:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094372.412780:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.412794:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.412804:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784094372.413095:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000077e7fc15 reply state 00000000b3bdc5f1 transno 4294967760 ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094372.413106:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784094372.413123:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:1.0:1784094372.413255:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:61871:x1870757013919232:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 646us (3832us total) trans 4294967760 rc 0/0 00000100:00100000:1.0:1784094372.413263:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1205 00010000:00010000:3.0:1784094372.416033:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.416057:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.416065:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.416072:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094372.416077:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.416084:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.416102:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907219c12700) 00010000:00010000:3.0:1784094372.416105:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094372.416110:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.416116:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12800/0x9ce98053214ccc17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094372.489823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.489928:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013919360 00000100:00100000:2.0:1784094372.489938:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013919360 00000100:00100000:2.0:1784094372.489999:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1206 00000100:00100000:2.0:1784094372.490010:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013919360:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094372.490113:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013919360:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094372.490121:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1206 00000100:00100000:1.0:1784094372.492576:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.492694:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013919488 00000100:00100000:3.0:1784094372.492702:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013919488 00000100:00100000:3.0:1784094372.492762:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 614 00000100:00100000:3.0:1784094372.492777:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61883:x1870757013919488:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094372.493126:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:61883:x1870757013919488:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 354us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094372.493134:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 614 00000100:00080000:1.0:1784094372.493418:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094372.494924:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.495330:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013919616 00000100:00100000:3.0:1784094372.495340:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013919616 00000100:00100000:3.0:1784094372.495405:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 615 00000100:00100000:3.0:1784094372.495416:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:61883:x1870757013919616:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094372.495759:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:61883:x1870757013919616:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 346us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094372.495767:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 615 00000100:00080000:1.0:1784094372.495864:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094372.498610:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.498839:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013919744 00000100:00100000:2.0:1784094372.498851:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013919744 00000100:00100000:2.0:1784094372.498955:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1207 00000100:00100000:2.0:1784094372.498967:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013919744:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094372.499340:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013919744:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 375us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094372.499346:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1207 00000100:00100000:0.0:1784094372.502537:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094372.502596:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013919872 00000100:00100000:1.0:1784094372.502607:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013919872 00000100:00100000:1.0:1784094372.502670:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1208 00000100:00100000:1.0:1784094372.502680:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013919872:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094372.502767:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013919872:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094372.502775:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1208 00000100:00100000:1.0:1784094372.504552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094372.504647:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920000 00000100:00100000:0.0:1784094372.504655:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920000 00000100:00100000:0.0:1784094372.504713:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 616 00000100:00100000:0.0:1784094372.504723:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61883:x1870757013920000:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094372.505115:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:61883:x1870757013920000:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 393us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094372.505124:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 616 00000100:00100000:0.0:1784094372.511925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.512049:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920128 00000100:00100000:3.0:1784094372.512060:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920128 00000100:00100000:3.0:1784094372.512125:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:3.0:1784094372.512136:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:61883:x1870757013920128:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094372.512589:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:61883:x1870757013920128:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 454us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094372.512598:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 617 00000100:00100000:0.0:1784094372.520797:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.520913:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920256 00000100:00100000:2.0:1784094372.520924:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920256 00000100:00100000:2.0:1784094372.520974:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1209 00000100:00100000:2.0:1784094372.520982:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013920256:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:2.0:1784094372.521343:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:61883:x1870757013920256:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 360us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094372.521350:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1209 00000100:00100000:1.0:1784094372.564368:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.564476:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920384 00000100:00100000:2.0:1784094372.564487:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920384 00000100:00100000:2.0:1784094372.564550:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1210 00000100:00100000:2.0:1784094372.564561:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:61887:x1870757013920384:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:2.0:1784094372.564582:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094372.564604:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccc1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fb8 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.564678:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.564692:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.564703:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.564719:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.564726:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.564734:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567722:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccc33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567737:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567746:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094372.567781:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094372.567784:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094372.567801:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567812:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567816:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567820:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567824:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094372.567827:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567831:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567839:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:2.0:1784094372.567841:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094372.567844:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567848:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40200/0x9ce98053214ccc25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567856:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567862:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567866:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567869:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094372.567870:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567873:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567877:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff90721a781400) 00010000:00010000:2.0:1784094372.567878:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094372.567880:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567883:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41200/0x9ce98053214ccc2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567913:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccc1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fb8 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567922:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fb8 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.567926:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784094372.567927:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094372.567929:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094372.567991:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:61887:x1870757013920384:12345-192.168.204.57@tcp:101:dd.0 Request processed in 3431us (3633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094372.568000:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1210 00000100:00100000:0.0:1784094372.571079:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.571150:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920640 00000100:00100000:3.0:1784094372.571159:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920640 00000100:00100000:3.0:1784094372.571227:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1211 00000100:00100000:3.0:1784094372.571239:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+12:61887:x1870757013920640:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784094372.571261:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094372.571282:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccc3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fbf expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.571417:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.571461:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.571477:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.571539:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.571546:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.571550:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094372.572078:0:8381:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26:0x0], index 1: 0 00010000:00010000:3.0:1784094372.572236:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccc4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572246:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572254:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccc4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572288:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572294:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572300:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572305:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094372.572309:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572316:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572327:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:3.0:1784094372.572330:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094372.572335:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572342:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094372.572355:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000005a6a2abf reply state 00000000a6e147f8 transno 4294967761 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094372.572364:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094372.572390:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69000/0x9ce98053214ccc3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fbf expref: 15 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572406:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccc4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fbf expref: 14 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.572412:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784094372.572414:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094372.572417:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68000, rc 0) 00000100:00100000:3.0:1784094372.572633:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+15:61887:x1870757013920640:12345-192.168.204.57@tcp:101:dd.0 Request processed in 1396us (1560us total) trans 4294967761 rc 0/0 00000100:00100000:3.0:1784094372.572642:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1211 00010000:00010000:3.0:1784094372.574825:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.574843:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.574851:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.574857:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094372.574862:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.574870:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.574886:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fcea00) 00010000:00010000:3.0:1784094372.574889:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094372.574894:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.574900:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094372.578238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.579049:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920768 00000100:00100000:3.0:1784094372.579062:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920768 00000100:00100000:3.0:1784094372.579115:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 618 00000100:00100000:3.0:1784094372.579126:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:61887:x1870757013920768:12345-192.168.204.57@tcp:101:dd.0 00010000:00010000:3.0:1784094372.579147:0:6573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094372.579169:0:6573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fc6 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784094372.579202:0:6573:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784094372.579223:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=1533s v=(0 0) 00010000:00010000:3.0:1784094372.579228:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094372.579238:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 7 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.579258:0:6573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 7 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094372.579272:0:6573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094372.579337:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:61887:x1870757013920768:12345-192.168.204.57@tcp:101:dd.0 Request processed in 213us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094372.579345:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 618 00000100:00100000:0.0:1784094372.590689:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.591022:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013920896 00000100:00100000:3.0:1784094372.591039:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013920896 00002000:00100000:3.0:1784094372.591121:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff907230cbc700 x1870757013920896/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:693/0 lens 488/0 e 0 to 0 dl 1784094383 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784094372.591132:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230cbc700 with x1870757013920896 ext(0->1048575) 00002000:00010000:3.0:1784094372.591139:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230cbc700 00000100:00100000:3.0:1784094372.591177:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 30 00000100:00100000:3.0:1784094372.591187:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013920896:12345-192.168.204.57@tcp:4:dd.0 00000100:00100000:3.0:1784094372.607363:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013920896:12345-192.168.204.57@tcp:4:dd.0 Request processed in 16166us (16672us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1784094372.607377:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 30 00002000:00100000:3.0:1784094372.607391:0:6577:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff907230cbc700 x1870757013920896/t4294967372(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:693/0 lens 488/448 e 0 to 0 dl 1784094383 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784094372.607402:0:6577:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff907230cbc700 with x1870757013920896 ext(0->1048575) 00002000:00010000:3.0:1784094372.607409:0:6577:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907230cbc700 00000100:00100000:0.0:1784094372.611978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.612138:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921024 00000100:00100000:2.0:1784094372.612148:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921024 00000100:00100000:2.0:1784094372.612267:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1212 00000100:00100000:2.0:1784094372.612278:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+14:61887:x1870757013921024:12345-192.168.204.57@tcp:44:dd.0 00000001:00080000:1.0:1784094372.650166:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967758 is committed 00000001:00080000:1.0:1784094372.650185:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967760 is committed 00000004:00080000:1.0:1784094372.650194:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000001:00080000:1.0:1784094372.650214:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967761 is committed 00000100:00100000:1.0:1784094372.650392:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024387200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784094372.650490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094372.650516:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024387200 00000100:00100000:2.0:1784094372.650524:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024387200 00000100:00100000:2.0:1784094372.650588:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1784094372.650597:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024387200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784094372.650699:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:38 count 1 00010000:00010000:2.0:1784094372.650727:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.650804:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.650814:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784094372.650818:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094372.650823:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.650851:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 6 pid: 53396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.650871:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 6 pid: 53396 timeout: 1633 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094372.650884:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024387328:192.168.204.57@tcp:104: 00000100:00100000:2.0:1784094372.650941:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072012ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1784094372.651010:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:61887:x1870757013921024:12345-192.168.204.57@tcp:44:dd.0 Request processed in 38733us (39043us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094372.651019:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1212 00000100:00080000:2.0:1784094372.651088:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094372.653624:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6574:1870757024387328:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094372.653657:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094372.654531:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.654599:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921152 00000100:00100000:3.0:1784094372.654609:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921152 00000100:00100000:0.0:1784094372.654641:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094372.654670:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 620 00000100:00100000:3.0:1784094372.654682:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013921152:12345-192.168.204.57@tcp:16:dd.0 00000100:00100000:1.0:1784094372.655066:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921280 00000100:00100000:1.0:1784094372.655072:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921280 00010000:00010000:1.0:1784094372.655100:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 7 pid: 53396 timeout: 1633 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094372.655129:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 368 00000100:00100000:1.0:1784094372.655136:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013921280:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094372.655147:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094372.655153:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 7 pid: 53396 timeout: 1633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655172:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 7 pid: 53396 timeout: 1633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655194:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba17077a/0x9ce98053214ccbe6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5faa expref: 7 pid: 53396 timeout: 1633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655209:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094372.655213:0:5764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094372.655229:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655240:0:5764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655740:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094372.655808:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013921280:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 669us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094372.655818:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 368 00010000:00010000:1.0:1784094372.655963:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655974:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655985:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.655993:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094372.656018:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094372.656057:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094372.656066:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.656077:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094372.656082:0:5766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.656093:0:5766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.656107:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.656121:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335d6a64/0x9ce98053214ccc64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094372.656142:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094372.656144:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094372.656146:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784094372.658067:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723ca61f80/2, rc 0, transno 4294967373 00000100:00100000:3.0:1784094372.658080:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024387200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784094372.658136:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024387200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7539us (7645us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1784094372.658146:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1784094372.688902:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:2353:x1870757013921152:12345-192.168.204.57@tcp:16:dd.0 Request processed in 34212us (34366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094372.688917:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 620 00000001:00080000:1.0:1784094372.689017:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000001:00080000:1.0:1784094372.689032:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000100:00100000:0.0:1784094372.694024:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094372.694230:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921536 00000100:00100000:2.0:1784094372.694241:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921536 00000100:00100000:2.0:1784094372.694353:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 123 00000100:00100000:2.0:1784094372.694365:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:61887:x1870757013921536:12345-192.168.204.57@tcp:35:dd.0 00000100:00100000:2.0:1784094372.694872:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:61887:x1870757013921536:12345-192.168.204.57@tcp:35:dd.0 Request processed in 507us (857us total) trans 4294967762 rc 0/0 00000100:00100000:2.0:1784094372.694881:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 123 00000100:00100000:1.0:1784094372.841768:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094372.841797:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024387456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094372.841901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094372.842063:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024387456 00000100:00100000:3.0:1784094372.842074:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024387456 00000100:00100000:3.0:1784094372.842277:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1784094372.842293:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024387456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094372.842341:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094372.842401:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024387456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094372.842409:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1784094372.842529:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024387456:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1784094373.304262:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967762 is committed 00010000:00010000:1.0:1784094373.354635:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784094373.890295:0:103869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1534967870598ns, next at 1533978625345ns, rc = 0 00000004:00080000:0.0:1784094373.890403:0:103869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1534967980756ns, next at 1533262641105ns, rc = 0 00000004:00080000:2.0:1784094373.892396:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00000004:00080000:2.0:1784094373.892455:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00010000:00010000:2.0:1784094374.377626:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094374.516227:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00000001:00080000:2.0:1784094374.516241:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00000100:00100000:0.0:1784094374.573911:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094374.573970:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921664 00000100:00100000:1.0:1784094374.573981:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921664 00000100:00080000:3.0:1784094374.574048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094374.574065:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1213 00000100:00100000:1.0:1784094374.574078:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013921664:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094374.574172:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013921664:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094374.574179:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1213 00000100:00100000:1.0:1784094374.577060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094374.577220:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921792 00000100:00100000:3.0:1784094374.577230:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921792 00000100:00080000:0.0:1784094374.577312:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094374.577335:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 621 00000100:00100000:3.0:1784094374.577349:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62079:x1870757013921792:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094374.577736:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62079:x1870757013921792:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 390us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094374.577745:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 621 00000100:00100000:3.0:1784094374.579055:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094374.579108:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013921920 00000100:00100000:1.0:1784094374.579118:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013921920 00000100:00100000:1.0:1784094374.579168:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 622 00000100:00080000:0.0:1784094374.579172:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094374.579176:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62079:x1870757013921920:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094374.579504:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62079:x1870757013921920:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 318us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094374.579512:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 622 00000100:00100000:0.0:1784094374.581186:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094374.581282:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922048 00000100:00100000:3.0:1784094374.581291:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922048 00000100:00100000:3.0:1784094374.581381:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1214 00000100:00100000:3.0:1784094374.581392:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013922048:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094374.581782:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013922048:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 392us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094374.581791:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1214 00000100:00100000:1.0:1784094374.585022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094374.585109:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922176 00000100:00100000:0.0:1784094374.585119:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922176 00000100:00100000:0.0:1784094374.585168:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1215 00000100:00100000:0.0:1784094374.585179:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013922176:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094374.585273:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013922176:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094374.585280:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1215 00000100:00100000:1.0:1784094374.586801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094374.588486:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922304 00000100:00100000:2.0:1784094374.588498:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922304 00000100:00100000:2.0:1784094374.588558:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 623 00000100:00100000:2.0:1784094374.588569:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:62079:x1870757013922304:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094374.588958:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:62079:x1870757013922304:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 390us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094374.588966:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 623 00000100:00100000:2.0:1784094374.590996:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094374.591049:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922432 00000100:00100000:0.0:1784094374.591058:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922432 00000100:00100000:0.0:1784094374.591103:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:0.0:1784094374.591120:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:62079:x1870757013922432:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:0.0:1784094374.591478:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:62079:x1870757013922432:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 358us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094374.591485:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 624 00000100:00100000:0.0:1784094374.592818:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094374.592866:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922560 00000100:00100000:1.0:1784094374.592877:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922560 00000100:00100000:1.0:1784094374.592930:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1216 00000100:00100000:1.0:1784094374.592942:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013922560:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:1.0:1784094374.594039:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62079:x1870757013922560:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 1097us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094374.594050:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1216 00000100:00100000:1.0:1784094374.622613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094374.622674:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922816 00000100:00100000:3.0:1784094374.622685:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922816 00000100:00100000:3.0:1784094374.622751:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1217 00000100:00100000:3.0:1784094374.622763:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62083:x1870757013922816:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:3.0:1784094374.622816:0:8381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094374.622845:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccc4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fbf expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.622865:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff907204fce000) 00010000:00010000:3.0:1784094374.622876:0:8381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094374.622899:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.622914:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.622923:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.622937:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.622949:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.622956:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.623348:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.623357:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.623365:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094374.624363:0:8381:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 64 off10624 00000004:00080000:3.0:1784094374.624374:0:8381:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1535701951376ns, next at 1536701948939ns, rc = 0 00010000:00010000:3.0:1784094374.624505:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624516:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624524:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624531:0:8381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624538:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624549:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624568:0:8381:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094374.624588:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094374.624592:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094374.624595:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094374.624602:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624603:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624619:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094374.624623:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624630:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624637:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff907204fcea00) 00010000:00010000:3.0:1784094374.624639:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094374.624643:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624648:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccc79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624662:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624667:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624673:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624677:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094374.624681:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094374.624682:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094374.624688:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624692:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094374.624700:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624704:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:3.0:1784094374.624709:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094374.624713:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094374.624713:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff907204fcea00) 00010000:00010000:2.0:1784094374.624720:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094374.624726:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094374.624727:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccc6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094374.624743:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68800/0x9ce98053214ccc80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094374.624748:0:8381:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c39a90fe reply state 00000000789fcf87 transno 4294967763 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094374.624759:0:8381:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784094374.624770:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094374.624773:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094374.624776:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094374.624902:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+9:62083:x1870757013922816:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2138us (2295us total) trans 4294967763 rc 0/0 00000100:00100000:3.0:1784094374.624910:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1217 00010000:00010000:0.0:1784094374.626830:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094374.626845:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094374.626857:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094374.626862:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094374.626867:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094374.626874:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094374.626887:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce800) 00010000:00010000:0.0:1784094374.626891:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094374.626894:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094374.626900:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69600/0x9ce98053214ccc72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094375.289155:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094375.289196:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094375.289237:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013922944 00000100:00100000:1.0:1784094375.289237:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094375.289249:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013922944 00000100:00100000:1.0:1784094375.289279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094375.289282:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923200 00000100:00100000:3.0:1784094375.289288:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923200 00000100:00100000:2.0:1784094375.289313:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 955 00000100:00100000:3.0:1784094375.289325:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923328 00000100:00100000:2.0:1784094375.289327:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013922944:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094375.289328:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923328 00000100:00100000:3.0:1784094375.289347:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 821 00000100:00100000:3.0:1784094375.289362:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013923200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094375.289366:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 822 00000100:00100000:1.0:1784094375.289379:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013923328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094375.289414:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013922944:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094375.289454:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 955 00000100:00100000:3.0:1784094375.289466:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013923200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094375.289468:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923072 00000100:00100000:0.0:1784094375.289475:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923072 00000100:00100000:3.0:1784094375.289480:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 821 00000100:00100000:0.0:1784094375.289520:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1066 00000100:00100000:0.0:1784094375.289532:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013923072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094375.289584:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:2355:x1870757013923072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094375.289591:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1066 00000100:00100000:1.0:1784094375.289789:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2355:x1870757013923328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 411us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094375.289797:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 822 00010000:00010000:3.0:1784094375.401548:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784094375.687637:0:104017:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1536765211077ns, next at 1533978625345ns, rc = 0 00000004:00080000:1.0:1784094375.687761:0:104017:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1536765338542ns, next at 1536701948939ns, rc = 0 00000004:00080000:2.0:1784094375.715565:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000001:00080000:2.0:1784094375.715609:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967763 is committed 00000004:00080000:2.0:1784094375.715615:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000100:00100000:2.0:1784094375.715771:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024387584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784094375.715841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094375.715928:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024387584 00000100:00100000:3.0:1784094375.715936:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024387584 00000100:00100000:3.0:1784094375.716011:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1784094375.716023:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024387584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784094375.716051:0:6573:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:38 count 1 00010000:00010000:3.0:1784094375.716077:0:6573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.716099:0:6573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.716108:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x26:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1784094375.716112:0:6573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784094375.716115:0:6573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.716137:0:6573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 5 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.716147:0:6573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 5 pid: 6573 timeout: 1636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094375.716160:0:6573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024387712:192.168.204.57@tcp:104: 00000100:00100000:3.0:1784094375.716218:0:6573:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab1d80 going to sleep for 11 seconds 00000100:00080000:2.0:1784094375.716532:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094375.718199:0:6573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6573:1870757024387712:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094375.718223:0:6573:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094375.718416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000004:00080000:1.0:1784094375.718688:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000100:00100000:0.0:1784094375.719003:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923456 00000100:00100000:0.0:1784094375.719011:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923456 00010000:00010000:0.0:1784094375.719046:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 6 pid: 6573 timeout: 1636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094375.719088:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 369 00000100:00100000:0.0:1784094375.719098:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013923456:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784094375.719113:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094375.719119:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 6 pid: 6573 timeout: 1636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094375.719133:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 6 pid: 6573 timeout: 1636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094375.719159:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c916881/0x9ce98053214ccc5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fc6 expref: 6 pid: 6573 timeout: 1636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094375.719175:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094375.719179:0:11171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784094375.719185:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094375.719301:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094375.719371:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094375.719474:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013923456:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 376us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094375.719483:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 369 00010000:00010000:3.0:1784094375.719585:0:6573:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.719596:0:6573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.719607:0:6573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.719616:0:6573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094375.719666:0:6573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784094375.720293:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024387584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4271us (4450us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1784094375.720303:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1784094375.720335:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:2.0:1784094375.720342:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230cbf100, transno 4294967371 00000100:00100000:2.0:1784094375.720363:0:3301:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff90723ca63b80 x1870757024387584/t4294967373(4294967373) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784094391 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1784094375.720373:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723ca63b80/2, rc 0, transno 4294967373 00010000:00010000:1.0:1784094375.720658:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094375.720665:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094375.720675:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094375.720680:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094375.720692:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094375.720709:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094375.720718:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc6f077/0x9ce98053214ccc87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094375.720744:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094375.720747:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094375.720750:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094375.720756:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024387584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094375.913827:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094375.913851:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024387840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094375.913920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094375.914071:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024387840 00000100:00100000:0.0:1784094375.914078:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024387968:0@lo:400:kworker.0 00000100:00100000:0.0:1784094375.914116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094375.914144:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094375.914150:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024388096:0@lo:400:kworker.0 00000100:00100000:0.0:1784094375.914173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094375.914216:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024387968 00000100:00100000:0.0:1784094375.914222:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024387968 00000100:00100000:2.0:1784094375.914251:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024388352:0@lo:400:kworker.0 00000100:00100000:0.0:1784094375.914269:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1784094375.914280:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024387968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094375.914288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094375.914314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094375.914321:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024388224:0@lo:400:kworker.0 00000100:00100000:0.0:1784094375.914333:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024387968:12345-0@lo:400:kworker.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094375.914342:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1784094375.914351:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094375.914399:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388352 00000100:00100000:0.0:1784094375.914403:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388096 00000100:00100000:2.0:1784094375.914404:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388352 00000100:00100000:0.0:1784094375.914410:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388096 00000100:00100000:0.0:1784094375.914463:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388224 00000100:00100000:0.0:1784094375.914467:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388224 00000100:00100000:2.0:1784094375.914477:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1784094375.914486:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094375.914495:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1784094375.914505:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024388096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094375.914534:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024388352:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094375.914542:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1784094375.914548:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024388096:12345-0@lo:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094375.914596:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024387840 00000100:00100000:3.0:1784094375.914629:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1784094375.914629:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1784094375.914640:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024387840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094375.914669:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784094375.914686:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094375.914698:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024388480:0@lo:400:kworker.0 00000100:00100000:3.0:1784094375.914714:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024387840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094375.914723:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1784094375.914732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094375.914748:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388480 00000100:00100000:3.0:1784094375.914753:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388480 00000100:00100000:2.0:1784094375.915356:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1784094375.915368:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024388224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094375.915418:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024388224:12345-0@lo:400:kworker.0 Request processed in 54us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094375.915444:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:2.0:1784094375.915468:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094375.915472:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094375.915516:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024387840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094375.915545:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024388224:0@lo:400:kworker.0 00000100:00100000:2.0:1784094375.915558:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:2.0:1784094375.915563:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723ca61f80, transno 4294967373 00000100:00100000:2.0:1784094375.915578:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024388352:0@lo:400:kworker.0 00000100:00100000:2.0:1784094375.915993:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024388096:0@lo:400:kworker.0 00000100:00100000:2.0:1784094375.916006:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024387968:0@lo:400:kworker.0 00000100:00100000:3.0:1784094375.916994:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1784094375.917015:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024388480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094375.917412:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024388480:12345-0@lo:400:kworker.0 Request processed in 407us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094375.917444:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1784094375.917800:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024388480:0@lo:400:kworker.0 00010000:00010000:1.0:1784094376.426655:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094377.454568:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094377.961632:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024388608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094377.961714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094377.961815:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388608 00000100:00100000:1.0:1784094377.961824:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388608 00000100:00100000:1.0:1784094377.961892:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1784094377.961903:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024388608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094377.961945:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094377.961996:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024388608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094377.962003:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00080000:1.0:1784094377.962024:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094377.962066:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024388608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094378.475018:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094379.498252:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094380.026904:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00000100:00100000:2.0:1784094380.410707:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094380.411048:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923584 00000100:00100000:0.0:1784094380.411059:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923584 00000100:00100000:0.0:1784094380.411117:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 957 00000100:00100000:0.0:1784094380.411128:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013923584:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094380.411207:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013923584:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 80us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094380.411216:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 957 00000100:00100000:1.0:1784094380.411510:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094380.411626:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094380.411648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094380.411671:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923712 00000100:00100000:0.0:1784094380.411676:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923712 00000100:00080000:2.0:1784094380.411704:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094380.411723:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1070 00000100:00100000:0.0:1784094380.411732:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013923712:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094380.411775:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013923712:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094380.411781:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1070 00000100:00100000:3.0:1784094380.412460:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923840 00000100:00100000:3.0:1784094380.412467:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923840 00000100:00100000:3.0:1784094380.412566:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013923968 00000100:00100000:3.0:1784094380.412570:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013923968 00000100:00080000:2.0:1784094380.412594:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094380.412597:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094380.412622:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 824 00000100:00100000:0.0:1784094380.412632:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013923840:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094380.412681:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 825 00000100:00100000:3.0:1784094380.412688:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013923968:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094380.412937:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013923968:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 248us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094380.412937:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013923840:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 306us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094380.412945:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 824 00000100:00100000:3.0:1784094380.412948:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 825 00010000:00010000:1.0:1784094380.521807:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094381.033953:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024388736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094381.034039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094381.034110:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094381.034118:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024388864:0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094381.034187:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024388992:0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034194:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388736 00000100:00100000:2.0:1784094381.034203:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388736 00000100:00100000:1.0:1784094381.034227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094381.034234:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024389120:0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034276:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1784094381.034305:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024388736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094381.034306:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024389376:0@lo:400:kworker.0 00000100:00100000:1.0:1784094381.034341:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784094381.034347:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094381.034362:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388992 00000100:00100000:1.0:1784094381.034366:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094381.034369:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388992 00000100:00100000:1.0:1784094381.034375:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024389248:0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034403:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024388736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094381.034409:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389376 00000100:00100000:1.0:1784094381.034413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094381.034415:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389376 00000100:00100000:2.0:1784094381.034415:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1784094381.034456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094381.034472:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389120 00000100:00100000:2.0:1784094381.034475:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024388864 00000100:00100000:3.0:1784094381.034477:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389120 00000100:00100000:1.0:1784094381.034482:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1784094381.034483:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024388864 00000100:00100000:1.0:1784094381.034496:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094381.034497:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1784094381.034506:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024389376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094381.034518:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1784094381.034525:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1784094381.034532:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034539:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094381.034543:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024388992:12345-0@lo:400:kworker.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094381.034543:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024389376:12345-0@lo:400:kworker.0 Request processed in 37us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094381.034552:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1784094381.034558:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1784094381.034592:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024388992:0@lo:400:kworker.0 00000100:00100000:0.0:1784094381.034592:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024389376:0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034595:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024388864:12345-0@lo:400:kworker.0 Request processed in 60us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094381.034599:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024389120:12345-0@lo:400:kworker.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094381.034612:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1784094381.034616:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1784094381.034628:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024389120:0@lo:400:kworker.0 00000100:00100000:1.0:1784094381.034639:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389248 00000100:00100000:1.0:1784094381.034643:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389248 00000100:00100000:2.0:1784094381.034672:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024388864:0@lo:400:kworker.0 00000100:00080000:0.0:1784094381.034675:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094381.034680:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00080000:0.0:1784094381.034681:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094381.034685:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094381.034688:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094381.034691:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:2.0:1784094381.034697:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723ca63b80, transno 4294967373 00000100:00100000:2.0:1784094381.034718:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024388736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094381.034738:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024389248:12345-0@lo:400:kworker.0 Request processed in 50us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094381.034746:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1784094381.034796:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024389248:0@lo:400:kworker.0 00010000:00010000:2.0:1784094381.546661:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094382.569643:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094383.081729:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094383.081796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094383.081930:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389504 00000100:00100000:1.0:1784094383.081937:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389504 00000100:00100000:1.0:1784094383.082001:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00080000:0.0:1784094383.082006:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094383.082131:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094383.082167:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094383.082223:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 213us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094383.082236:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1784094383.082287:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024389504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094383.593628:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094384.617796:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094385.532759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094385.532815:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924096 00000100:00100000:0.0:1784094385.532833:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924096 00000100:00100000:2.0:1784094385.532855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094385.532893:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094385.532922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094385.532926:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924352 00000100:00100000:1.0:1784094385.532932:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924352 00000100:00100000:2.0:1784094385.532966:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924224 00000100:00100000:2.0:1784094385.532972:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924224 00000100:00100000:1.0:1784094385.532984:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924480 00000100:00100000:1.0:1784094385.532989:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924480 00000100:00100000:1.0:1784094385.533022:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 827 00000100:00100000:1.0:1784094385.533032:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924352:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094385.533067:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1074 00000100:00100000:2.0:1784094385.533079:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013924224:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094385.533126:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924352:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094385.533128:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013924224:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094385.533144:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1074 00000100:00100000:1.0:1784094385.533144:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 827 00000100:00100000:1.0:1784094385.533168:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 828 00000100:00100000:1.0:1784094385.533183:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924480:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:2.0:1784094385.533192:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094385.533214:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094385.533217:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094385.533226:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924480:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094385.533233:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 828 00000100:00100000:0.0:1784094385.533327:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 959 00000100:00100000:0.0:1784094385.533336:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013924096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094385.533390:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013924096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 56us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094385.533396:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 959 00010000:00010000:2.0:1784094385.641615:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094386.153631:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094386.153657:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094386.153734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094386.153860:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389632 00000100:00100000:1.0:1784094386.153869:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389632 00000100:00100000:1.0:1784094386.153941:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1784094386.153952:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024389632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094386.153990:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094386.154090:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024390144:0@lo:400:kworker.0 00000100:00100000:0.0:1784094386.154110:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024389760:0@lo:400:kworker.0 00000100:00100000:3.0:1784094386.154130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094386.154160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094386.154165:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094386.154215:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024389632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094386.154224:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1784094386.154256:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024389888:0@lo:400:kworker.0 00000100:00100000:0.0:1784094386.154261:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024390272:0@lo:400:kworker.0 00000100:00100000:0.0:1784094386.154306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094386.154349:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389760 00000100:00100000:1.0:1784094386.154354:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389760 00000100:00100000:3.0:1784094386.154359:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024390016:0@lo:400:kworker.0 00000100:00100000:0.0:1784094386.154367:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390272 00000100:00100000:0.0:1784094386.154372:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390272 00000100:00100000:3.0:1784094386.154399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094386.154408:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1784094386.154418:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024389760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094386.154491:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024389760:12345-0@lo:400:kworker.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094386.154499:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00080000:1.0:1784094386.154535:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094386.154540:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094386.154605:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390016 00000100:00100000:0.0:1784094386.154611:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390016 00000100:00100000:0.0:1784094386.154651:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1784094386.154659:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094386.154692:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1784094386.154702:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024390016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094386.155479:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024389760:0@lo:400:kworker.0 00000100:00080000:1.0:1784094386.155847:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094386.155895:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390144 00000100:00100000:1.0:1784094386.155901:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390144 00000100:00100000:1.0:1784094386.155944:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1784094386.155952:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024390144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094386.156006:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024390144:12345-0@lo:400:kworker.0 Request processed in 55us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094386.156012:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:1.0:1784094386.156033:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094386.156063:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094386.156100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094386.156133:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024389888 00000100:00100000:1.0:1784094386.156137:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024389888 00000100:00100000:1.0:1784094386.156159:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1784094386.156165:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024389888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094386.156223:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024389888:12345-0@lo:400:kworker.0 Request processed in 48us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094386.156229:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1784094386.156259:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024389888:0@lo:400:kworker.0 00000100:00100000:3.0:1784094386.156477:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024390144:0@lo:400:kworker.0 00000100:00100000:2.0:1784094386.156604:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024390016:12345-0@lo:400:kworker.0 Request processed in 1901us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094386.156615:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1784094386.156670:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024390272:0@lo:400:kworker.0 00000100:00100000:0.0:1784094386.156709:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024390272:12345-0@lo:400:kworker.0 Request processed in 1985us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094386.156720:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1784094386.156978:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024390016:0@lo:400:kworker.0 00010000:00010000:3.0:1784094386.665636:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094387.690789:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094388.201789:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024390400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094388.201861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094388.201918:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390400 00000100:00100000:1.0:1784094388.201928:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390400 00000100:00080000:2.0:1784094388.201977:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094388.201995:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1784094388.202007:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024390400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094388.202043:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094388.202113:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024390400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094388.202121:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1784094388.202254:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024390400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094388.713716:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094389.737622:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094390.649155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094390.649275:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094390.649316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094390.649328:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924736 00000100:00100000:1.0:1784094390.649339:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924736 00000100:00100000:2.0:1784094390.649360:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00080000:2.0:1784094390.649385:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094390.649400:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924864 00000100:00100000:2.0:1784094390.649405:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924864 00000100:00100000:1.0:1784094390.649414:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1078 00000100:00100000:2.0:1784094390.649466:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924992 00000100:00100000:2.0:1784094390.649471:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924992 00000100:00100000:1.0:1784094390.649472:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013924736:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094390.649494:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 830 00000100:00100000:2.0:1784094390.649503:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924864:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094390.649608:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 831 00000100:00100000:3.0:1784094390.649616:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924992:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094390.649666:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013924608 00000100:00100000:0.0:1784094390.649670:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013924608 00000100:00100000:0.0:1784094390.649692:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 961 00000100:00100000:0.0:1784094390.649696:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013924608:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094390.649742:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013924736:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 318us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094390.649749:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1078 00000100:00100000:2.0:1784094390.651071:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924864:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1562us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094390.651082:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 830 00000100:00100000:3.0:1784094390.651121:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013924992:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1502us (1757us total) trans 0 rc 0/0 00000100:00080000:2.0:1784094390.651127:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094390.651132:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 831 00000100:00080000:2.0:1784094390.651134:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094390.651351:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013924608:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1651us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094390.651360:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 961 00010000:00010000:3.0:1784094390.761885:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094391.232862:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094391.232929:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925120 00000100:00100000:3.0:1784094391.232940:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925120 00000100:00100000:3.0:1784094391.233107:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1218 00000100:00100000:3.0:1784094391.233118:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013925120:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094391.233681:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013925120:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 562us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094391.233691:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1218 00000100:00100000:3.0:1784094391.235812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094391.236187:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925248 00000100:00100000:2.0:1784094391.236198:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925248 00000100:00100000:2.0:1784094391.236261:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 626 00000100:00100000:2.0:1784094391.236272:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925248:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:2.0:1784094391.236631:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925248:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 360us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094391.236640:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 626 00000100:00100000:0.0:1784094391.238283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094391.238362:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925376 00000100:00100000:3.0:1784094391.238371:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925376 00000100:00100000:3.0:1784094391.238439:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 627 00000100:00100000:3.0:1784094391.238449:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925376:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:3.0:1784094391.238761:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925376:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 313us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094391.238770:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 627 00000100:00100000:0.0:1784094391.241351:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094391.241405:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925504 00000100:00100000:3.0:1784094391.241415:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925504 00000100:00100000:3.0:1784094391.241480:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1219 00000100:00100000:3.0:1784094391.241492:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013925504:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094391.242490:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013925504:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 999us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094391.242501:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1219 00000100:00100000:3.0:1784094391.245938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094391.245974:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925632 00000100:00100000:3.0:1784094391.245983:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925632 00000100:00100000:3.0:1784094391.246029:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1220 00000100:00100000:3.0:1784094391.246039:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013925632:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:3.0:1784094391.246136:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013925632:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094391.246143:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1220 00000100:00100000:1.0:1784094391.255322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094391.255371:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925760 00000100:00100000:1.0:1784094391.255382:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925760 00000100:00100000:1.0:1784094391.255458:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 628 00000100:00100000:1.0:1784094391.255469:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925760:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094391.255871:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925760:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 403us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094391.255880:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 628 00000100:00100000:0.0:1784094391.260447:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094391.260659:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013925888 00000100:00100000:1.0:1784094391.260668:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013925888 00000100:00100000:1.0:1784094391.260764:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 629 00000100:00100000:1.0:1784094391.260776:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925888:12345-192.168.204.57@tcp:19:lfs.0 00000100:00100000:1.0:1784094391.261199:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:62340:x1870757013925888:12345-192.168.204.57@tcp:19:lfs.0 Request processed in 425us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094391.261208:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 629 00000100:00100000:1.0:1784094391.266698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094391.267129:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013926016 00000100:00100000:0.0:1784094391.267140:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013926016 00000100:00100000:0.0:1784094391.267199:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1221 00000100:00100000:0.0:1784094391.267213:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013926016:12345-192.168.204.57@tcp:48:lfs.0 00000100:00100000:0.0:1784094391.267885:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62340:x1870757013926016:12345-192.168.204.57@tcp:48:lfs.0 Request processed in 675us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094391.267894:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1221 00000100:00100000:1.0:1784094391.273698:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024390528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094391.273767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094391.273871:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390528 00000100:00100000:2.0:1784094391.273879:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390528 00000100:00100000:2.0:1784094391.273955:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1784094391.273965:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024390528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094391.273999:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094391.274049:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024390528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094391.274055:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1784094391.274112:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024390528:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094391.274118:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094391.274607:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024390784:0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.274649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094391.274684:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094391.274693:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024390912:0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.274724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094391.274762:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024391040:0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.274778:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390784 00000100:00100000:0.0:1784094391.274784:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390784 00000100:00100000:2.0:1784094391.274791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094391.274811:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784094391.274816:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024390656:0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.274822:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390912 00000100:00100000:0.0:1784094391.274827:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390912 00000100:00100000:2.0:1784094391.274842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094391.274873:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024391168:0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.274886:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1784094391.274899:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094391.274902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094391.274934:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024390656 00000100:00100000:2.0:1784094391.274937:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024390656 00000100:00100000:0.0:1784094391.274960:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024390784:12345-0@lo:400:kworker.0 Request processed in 65us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094391.274962:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1784094391.274970:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024390656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.274974:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1784094391.274993:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391168 00000100:00100000:0.0:1784094391.274997:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391168 00000100:00100000:2.0:1784094391.274998:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024390656:12345-0@lo:400:kworker.0 Request processed in 29us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094391.275004:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1784094391.275024:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1784094391.275033:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391040 00000100:00100000:0.0:1784094391.275033:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024390912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094391.275037:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391040 00000100:00100000:2.0:1784094391.275064:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1784094391.275070:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024391040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.275074:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024390912:12345-0@lo:400:kworker.0 Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094391.275082:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1784094391.275113:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1784094391.275119:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024391040:12345-0@lo:400:kworker.0 Request processed in 48us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094391.275123:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024391168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094391.275139:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1784094391.275160:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024391168:12345-0@lo:400:kworker.0 Request processed in 40us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094391.275167:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00080000:0.0:1784094391.275188:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094391.275192:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094391.275207:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024390912:0@lo:400:kworker.0 00000100:00100000:0.0:1784094391.275215:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024390784:0@lo:400:kworker.0 00000100:00100000:2.0:1784094391.275530:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024390656:0@lo:400:kworker.0 00000100:00100000:2.0:1784094391.275546:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024391168:0@lo:400:kworker.0 00000100:00100000:2.0:1784094391.275554:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024391040:0@lo:400:kworker.0 00010000:00010000:3.0:1784094391.789016:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094392.054216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094392.054461:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013926144 00000100:00100000:1.0:1784094392.054470:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013926144 00000100:00100000:1.0:1784094392.054545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1222 00000100:00100000:1.0:1784094392.054556:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:62354:x1870757013926144:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094392.054577:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094392.054598:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ccc8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fcd expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.054662:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccc95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.054677:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.054690:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094392.054877:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1784094392.054881:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094392.054958:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784094392.054982:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094392.054987:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13c00/0x9ce98053214ccc8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fcd expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.055004:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccc95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fcd expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.055013:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:1.0:1784094392.055016:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094392.055020:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094392.055086:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:62354:x1870757013926144:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 533us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094392.055095:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1222 00000100:00100000:1.0:1784094392.057227:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094392.057400:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013926400 00000100:00100000:0.0:1784094392.057410:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013926400 00000100:00100000:0.0:1784094392.057495:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1223 00000100:00100000:0.0:1784094392.057506:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:62354:x1870757013926400:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094392.057631:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094392.057657:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12000/0x9ce98053214ccc95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fcd expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.057676:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccc33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fb8 expref: 7 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.057687:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:0.0:1784094392.057700:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094392.057726:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.057737:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.057746:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094392.089261:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000c36dda87 reply state 000000008fc2150f transno 4294967764 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094392.089279:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784094392.089566:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:0.0:1784094392.089664:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:62354:x1870757013926400:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 32156us (32441us total) trans 4294967764 rc 0/0 00000100:00100000:0.0:1784094392.089674:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1223 00000001:00080000:0.0:1784094392.089713:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967764 is committed 00010000:00010000:0.0:1784094392.090542:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.090555:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.090562:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.090569:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094392.090573:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.090580:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.090596:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907202e6be00) 00010000:00010000:0.0:1784094392.090599:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784094392.090604:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.090682:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77800/0x9ce98053214ccc9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094392.120348:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094392.120467:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013926528 00000100:00100000:2.0:1784094392.120475:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013926528 00000100:00100000:2.0:1784094392.120526:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1224 00000100:00100000:2.0:1784094392.120536:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62358:x1870757013926528:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784094392.120559:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094392.120605:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fd4 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.120669:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.120680:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.120688:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.120698:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.120702:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.120706:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121107:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cccb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121117:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cccb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121123:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cccb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094392.121192:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094392.121195:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094392.121248:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cccb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121257:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121261:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121266:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121270:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094392.121273:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121277:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121287:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:2.0:1784094392.121289:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094392.121292:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121296:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214cccaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121304:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121308:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121311:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121314:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094392.121316:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121319:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121322:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff90721a781200) 00010000:00010000:2.0:1784094392.121324:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094392.121325:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121328:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214cccb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121348:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fd4 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121361:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cccb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fd4 expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.121366:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781900) 00010000:00010000:2.0:1784094392.121367:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094392.121369:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094392.121458:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62358:x1870757013926528:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 923us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094392.121467:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1224 00000100:00100000:0.0:1784094392.124693:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094392.124857:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013926784 00000100:00100000:3.0:1784094392.124868:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013926784 00000100:00100000:3.0:1784094392.124925:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1225 00000100:00100000:3.0:1784094392.124937:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62358:x1870757013926784:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:3.0:1784094392.124961:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094392.124981:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fdb expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.125651:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.125669:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.125681:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.125696:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.125703:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.125709:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094392.126973:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27:0x0], index 0: 0 00010000:00010000:3.0:1784094392.127280:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cccd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127291:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cccd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127346:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cccd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127379:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127384:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127388:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127392:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.127395:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127399:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127407:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781900) 00010000:00010000:3.0:1784094392.127409:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094392.127412:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127416:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094392.127452:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000d1130b2b reply state 0000000090c0def5 transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094392.127460:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094392.127491:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fdb expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127517:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cccd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fdb expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.127523:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff907204fce100) 00010000:00010000:3.0:1784094392.127525:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094392.127526:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784094392.127586:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+10:62358:x1870757013926784:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 2652us (2902us total) trans 4294967765 rc 0/0 00000100:00100000:3.0:1784094392.127594:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1225 00010000:00010000:3.0:1784094392.128662:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.128674:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.128680:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.128686:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.128690:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.128696:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.128706:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce300) 00010000:00010000:3.0:1784094392.128708:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094392.128711:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.128728:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccccd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094392.131102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094392.131350:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013927040 00000100:00100000:2.0:1784094392.131361:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013927040 00000100:00100000:2.0:1784094392.131461:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1226 00000100:00100000:2.0:1784094392.131473:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:62358:x1870757013927040:12345-192.168.204.57@tcp:36:touch.60003 00010000:00010000:2.0:1784094392.131527:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094392.131552:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214cccd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fdb expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.131569:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff907204fce100) 00010000:00010000:2.0:1784094392.131579:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094392.131623:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.131635:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.131645:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784094392.131766:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000dcee0535 reply state 0000000082f32b88 transno 4294967766 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094392.131775:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094392.131863:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:62358:x1870757013927040:12345-192.168.204.57@tcp:36:touch.60003 Request processed in 392us (766us total) trans 4294967766 rc 0/0 00000100:00100000:2.0:1784094392.131874:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1226 00010000:00010000:3.0:1784094392.134575:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.134592:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.134600:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.134607:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.134612:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094392.134619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00010000:00010000:3.0:1784094392.134624:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.134641:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff90721a781200) 00010000:00010000:3.0:1784094392.134645:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094392.134649:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.134655:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40800/0x9ce98053214ccce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094392.134819:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013927168 00000100:00100000:1.0:1784094392.134830:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013927168 00000100:00100000:1.0:1784094392.134880:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1227 00000100:00100000:1.0:1784094392.134891:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:62358:x1870757013927168:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:1.0:1784094392.134914:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094392.134995:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ccce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fe2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.135441:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ccce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fe2 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.135458:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ccce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fe2 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.135480:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff907219c12500) 00010000:00010000:1.0:1784094392.135483:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784094392.135486:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094392.135752:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+10:62358:x1870757013927168:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 861us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094392.135760:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1227 00000100:00100000:1.0:1784094392.138088:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094392.138144:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013927296 00000100:00100000:3.0:1784094392.138153:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013927296 00000100:00100000:3.0:1784094392.138238:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00100000:3.0:1784094392.138257:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013927296:12345-192.168.204.57@tcp:2:touch.60003 00000100:00080000:0.0:1784094392.138261:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094392.138630:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013927296:12345-192.168.204.57@tcp:2:touch.60003 Request processed in 374us (560us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1784094392.138637:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 630 00000100:00100000:0.0:1784094392.140391:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094392.140596:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013927552 00000100:00100000:3.0:1784094392.140606:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013927552 00000100:00100000:3.0:1784094392.140705:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 124 00000100:00100000:3.0:1784094392.140724:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:62358:x1870757013927552:12345-192.168.204.57@tcp:35:touch.60003 00000100:00100000:3.0:1784094392.141031:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+11:62358:x1870757013927552:12345-192.168.204.57@tcp:35:touch.60003 Request processed in 316us (646us total) trans 4294967767 rc 0/0 00000100:00100000:3.0:1784094392.141040:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 124 00000100:00100000:0.0:1784094392.169191:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094392.169282:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013927680 00000100:00100000:3.0:1784094392.169292:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013927680 00000100:00100000:3.0:1784094392.169343:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1228 00000100:00100000:3.0:1784094392.169352:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:62362:x1870757013927680:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:3.0:1784094392.169375:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094392.169394:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cccf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5fe9 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169599:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169615:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169627:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169656:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169664:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169671:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169764:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169772:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169779:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094392.169809:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x65:0x0]: returning size 0 00000004:00200000:3.0:1784094392.169813:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094392.169832:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169843:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169850:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169856:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169865:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169870:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.169874:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169882:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169893:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781900) 00010000:00010000:3.0:1784094392.169896:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094392.169900:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169907:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214cccf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169919:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169924:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169929:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169934:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.169936:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169945:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169951:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce300) 00010000:00010000:3.0:1784094392.169953:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094392.169956:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169961:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214cccfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169987:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214cccf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fe9 expref: 13 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.169998:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fe9 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.170005:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff907219c12500) 00010000:00010000:3.0:1784094392.170007:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094392.170010:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784094392.170119:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:62362:x1870757013927680:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 767us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094392.170128:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1228 00000100:00100000:1.0:1784094392.179194:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094392.179303:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013927808 00000100:00100000:2.0:1784094392.179314:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013927808 00000100:00100000:2.0:1784094392.179375:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 631 00000100:00100000:2.0:1784094392.179387:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013927808:12345-192.168.204.57@tcp:101:rm.60003 00010000:00010000:2.0:1784094392.179407:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094392.179575:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ff0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784094392.179605:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x6a571eb8, atime: 0x6a571eb8, ctime: 0x6a571eb8, blocks: 0x1 00010000:00010000:2.0:1784094392.179623:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=1553s v=(0 0) 00010000:00010000:2.0:1784094392.179627:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784094392.179635:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.179726:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.179739:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40000, rc 0) 00000100:00100000:2.0:1784094392.179802:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:2353:x1870757013927808:12345-192.168.204.57@tcp:101:rm.60003 Request processed in 417us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094392.179809:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 631 00000100:00100000:0.0:1784094392.183271:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094392.183550:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013928064 00000100:00100000:2.0:1784094392.183560:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013928064 00000100:00100000:2.0:1784094392.183618:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1229 00000100:00100000:2.0:1784094392.183628:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:62362:x1870757013928064:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:2.0:1784094392.183780:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784094392.183806:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccd05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fe9 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183829:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13a00/0x9ce98053214ccce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fe2 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183839:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff907219c12500) 00010000:00010000:2.0:1784094392.183850:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094392.183872:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183884:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183894:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183908:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183915:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.183923:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184019:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184027:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184034:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784094392.184722:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 64 off10688 00000004:00080000:2.0:1784094392.184734:0:5779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1553262311171ns, next at 1554262308710ns, rc = 0 00010000:00010000:2.0:1784094392.184789:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184799:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184807:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184815:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184820:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184826:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184858:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094392.184877:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184884:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184889:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184896:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094392.184899:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184907:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184916:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff90721a781c00) 00010000:00010000:2.0:1784094392.184919:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784094392.184923:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184929:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccd21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184945:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184952:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.184953:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094392.184960:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.184974:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094392.184974:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.184981:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184984:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.184989:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.184990:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.185005:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.185006:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff90721a781c00) 00010000:00010000:3.0:1784094392.185011:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784094392.185015:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.185019:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781900) 00010000:00010000:3.0:1784094392.185021:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40c00/0x9ce98053214ccd28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.185024:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094392.185028:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.185036:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094392.185036:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccd13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.185039:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094392.185041:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1784094392.185050:0:5779:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000012bd932 reply state 0000000014cb25c4 transno 4294967768 ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094392.185058:0:5779:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094392.185138:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+12:62362:x1870757013928064:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1510us (1875us total) trans 4294967768 rc 0/0 00000100:00100000:2.0:1784094392.185145:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1229 00010000:00010000:0.0:1784094392.188338:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.188354:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.188362:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.188367:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094392.188372:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.188380:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.188396:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff90721a781500) 00010000:00010000:0.0:1784094392.188399:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094392.188402:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.188408:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41e00/0x9ce98053214ccd1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094392.715922:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094392.716233:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013928192 00000100:00100000:1.0:1784094392.716244:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013928192 00000100:00100000:1.0:1784094392.716304:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1230 00000100:00100000:1.0:1784094392.716314:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+11:62378:x1870757013928192:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:1.0:1784094392.716338:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094392.716356:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccd2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ff7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.716448:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccd36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.716468:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.716480:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094392.716538:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:1.0:1784094392.716542:0:5809:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094392.716566:0:5809:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.716590:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12600/0x9ce98053214ccd2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff7 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.716606:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccd36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff7 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.716615:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781900) 00010000:00010000:1.0:1784094392.716618:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094392.716622:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094392.716681:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+12:62378:x1870757013928192:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 368us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094392.716689:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1230 00000100:00100000:1.0:1784094392.721919:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094392.721974:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013928448 00000100:00100000:0.0:1784094392.721988:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013928448 00000100:00100000:0.0:1784094392.722073:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1231 00000100:00100000:0.0:1784094392.722085:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+12:62378:x1870757013928448:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:0.0:1784094392.722145:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784094392.722173:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13e00/0x9ce98053214ccd36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff7 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.722192:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214cccb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5fd4 expref: 11 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.722204:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781900) 00010000:00010000:0.0:1784094392.722214:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094392.722240:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.722252:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094392.722261:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784094392.755136:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967769 is committed 00000004:00010000:0.0:1784094392.755150:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000045c5fc42 reply state 000000009ac1778c transno 4294967769 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784094392.755159:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00000100:00100000:0.0:1784094392.755166:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784094392.755357:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094392.755385:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024391296:0@lo:6:osp-syn-0-0.0 00000004:00200000:0.0:1784094392.755464:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:2.0:1784094392.755488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094392.755523:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391296 00000100:00100000:1.0:1784094392.755533:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391296 00010000:00080000:0.0:1784094392.755557:0:5778:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1784094392.755580:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62378:x1870757013928448:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 33495us (33668us total) trans 4294967769 rc 0/0 00010000:00010000:3.0:1784094392.755590:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094392.755591:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1784094392.755592:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1231 00010000:00010000:3.0:1784094392.755604:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094392.755604:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024391296:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784094392.755613:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.755620:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094392.755626:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784094392.755633:0:8031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:39 count 1 00010000:00010000:3.0:1784094392.755634:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.755652:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.755654:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907202e6be00) 00010000:00010000:3.0:1784094392.755657:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094392.755662:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.755668:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77e00/0x9ce98053214ccd3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.755672:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.755680:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094392.755686:0:8031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784094392.755691:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.755723:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094392.755739:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 6 pid: 6574 timeout: 1653 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094392.755751:0:8031:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024391424:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784094392.756052:0:8031:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1784094392.758672:0:8031:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8031:1870757024391424:192.168.204.57@tcp:104: 00010000:00010000:0.0:1784094392.758703:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094392.761961:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094392.762051:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013928576 00000100:00100000:3.0:1784094392.762072:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013928576 00010000:00010000:3.0:1784094392.762114:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 7 pid: 6574 timeout: 1653 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094392.762156:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 370 00000100:00100000:3.0:1784094392.762166:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013928576:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784094392.762181:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094392.762188:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 7 pid: 6574 timeout: 1653 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762203:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 7 pid: 6574 timeout: 1653 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762227:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b152f10/0x9ce98053214ccd0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ff0 expref: 7 pid: 6574 timeout: 1653 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762245:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094392.762252:0:5763:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784094392.762258:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762269:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762299:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094392.762350:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013928576:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 184us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094392.762358:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 370 00010000:00010000:3.0:1784094392.762471:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762480:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762491:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762499:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094392.762514:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784094392.763533:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094392.763543:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.763554:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094392.763559:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.763568:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.763584:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.763591:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adec2e4/0x9ce98053214ccd44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.763609:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094392.763611:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094392.763613:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094392.764908:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024391296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9302us (9414us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1784094392.764921:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000004:00080000:2.0:1784094392.765330:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90723ca63b80/2, rc 0, transno 4294967375 00000100:00100000:2.0:1784094392.765338:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024391296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784094392.792549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094392.792928:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013928704 00000100:00100000:2.0:1784094392.792941:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013928704 00000100:00100000:2.0:1784094392.793004:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1232 00000100:00100000:2.0:1784094392.793014:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:62382:x1870757013928704:12345-192.168.204.57@tcp:101:touch.60003 00010000:00010000:2.0:1784094392.793038:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094392.793057:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf5ffe expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793131:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793147:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793158:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793171:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793178:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793185:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793627:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ccd60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793636:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ccd60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793762:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ccd60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094392.793846:0:5779:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094392.793851:0:5779:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094392.793928:0:5779:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ccd60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793946:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793951:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793956:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793959:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094392.793962:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793967:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793975:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:2.0:1784094392.793977:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094392.793981:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793985:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41a00/0x9ce98053214ccd52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793992:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793996:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.793999:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794003:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094392.794005:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794008:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794011:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff90721a781200) 00010000:00010000:2.0:1784094392.794013:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094392.794014:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794019:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794048:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ffe expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794072:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ccd60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ffe expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094392.794080:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784094392.794082:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094392.794085:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40e00, rc 0) 00000100:00100000:2.0:1784094392.794141:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62382:x1870757013928704:12345-192.168.204.57@tcp:101:touch.60003 Request processed in 1129us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094392.794147:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1232 00010000:00010000:3.0:1784094392.810287:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094393.273855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094393.274498:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013928832 00000100:00100000:2.0:1784094393.274508:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013928832 00000100:00100000:2.0:1784094393.274564:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1233 00000100:00100000:2.0:1784094393.274575:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62396:x1870757013928832:12345-192.168.204.57@tcp:101:chmod.0 00010000:00010000:2.0:1784094393.274601:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094393.274621:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf6005 expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.274677:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.274691:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.274703:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094393.275027:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094393.275032:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094393.275128:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.275167:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41600/0x9ce98053214ccd67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6005 expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.275184:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6005 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.275192:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:2.0:1784094393.275196:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094393.275199:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41000, rc 0) 00000100:00100000:2.0:1784094393.275376:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62396:x1870757013928832:12345-192.168.204.57@tcp:101:chmod.0 Request processed in 801us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094393.275384:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1233 00000100:00100000:2.0:1784094393.277584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094393.277633:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929088 00000100:00100000:3.0:1784094393.277643:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929088 00000100:00100000:3.0:1784094393.277695:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1234 00000100:00100000:3.0:1784094393.277705:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62396:x1870757013929088:12345-192.168.204.57@tcp:36:chmod.0 00010000:00010000:3.0:1784094393.277749:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784094393.277772:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41000/0x9ce98053214ccd6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6005 expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.277792:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40e00/0x9ce98053214ccd60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5ffe expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.277804:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781800) 00010000:00010000:3.0:1784094393.277815:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094393.277837:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.277849:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.277858:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094393.278292:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 000000004ef14a1e reply state 000000001143327b transno 4294967770 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094393.278302:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784094393.278369:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000100:00100000:3.0:1784094393.278460:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62396:x1870757013929088:12345-192.168.204.57@tcp:36:chmod.0 Request processed in 755us (877us total) trans 4294967770 rc 0/0 00000100:00100000:3.0:1784094393.278471:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1234 00010000:00010000:3.0:1784094393.279754:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.279765:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.279773:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.279780:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094393.279784:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.279791:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.279803:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907204fcee00) 00010000:00010000:3.0:1784094393.279806:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784094393.279810:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.279817:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094393.321664:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094393.321686:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024391552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094393.321751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094393.321808:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391552 00000100:00100000:2.0:1784094393.321815:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391552 00000100:00080000:3.0:1784094393.321956:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094393.321976:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1784094393.321986:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024391552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094393.322019:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094393.322077:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1870757024391552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094393.322086:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1784094393.322136:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024391552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094393.342271:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.342533:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929216 00000100:00100000:0.0:1784094393.342543:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929216 00000100:00100000:0.0:1784094393.342602:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1235 00000100:00100000:0.0:1784094393.342613:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013929216:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094393.342718:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013929216:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 107us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094393.342727:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1235 00000100:00100000:1.0:1784094393.343714:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094393.343771:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929344 00000100:00100000:3.0:1784094393.343778:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929344 00000100:00100000:3.0:1784094393.343821:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:3.0:1784094393.343829:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62408:x1870757013929344:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094393.344153:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62408:x1870757013929344:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 323us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094393.344161:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 633 00000100:00100000:1.0:1784094393.345200:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.345243:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929472 00000100:00100000:0.0:1784094393.345250:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929472 00000100:00100000:0.0:1784094393.345300:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 634 00000100:00100000:0.0:1784094393.345308:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:62408:x1870757013929472:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:3.0:1784094393.345559:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094393.345600:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:62408:x1870757013929472:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 292us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094393.345608:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 634 00000100:00100000:0.0:1784094393.348192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094393.348258:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929600 00000100:00100000:2.0:1784094393.348266:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929600 00000100:00100000:2.0:1784094393.348321:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1236 00000100:00100000:2.0:1784094393.348332:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013929600:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094393.348760:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013929600:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 421us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094393.348773:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1236 00000100:00100000:1.0:1784094393.351717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094393.351982:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929728 00000100:00100000:3.0:1784094393.351992:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929728 00000100:00100000:3.0:1784094393.352093:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1237 00000100:00100000:3.0:1784094393.352104:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013929728:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094393.352203:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013929728:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 96us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094393.352211:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1237 00000100:00100000:1.0:1784094393.354058:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094393.354140:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929856 00000100:00100000:3.0:1784094393.354149:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929856 00000100:00100000:3.0:1784094393.354201:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 635 00000100:00100000:3.0:1784094393.354210:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:62408:x1870757013929856:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094393.354636:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:62408:x1870757013929856:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 426us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094393.354644:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 635 00000100:00100000:0.0:1784094393.356277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094393.356352:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013929984 00000100:00100000:3.0:1784094393.356361:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013929984 00000100:00100000:3.0:1784094393.356742:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:3.0:1784094393.356754:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:62408:x1870757013929984:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094393.357077:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:62408:x1870757013929984:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 324us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094393.357085:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 636 00000100:00100000:1.0:1784094393.358953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.359038:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013930112 00000100:00100000:0.0:1784094393.359045:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013930112 00000100:00100000:0.0:1784094393.359147:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1238 00000100:00100000:0.0:1784094393.359157:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013930112:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094393.359684:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62408:x1870757013930112:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 528us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094393.359693:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1238 00000100:00100000:0.0:1784094393.388727:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094393.388822:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013930240 00000100:00100000:2.0:1784094393.388832:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013930240 00000100:00100000:2.0:1784094393.389013:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1239 00000100:00100000:2.0:1784094393.389024:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+7:62412:x1870757013930240:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:2.0:1784094393.389045:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094393.389079:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccd7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf600c expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389137:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389156:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389167:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389181:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389188:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389196:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389660:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccd91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389669:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389677:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094393.389746:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094393.389751:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094393.389822:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389834:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389846:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389852:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389858:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094393.389862:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389870:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389881:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:2.0:1784094393.389884:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094393.389889:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389895:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40400/0x9ce98053214ccd83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389906:0:8381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389912:0:8381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389918:0:8381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389922:0:8381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:2.0:1784094393.389925:0:8381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389931:0:8381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389937:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff90721a781200) 00010000:00010000:2.0:1784094393.389940:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094393.389943:0:8381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389948:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40600/0x9ce98053214ccd8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389981:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40000/0x9ce98053214ccd7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf600c expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.389994:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccd91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf600c expref: 8 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094393.390001:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784094393.390004:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784094393.390006:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40a00, rc 0) 00000100:00100000:2.0:1784094393.390077:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62412:x1870757013930240:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 1054us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094393.390084:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1239 00000100:00100000:2.0:1784094393.392656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094393.392711:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013930496 00000100:00100000:3.0:1784094393.392721:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013930496 00000100:00100000:3.0:1784094393.392771:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1240 00000100:00100000:3.0:1784094393.392782:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62412:x1870757013930496:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:3.0:1784094393.392802:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094393.392821:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf6013 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.393172:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.393187:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.393199:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.393212:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.393219:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.393230:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784094393.394103:0:5778:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27:0x0], index 1: 0 00010000:00010000:3.0:1784094393.394320:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccdad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394331:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccdad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394340:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccdad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394372:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394379:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394385:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394389:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094393.394391:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394398:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394410:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781700) 00010000:00010000:3.0:1784094393.394413:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094393.394418:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394444:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccd9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094393.394456:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 00000000863ecaff reply state 000000000d6cbdbe transno 4294967771 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094393.394465:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784094393.394497:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccd98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6013 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.394511:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccdad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6013 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094393.395209:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784094393.395213:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784094393.395216:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784094393.395360:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+11:62412:x1870757013930496:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 2579us (2709us total) trans 4294967771 rc 0/0 00000100:00100000:3.0:1784094393.395369:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1240 00010000:00010000:0.0:1784094393.398755:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.398774:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.398782:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.398795:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68000 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094393.398802:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.398809:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.398825:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fcee00) 00010000:00010000:0.0:1784094393.398835:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094393.398840:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.398847:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68000/0x9ce98053214ccda6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094393.398924:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.398990:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013930624 00000100:00100000:0.0:1784094393.398999:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013930624 00000100:00100000:0.0:1784094393.399059:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 637 00000100:00100000:0.0:1784094393.399070:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:62412:x1870757013930624:12345-192.168.204.57@tcp:101:dd.60003 00010000:00010000:0.0:1784094393.399088:0:6572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094393.399107:0:6572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf601a expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784094393.399131:0:6572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784094393.399151:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=1554s v=(0 0) 00010000:00010000:0.0:1784094393.399156:0:6572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784094393.399166:0:6572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.399183:0:6572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 6 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094393.399195:0:6572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76800, rc 0) 00000100:00100000:0.0:1784094393.399358:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:62412:x1870757013930624:12345-192.168.204.57@tcp:101:dd.60003 Request processed in 289us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094393.399365:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 637 00000100:00100000:1.0:1784094393.409299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.409358:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013930752 00000100:00100000:0.0:1784094393.409367:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013930752 00002000:00100000:0.0:1784094393.409407:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff90723d23d500 x1870757013930752/t0(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:714/0 lens 488/0 e 0 to 0 dl 1784094404 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1784094393.409415:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d23d500 with x1870757013930752 ext(0->1048575) 00002000:00010000:0.0:1784094393.409448:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d23d500 00000100:00100000:0.0:1784094393.409635:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 31 00000100:00100000:0.0:1784094393.409651:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+6:2352:x1870757013930752:12345-192.168.204.57@tcp:4:dd.60003 00000100:00100000:0.0:1784094393.420658:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013930752:12345-192.168.204.57@tcp:4:dd.60003 Request processed in 11000us (11357us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1784094393.420673:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 31 00002000:00100000:0.0:1784094393.420686:0:6578:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff90723d23d500 x1870757013930752/t4294967374(0) o4->d859d42d-5b91-4307-b8c2-f99991427baa@192.168.204.57@tcp:714/0 lens 488/448 e 0 to 0 dl 1784094404 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1784094393.420695:0:6578:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff90723d23d500 with x1870757013930752 ext(0->1048575) 00002000:00010000:0.0:1784094393.420701:0:6578:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90723d23d500 00000100:00100000:2.0:1784094393.422758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.422854:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013930880 00000100:00100000:0.0:1784094393.422863:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013930880 00000100:00100000:0.0:1784094393.422920:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1241 00000100:00100000:0.0:1784094393.422929:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+10:62412:x1870757013930880:12345-192.168.204.57@tcp:44:dd.60003 00000001:00080000:0.0:1784094393.443662:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967771 is committed 00000100:00100000:2.0:1784094393.444093:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:62412:x1870757013930880:12345-192.168.204.57@tcp:44:dd.60003 Request processed in 21159us (21336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094393.444107:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1241 00000100:00100000:1.0:1784094393.446339:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094393.446409:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931008 00000100:00100000:2.0:1784094393.446452:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931008 00000100:00100000:2.0:1784094393.446576:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 638 00000100:00100000:2.0:1784094393.446587:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:2353:x1870757013931008:12345-192.168.204.57@tcp:16:dd.60003 00000001:00080000:0.0:1784094393.462054:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00000100:00100000:1.0:1784094393.462185:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013931008:12345-192.168.204.57@tcp:16:dd.60003 Request processed in 15592us (15846us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094393.462197:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 638 00000100:00100000:1.0:1784094393.466701:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094393.466832:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931264 00000100:00100000:0.0:1784094393.466843:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931264 00000100:00100000:0.0:1784094393.466942:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 125 00000100:00100000:0.0:1784094393.466951:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62412:x1870757013931264:12345-192.168.204.57@tcp:35:dd.60003 00000100:00100000:0.0:1784094393.467488:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:62412:x1870757013931264:12345-192.168.204.57@tcp:35:dd.60003 Request processed in 535us (794us total) trans 4294967772 rc 0/0 00000100:00100000:0.0:1784094393.467497:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 125 00010000:00010000:3.0:1784094393.833622:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784094394.151636:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967772 is committed 00000004:00080000:2.0:1784094394.819307:0:104478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1555896881800ns, next at 1554262308710ns, rc = 0 00000004:00080000:2.0:1784094394.819503:0:104478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1555897080451ns, next at 1536701948939ns, rc = 0 00000004:00080000:0.0:1784094394.821416:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00000004:00080000:0.0:1784094394.821462:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00010000:00010000:1.0:1784094394.858461:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094395.390023:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000001:00080000:2.0:1784094395.390042:0:6598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00000100:00100000:0.0:1784094395.555073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094395.555164:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931392 00000100:00100000:1.0:1784094395.555175:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931392 00000100:00100000:1.0:1784094395.555291:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1242 00000100:00100000:1.0:1784094395.555302:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013931392:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094395.555396:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013931392:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 96us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094395.555403:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1242 00000100:00080000:3.0:1784094395.555451:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094395.558125:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094395.559070:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931520 00000100:00100000:2.0:1784094395.559082:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931520 00000100:00100000:2.0:1784094395.559234:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 639 00000100:00100000:2.0:1784094395.559246:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:62604:x1870757013931520:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:3.0:1784094395.559723:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094395.559979:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:62604:x1870757013931520:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 735us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094395.559989:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 639 00000100:00100000:3.0:1784094395.563866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094395.563936:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931648 00000100:00100000:1.0:1784094395.563948:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931648 00000100:00100000:1.0:1784094395.564018:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:1.0:1784094395.564029:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:62604:x1870757013931648:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00080000:3.0:1784094395.564224:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094395.564382:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+6:62604:x1870757013931648:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 354us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094395.564390:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 640 00000100:00100000:0.0:1784094395.569268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094395.570100:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931776 00000100:00100000:3.0:1784094395.570113:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931776 00000100:00100000:3.0:1784094395.570173:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1243 00000100:00100000:3.0:1784094395.570184:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013931776:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094395.570573:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013931776:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 389us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094395.570581:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1243 00000100:00100000:1.0:1784094395.573347:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094395.573454:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013931904 00000100:00100000:2.0:1784094395.573468:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013931904 00000100:00100000:2.0:1784094395.573557:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1244 00000100:00100000:2.0:1784094395.573570:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013931904:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094395.574022:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013931904:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 442us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094395.574031:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1244 00000100:00100000:1.0:1784094395.577526:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094395.577605:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932032 00000100:00100000:0.0:1784094395.577615:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932032 00000100:00100000:0.0:1784094395.577670:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 641 00000100:00100000:0.0:1784094395.577679:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:62604:x1870757013932032:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094395.578026:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:62604:x1870757013932032:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 348us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094395.578035:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 641 00000100:00100000:1.0:1784094395.581122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094395.581205:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932160 00000100:00100000:3.0:1784094395.581216:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932160 00000100:00100000:3.0:1784094395.581273:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:3.0:1784094395.581285:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62604:x1870757013932160:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:3.0:1784094395.581792:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:62604:x1870757013932160:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 511us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094395.581799:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 642 00000100:00100000:0.0:1784094395.583680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094395.583792:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932288 00000100:00100000:1.0:1784094395.583801:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932288 00000100:00100000:1.0:1784094395.583866:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1245 00000100:00100000:1.0:1784094395.583876:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013932288:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:1.0:1784094395.584281:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+8:62604:x1870757013932288:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 405us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094395.584290:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1245 00000100:00100000:1.0:1784094395.620615:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094395.621258:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932544 00000100:00100000:3.0:1784094395.621280:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932544 00000100:00100000:3.0:1784094395.621338:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1246 00000100:00100000:3.0:1784094395.621349:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62608:x1870757013932544:12345-192.168.204.57@tcp:36:rm.60003 00010000:00010000:3.0:1784094395.621400:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094395.621469:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccdad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6013 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621489:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784094395.621499:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094395.621531:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621547:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621557:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621572:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621579:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621585:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621940:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621947:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.621955:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784094395.622778:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 64 off10688 00000004:00080000:3.0:1784094395.622785:0:5778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1556700362802ns, next at 1557700361477ns, rc = 0 00010000:00010000:3.0:1784094395.622845:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622853:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622858:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622863:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622871:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622875:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622888:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784094395.622905:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622908:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622912:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622917:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094395.622920:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622925:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622932:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff907204fce700) 00010000:00010000:2.0:1784094395.622932:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094395.622935:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784094395.622941:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094395.622942:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622946:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccdd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094395.622961:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094395.622966:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622972:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094395.622975:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.622989:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094395.622995:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff907204fce700) 00010000:00010000:3.0:1784094395.622997:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094395.623001:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784094395.623016:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.623019:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094395.623025:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094395.623027:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69400/0x9ce98053214ccdd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.623043:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.623055:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784094395.623055:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094395.623059:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094395.623060:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784094395.623063:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094395.623065:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.623072:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb69c00/0x9ce98053214ccdc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784094395.623083:0:5778:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000057f5b323 reply state 0000000066e3d02d transno 4294967773 ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094395.623092:0:5778:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784094395.623168:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+9:62608:x1870757013932544:12345-192.168.204.57@tcp:36:rm.60003 Request processed in 1821us (2562us total) trans 4294967773 rc 0/0 00000100:00100000:3.0:1784094395.623174:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1246 00010000:00010000:3.0:1784094395.627834:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.627860:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.627868:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.627875:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:3.0:1784094395.627880:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.627888:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.627905:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff907204fce900) 00010000:00010000:3.0:1784094395.627909:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784094395.627913:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094395.627920:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68c00/0x9ce98053214ccdc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094395.769178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094395.769417:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932672 00000100:00100000:0.0:1784094395.770034:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932672 00000100:00100000:0.0:1784094395.770091:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 963 00000100:00100000:0.0:1784094395.770101:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013932672:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094395.770173:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013932672:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 73us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094395.770181:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 963 00010000:00010000:3.0:1784094395.881628:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094396.393724:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024391936:0@lo:400:kworker.0 00000100:00100000:0.0:1784094396.393759:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094396.393801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094396.393807:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094396.393873:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024392192:0@lo:400:kworker.0 00000100:00100000:0.0:1784094396.393900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094396.393928:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784094396.393934:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024391808:0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.393945:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391680 00000100:00100000:3.0:1784094396.393954:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391680 00000100:00100000:0.0:1784094396.393965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094396.394009:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024392320:0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.394030:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1784094396.394042:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024391680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094396.394048:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024392064:0@lo:400:kworker.0 00002000:00000024:3.0:1784094396.394081:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784094396.394082:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392192 00000100:00100000:0.0:1784094396.394087:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392192 00000100:00100000:0.0:1784094396.394125:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1784094396.394136:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024392192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.394144:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024391680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094396.394154:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00080000:3.0:1784094396.394177:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094396.394182:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094396.394198:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024392192:12345-0@lo:400:kworker.0 Request processed in 65us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094396.394206:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1784094396.394215:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391808 00000100:00100000:3.0:1784094396.394221:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391808 00000100:00100000:3.0:1784094396.394252:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1784094396.394260:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024391808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.394309:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024391808:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094396.394316:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:2.0:1784094396.394417:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024392448:0@lo:400:kworker.0 00000100:00100000:2.0:1784094396.394464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094396.394489:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024391936 00000100:00100000:0.0:1784094396.394495:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024391936 00000100:00100000:2.0:1784094396.394501:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392448 00000100:00100000:2.0:1784094396.394507:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392448 00000100:00100000:2.0:1784094396.394543:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1784094396.394551:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024392448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094396.394584:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024392448:12345-0@lo:400:kworker.0 Request processed in 34us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094396.394594:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1784094396.394630:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024392448:0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.394773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094396.394805:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1784094396.394819:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024391936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.394831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094396.394872:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094396.394874:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024391936:12345-0@lo:400:kworker.0 Request processed in 56us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094396.394885:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1784094396.394892:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000100:00100000:0.0:1784094396.394898:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392064 00000004:00080000:3.0:1784094396.394899:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90723ca63b80, transno 4294967375 00000100:00100000:0.0:1784094396.394903:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392064 00000100:00100000:3.0:1784094396.394915:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024392192:0@lo:400:kworker.0 00000100:00100000:0.0:1784094396.394937:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392320 00000100:00100000:0.0:1784094396.394941:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392320 00000100:00100000:3.0:1784094396.394942:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024391808:0@lo:400:kworker.0 00000100:00100000:0.0:1784094396.394964:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1784094396.394975:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1784094396.394975:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024392064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.394989:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024392320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094396.395034:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024392064:12345-0@lo:400:kworker.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094396.395042:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1784094396.395054:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024392320:12345-0@lo:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094396.395062:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1784094396.395094:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024392320:0@lo:400:kworker.0 00000100:00080000:3.0:1784094396.395125:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094396.395144:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024391936:0@lo:400:kworker.0 00000100:00100000:3.0:1784094396.395174:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024392064:0@lo:400:kworker.0 00000004:00080000:3.0:1784094396.741028:0:104625:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1557818602202ns, next at 1554262308710ns, rc = 0 00000004:00080000:3.0:1784094396.741171:0:104625:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1557818747581ns, next at 1557700361477ns, rc = 0 00000004:00080000:1.0:1784094396.763055:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000004:00080000:1.0:1784094396.763083:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000001:00080000:1.0:1784094396.763101:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967773 is committed 00000004:00080000:1.0:1784094396.763105:0:5800:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000100:00100000:1.0:1784094396.763290:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024392576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784094396.763352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094396.763549:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392576 00000100:00100000:1.0:1784094396.763556:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392576 00000100:00100000:1.0:1784094396.763606:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1784094396.763616:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024392576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784094396.763644:0:53396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:39 count 1 00010000:00010000:1.0:1784094396.763667:0:53396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.763688:0:53396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.763696:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x27:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1784094396.763701:0:53396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094396.763706:0:53396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.763732:0:53396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 5 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.763747:0:53396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 5 pid: 6572 timeout: 1657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094396.763759:0:53396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024392704:192.168.204.57@tcp:104: 00000100:00100000:1.0:1784094396.763822:0:53396:0:(client.c:2702:ptlrpc_set_wait()) set ffff907204913300 going to sleep for 11 seconds 00000100:00100000:1.0:1784094396.773418:0:53396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:53396:1870757024392704:192.168.204.57@tcp:104: 00010000:00010000:1.0:1784094396.773484:0:53396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094396.773720:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094396.773770:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932800 00000100:00100000:1.0:1784094396.773778:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932800 00010000:00010000:1.0:1784094396.773812:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 6 pid: 6572 timeout: 1657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094396.773897:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 371 00000100:00100000:1.0:1784094396.773907:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013932800:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094396.773921:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094396.773927:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 6 pid: 6572 timeout: 1657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.773951:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 6 pid: 6572 timeout: 1657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.773979:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b6efc83/0x9ce98053214ccdbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf601a expref: 6 pid: 6572 timeout: 1657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.774008:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094396.774012:0:5765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784094396.774017:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.774028:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094396.774061:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094396.774115:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013932800:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094396.774122:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 371 00010000:00010000:3.0:1784094396.774159:0:53396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.774171:0:53396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.774183:0:53396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.774192:0:53396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.774211:0:53396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784094396.774952:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024392576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11337us (11599us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1784094396.774960:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00010000:00010000:3.0:1784094396.774978:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094396.774982:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.775007:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094396.775012:0:11170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.775021:0:11170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.775034:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.775042:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000229d212a/0x9ce98053214ccdde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 53396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094396.775065:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094396.775067:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094396.775069:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784094396.775087:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907230e4ad80/2, rc 0, transno 4294967375 00000100:00100000:2.0:1784094396.775106:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024392576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1784094396.905817:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094397.930104:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094398.441979:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094398.442002:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024392832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094398.442071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094398.442289:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392832 00000100:00100000:2.0:1784094398.442297:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392832 00000100:00100000:2.0:1784094398.442372:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1784094398.442382:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024392832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094398.442417:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784094398.442449:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094398.442672:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024392832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 291us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094398.442679:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1784094398.442749:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024392832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784094398.954030:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094399.977732:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784094400.528837:0:7469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00000100:00100000:3.0:1784094400.890813:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094400.890885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933056 00000100:00100000:0.0:1784094400.890896:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933056 00000100:00100000:3.0:1784094400.890951:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094400.891016:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1085 00000100:00080000:1.0:1784094400.891073:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094400.891090:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094400.891119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094400.891167:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013933056:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094400.891262:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2354:x1870757013933056:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 237us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094400.891270:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1085 00000100:00100000:1.0:1784094400.891461:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013932928 00000100:00100000:1.0:1784094400.891467:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013932928 00000100:00100000:1.0:1784094400.891498:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 965 00000100:00100000:1.0:1784094400.891506:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013932928:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094400.891543:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013932928:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094400.891551:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 965 00000100:00100000:2.0:1784094400.893058:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933312 00000100:00100000:2.0:1784094400.893069:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933312 00000100:00100000:2.0:1784094400.893136:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933184 00000100:00100000:2.0:1784094400.893140:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933184 00000100:00100000:2.0:1784094400.893172:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 835 00000100:00100000:2.0:1784094400.893183:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013933312:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094400.893186:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 836 00000100:00100000:0.0:1784094400.893201:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013933184:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784094400.893265:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094400.893266:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013933312:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (2314us total) trans 0 rc 0/0 00000100:00080000:3.0:1784094400.893272:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094400.893272:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013933184:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094400.893281:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 835 00000100:00100000:0.0:1784094400.893289:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 836 00010000:00010000:1.0:1784094401.001801:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094401.514281:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024393344:0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.514282:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024393088:0@lo:400:kworker.0 00000100:00100000:0.0:1784094401.514351:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024392960:0@lo:400:kworker.0 00000100:00100000:2.0:1784094401.514404:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024393216:0@lo:400:kworker.0 00000100:00100000:1.0:1784094401.515418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094401.515513:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393344 00000100:00100000:1.0:1784094401.515521:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393344 00000100:00100000:1.0:1784094401.515578:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1784094401.515589:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094401.515641:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024393344:12345-0@lo:400:kworker.0 Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094401.515649:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00080000:1.0:1784094401.515675:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094401.515706:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024393344:0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.516823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094401.516877:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024393600:0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.516922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094401.516976:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393600 00000100:00100000:3.0:1784094401.516982:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393600 00000100:00100000:3.0:1784094401.517167:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1784094401.517176:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024393600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.517282:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024393600:12345-0@lo:400:kworker.0 Request processed in 107us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094401.517289:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00080000:3.0:1784094401.517307:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094401.517328:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:3.0:1784094401.517333:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907230e4ad80, transno 4294967375 00000100:00100000:3.0:1784094401.517346:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024393600:0@lo:400:kworker.0 00000100:00100000:2.0:1784094401.517806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094401.517836:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024393728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094401.517884:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094401.518370:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393088 00000100:00100000:1.0:1784094401.518377:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393088 00000100:00100000:1.0:1784094401.518418:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393216 00000100:00100000:1.0:1784094401.518442:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393216 00000100:00100000:1.0:1784094401.518473:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1784094401.518481:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024393088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094401.518534:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024393088:12345-0@lo:400:kworker.0 Request processed in 54us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094401.518540:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1784094401.518555:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1784094401.518561:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094401.518593:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024393216:12345-0@lo:400:kworker.0 Request processed in 32us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094401.518599:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:1.0:1784094401.518614:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094401.518640:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024393216:0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.518883:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393728 00000100:00100000:3.0:1784094401.518888:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393728 00000100:00100000:3.0:1784094401.518965:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1784094401.518972:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024393728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094401.519148:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094401.519252:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024393728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 280us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094401.519258:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1784094401.519288:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024393088:0@lo:400:kworker.0 00000100:00100000:1.0:1784094401.519366:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024393728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094401.519445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094401.519492:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024393472:0@lo:400:kworker.0 00000100:00100000:0.0:1784094401.519521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094401.519572:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393472 00000100:00100000:1.0:1784094401.519578:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393472 00000100:00100000:3.0:1784094401.519643:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024392960 00000100:00100000:3.0:1784094401.519648:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024392960 00000100:00100000:1.0:1784094401.519680:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1784094401.519685:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1784094401.519691:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024393472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.519697:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024392960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094401.519747:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024393472:12345-0@lo:400:kworker.0 Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094401.519750:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024392960:12345-0@lo:400:kworker.0 Request processed in 56us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094401.519756:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00080000:2.0:1784094401.519811:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094401.519854:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024392960:0@lo:400:kworker.0 00000100:00100000:0.0:1784094401.519866:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024393472:0@lo:400:kworker.0 00000100:00100000:3.0:1784094401.519925:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00010000:00010000:0.0:1784094402.026198:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094403.050241:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094403.562451:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024393856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094403.562522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094403.562606:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393856 00000100:00100000:1.0:1784094403.562615:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393856 00000100:00100000:1.0:1784094403.562726:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1784094403.562737:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024393856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094403.562771:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094403.562819:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024393856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094403.562825:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00080000:3.0:1784094403.564616:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094403.564671:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024393856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094404.073956:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094405.098555:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094406.009019:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094406.009249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094406.009289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094406.009337:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094406.009368:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933824 00000100:00100000:1.0:1784094406.009377:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933824 00000100:00100000:1.0:1784094406.009458:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933696 00000100:00100000:1.0:1784094406.009461:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933696 00000100:00100000:1.0:1784094406.009483:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 839 00000100:00100000:1.0:1784094406.009491:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013933824:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094406.009570:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013933824:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094406.009577:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 839 00000100:00100000:1.0:1784094406.009597:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 840 00000100:00100000:1.0:1784094406.009603:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013933696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094406.009632:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013933696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094406.009638:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 840 00000100:00080000:1.0:1784094406.009661:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094406.009664:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094406.009724:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933440 00000100:00100000:3.0:1784094406.009729:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933440 00000100:00100000:3.0:1784094406.009765:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 967 00000100:00100000:3.0:1784094406.009772:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013933440:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094406.009797:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2352:x1870757013933440:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094406.009802:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 967 00000100:00100000:0.0:1784094406.009854:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933568 00000100:00100000:0.0:1784094406.009860:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933568 00000100:00100000:0.0:1784094406.009909:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1089 00000100:00100000:0.0:1784094406.009919:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013933568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:3.0:1784094406.009926:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094406.009967:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:2352:x1870757013933568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 50us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094406.009976:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1089 00010000:00010000:0.0:1784094406.121712:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094406.633736:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094406.633761:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094406.633840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094406.634049:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024393984 00000100:00100000:0.0:1784094406.634059:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024393984 00000100:00100000:0.0:1784094406.634175:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1784094406.634186:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024393984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094406.634222:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784094406.634223:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094406.634297:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024393984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094406.634304:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1784094406.634462:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024394112:0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.634511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094406.634512:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024394240:0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.634555:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024394624:0@lo:400:kworker.0 00000100:00100000:1.0:1784094406.634591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094406.634602:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024394368:0@lo:400:kworker.0 00000100:00100000:2.0:1784094406.634648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094406.634692:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024394496:0@lo:400:kworker.0 00000100:00100000:2.0:1784094406.634712:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094406.634750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094406.634763:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394240 00000100:00100000:2.0:1784094406.634769:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394240 00000100:00100000:2.0:1784094406.634828:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394368 00000100:00100000:2.0:1784094406.634831:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394368 00000100:00100000:2.0:1784094406.634857:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1784094406.634863:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024394240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094406.634922:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024394240:12345-0@lo:400:kworker.0 Request processed in 60us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094406.634929:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1784094406.634941:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784094406.634947:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024394368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094406.634975:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024394368:12345-0@lo:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094406.634981:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784094406.634999:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394496 00000100:00100000:2.0:1784094406.635002:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394496 00000100:00100000:2.0:1784094406.635028:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1784094406.635034:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024394496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.635091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094406.635128:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394112 00000100:00100000:3.0:1784094406.635133:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394112 00000100:00100000:3.0:1784094406.635171:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1784094406.635178:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024394112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.635211:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024394112:12345-0@lo:400:kworker.0 Request processed in 33us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094406.635218:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1784094406.635242:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394624 00000100:00100000:3.0:1784094406.635246:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394624 00000100:00100000:3.0:1784094406.635268:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1784094406.635274:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024394624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.635302:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024394624:12345-0@lo:400:kworker.0 Request processed in 28us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094406.635308:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:3.0:1784094406.635325:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094406.635328:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094406.635350:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024394624:0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.635358:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024394112:0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.635407:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024394240:0@lo:400:kworker.0 00000100:00100000:3.0:1784094406.635455:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024394368:0@lo:400:kworker.0 00000100:00100000:2.0:1784094406.635564:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024394496:12345-0@lo:400:kworker.0 Request processed in 528us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094406.635571:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1784094406.635675:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024394496:0@lo:400:kworker.0 00010000:00010000:3.0:1784094407.145940:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094408.169683:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094408.681709:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024394752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094408.681807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094408.681926:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394752 00000100:00100000:2.0:1784094408.681942:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394752 00000100:00100000:2.0:1784094408.682822:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1784094408.682837:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024394752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094408.682887:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094408.682978:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024394752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094408.682987:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1784094408.683145:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024394752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094408.683388:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784094409.193858:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094410.217591:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094411.130624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094411.130750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094411.130786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094411.130837:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934080 00000100:00100000:1.0:1784094411.130840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094411.130853:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934080 00000100:00100000:1.0:1784094411.130884:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934336 00000100:00100000:1.0:1784094411.130894:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934336 00000100:00100000:3.0:1784094411.130950:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1093 00000100:00100000:3.0:1784094411.130968:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013934080:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094411.130970:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934208 00000100:00100000:1.0:1784094411.130976:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934208 00000100:00100000:1.0:1784094411.131015:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 842 00000100:00100000:1.0:1784094411.131027:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013934336:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094411.131064:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:2355:x1870757013934080:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 101us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094411.131074:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1093 00000100:00100000:1.0:1784094411.131092:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013934336:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094411.131103:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 842 00000100:00080000:3.0:1784094411.131104:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094411.131112:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094411.131117:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094411.131139:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 843 00000100:00100000:3.0:1784094411.131152:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013934208:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094411.131192:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013934208:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094411.131200:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 843 00000100:00100000:2.0:1784094411.131481:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013933952 00000100:00100000:2.0:1784094411.131487:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013933952 00000100:00100000:2.0:1784094411.131530:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 969 00000100:00100000:2.0:1784094411.131538:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013933952:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094411.131634:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013933952:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 96us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094411.131641:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 969 00010000:00010000:3.0:1784094411.241904:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094411.753861:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024395264:0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.753982:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024395136:0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.754068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094411.754129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094411.754222:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395136 00000100:00100000:3.0:1784094411.754233:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395136 00000100:00100000:2.0:1784094411.754281:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024394880:0@lo:400:kworker.0 00000100:00080000:1.0:1784094411.754290:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094411.754327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094411.754334:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1784094411.754353:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024395136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094411.754376:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024395392:0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.754380:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094411.754394:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024395648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094411.754455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094411.754470:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024395136:12345-0@lo:400:kworker.0 Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094411.754481:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1784094411.754491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094411.754496:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784094411.754507:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024395008:0@lo:400:kworker.0 00000100:00100000:2.0:1784094411.754548:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094411.754555:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395648 00000100:00100000:1.0:1784094411.754564:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395648 00000100:00100000:2.0:1784094411.754582:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024395520:0@lo:400:kworker.0 00000100:00100000:0.0:1784094411.754627:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024395136:0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.754638:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1784094411.754650:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024395648:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094411.754675:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1784094411.754690:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094411.754734:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395392 00000100:00100000:0.0:1784094411.754790:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395392 00000100:00100000:2.0:1784094411.754848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094411.754860:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024395648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094411.754861:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395008 00000100:00100000:3.0:1784094411.754868:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395008 00000100:00100000:1.0:1784094411.754875:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1784094411.754914:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1784094411.754927:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024395008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.754946:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024395648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094411.754982:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024395008:12345-0@lo:400:kworker.0 Request processed in 57us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094411.754996:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024394880 00000100:00100000:1.0:1784094411.755002:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024394880 00000100:00100000:1.0:1784094411.755034:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1784094411.755044:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024394880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.755096:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024394880:12345-0@lo:400:kworker.0 Request processed in 54us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094411.755103:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1784094411.755127:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395264 00000100:00100000:3.0:1784094411.755135:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395264 00000100:00100000:2.0:1784094411.755135:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1784094411.755171:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395520 00000100:00100000:1.0:1784094411.755180:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395520 00000100:00100000:2.0:1784094411.755195:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024395008:0@lo:400:kworker.0 00000100:00100000:3.0:1784094411.755196:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1784094411.755217:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024394880:0@lo:400:kworker.0 00000100:00100000:3.0:1784094411.755230:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024395264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.755240:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1784094411.755255:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024395520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094411.755300:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024395264:12345-0@lo:400:kworker.0 Request processed in 90us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094411.755311:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1784094411.755331:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024395520:12345-0@lo:400:kworker.0 Request processed in 80us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094411.755342:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1784094411.755376:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024395520:0@lo:400:kworker.0 00000100:00100000:1.0:1784094411.755397:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024395264:0@lo:400:kworker.0 00000100:00080000:1.0:1784094411.755459:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094411.755464:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094411.755723:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1784094411.755734:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024395392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094411.755790:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024395392:12345-0@lo:400:kworker.0 Request processed in 59us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094411.755811:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1784094411.755830:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024395392:0@lo:400:kworker.0 00010000:00010000:1.0:1784094412.265765:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094412.284744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094412.284830:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934464 00000100:00100000:3.0:1784094412.284841:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934464 00000100:00100000:3.0:1784094412.284899:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1247 00000100:00100000:3.0:1784094412.284906:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013934464:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:3.0:1784094412.284990:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013934464:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094412.284995:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1247 00000100:00100000:1.0:1784094412.289860:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094412.290024:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934592 00000100:00100000:0.0:1784094412.290034:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934592 00000100:00100000:0.0:1784094412.290153:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 644 00000100:00100000:0.0:1784094412.290175:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013934592:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094412.290486:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013934592:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 324us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094412.290492:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 644 00000100:00100000:1.0:1784094412.291529:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094412.291807:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934720 00000100:00100000:2.0:1784094412.291813:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934720 00000100:00100000:2.0:1784094412.291849:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:2.0:1784094412.291855:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013934720:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094412.292161:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013934720:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 306us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094412.292166:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 645 00000100:00100000:1.0:1784094412.294847:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094412.294921:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934848 00000100:00100000:2.0:1784094412.294931:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934848 00000100:00100000:2.0:1784094412.294989:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1248 00000100:00100000:2.0:1784094412.294999:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013934848:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:2.0:1784094412.295709:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013934848:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 710us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094412.295718:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1248 00000100:00100000:1.0:1784094412.299662:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094412.299796:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013934976 00000100:00100000:0.0:1784094412.299806:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013934976 00000100:00100000:0.0:1784094412.299862:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1249 00000100:00100000:0.0:1784094412.299872:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013934976:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094412.299980:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013934976:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094412.299988:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1249 00000100:00100000:1.0:1784094412.303664:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094412.303776:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013935104 00000100:00100000:2.0:1784094412.303786:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013935104 00000100:00100000:2.0:1784094412.303846:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 646 00000100:00100000:2.0:1784094412.303856:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013935104:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:2.0:1784094412.304703:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013935104:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 837us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094412.304711:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 646 00000100:00100000:1.0:1784094412.306509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094412.306615:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013935232 00000100:00100000:0.0:1784094412.306625:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013935232 00000100:00100000:0.0:1784094412.306674:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 647 00000100:00100000:0.0:1784094412.306684:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013935232:12345-192.168.204.57@tcp:19:lfs.60003 00000100:00100000:0.0:1784094412.307127:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:62865:x1870757013935232:12345-192.168.204.57@tcp:19:lfs.60003 Request processed in 443us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094412.307135:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 647 00000100:00100000:1.0:1784094412.308148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094412.308197:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013935360 00000100:00100000:0.0:1784094412.308204:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013935360 00000100:00100000:0.0:1784094412.308253:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1250 00000100:00100000:0.0:1784094412.308263:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013935360:12345-192.168.204.57@tcp:48:lfs.60003 00000100:00100000:0.0:1784094412.308588:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+7:62865:x1870757013935360:12345-192.168.204.57@tcp:48:lfs.60003 Request processed in 327us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094412.308597:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1250 00000100:00100000:1.0:1784094412.324908:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094412.325079:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013935488 00000100:00100000:2.0:1784094412.325090:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013935488 00000100:00100000:2.0:1784094412.325152:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1251 00000100:00100000:2.0:1784094412.325164:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+7:62866:x1870757013935488:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:2.0:1784094412.325185:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094412.325238:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccde5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf6021 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094412.325307:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccdec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094412.325322:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094412.325333:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784094412.325559:0:5778:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00000004:00200000:2.0:1784094412.325563:0:5778:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784094412.325644:0:5778:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094412.325671:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41800/0x9ce98053214ccde5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6021 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094412.325706:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccdec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6021 expref: 8 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094412.325715:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781700) 00010000:00010000:2.0:1784094412.325718:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784094412.325722:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784094412.325781:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:62866:x1870757013935488:12345-192.168.204.57@tcp:101:rm.0 Request processed in 619us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094412.325788:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1251 00000100:00100000:1.0:1784094412.327977:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094412.328041:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013935744 00000100:00100000:0.0:1784094412.328052:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013935744 00000100:00100000:0.0:1784094412.328102:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1252 00000100:00100000:0.0:1784094412.328113:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+8:62866:x1870757013935744:12345-192.168.204.57@tcp:101:rm.0 00010000:00010000:0.0:1784094412.328134:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094412.328151:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ccdf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf6028 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094412.328412:0:5809:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00010000:0.0:1784094412.328712:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ccdf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6028 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.328726:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094412.328729:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784094412.328744:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214ccdf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6028 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.328757:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094412.328834:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+9:62866:x1870757013935744:12345-192.168.204.57@tcp:101:rm.0 Request processed in 723us (864us total) trans 4294967774 rc 301/301 00000100:00100000:0.0:1784094412.328841:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1252 00000100:00100000:1.0:1784094412.331217:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094412.331271:0:73874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013935872 00000100:00100000:2.0:1784094412.331281:0:73874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013935872 00000100:00100000:2.0:1784094412.331333:0:73874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 126 00000100:00100000:2.0:1784094412.331343:0:73874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:62866:x1870757013935872:12345-192.168.204.57@tcp:37:rm.0 00000100:00100000:2.0:1784094412.334862:0:73874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d859d42d-5b91-4307-b8c2-f99991427baa+9:62866:x1870757013935872:12345-192.168.204.57@tcp:37:rm.0 Request processed in 3509us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094412.334877:0:73874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 126 00000100:00100000:1.0:1784094412.341638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094412.341715:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013936128 00000100:00100000:3.0:1784094412.341725:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013936128 00000100:00100000:3.0:1784094412.341781:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 127 00000100:00100000:3.0:1784094412.341792:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:62866:x1870757013936128:12345-192.168.204.57@tcp:35:rm.0 00000100:00100000:3.0:1784094412.342274:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:62866:x1870757013936128:12345-192.168.204.57@tcp:35:rm.0 Request processed in 482us (643us total) trans 4294967775 rc 0/0 00000100:00100000:3.0:1784094412.342283:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 127 00000100:00100000:1.0:1784094412.344778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094412.344948:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013936384 00000100:00100000:0.0:1784094412.344958:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013936384 00000100:00100000:0.0:1784094412.345007:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1253 00000100:00100000:0.0:1784094412.345015:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+10:62866:x1870757013936384:12345-192.168.204.57@tcp:36:rm.0 00010000:00010000:0.0:1784094412.345065:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784094412.345087:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e41c00/0x9ce98053214ccdec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6021 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345115:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907101e40a00/0x9ce98053214ccd91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf600c expref: 9 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345127:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff90721a781700) 00010000:00010000:0.0:1784094412.345142:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de77c00/0x9ce98053214ccaab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf5f56 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345150:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bc00) 00010000:00010000:0.0:1784094412.345158:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784094412.345182:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345193:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345211:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345269:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345278:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.345285:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.346058:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.346072:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.346079:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784094412.346964:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 7680 00010000:00010000:0.0:1784094412.346980:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.346988:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.346996:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347002:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76400 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094412.347006:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347014:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347024:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff907202e6b100) 00010000:00010000:0.0:1784094412.347027:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784094412.347030:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347036:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76400/0x9ce98053214cce0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347054:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347061:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347067:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347072:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76200 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094412.347075:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347081:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347088:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907202e6bd00) 00010000:00010000:0.0:1784094412.347091:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094412.347093:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.347099:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76200/0x9ce98053214cce01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784094412.347109:0:5777:0:(mdt_handler.c:4483:mdt_save_lock()) ### save lock request 0000000036d706bb reply state 000000000e097a2e transno 4294967776 ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094412.347118:0:5777:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784094412.347206:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+9:62866:x1870757013936384:12345-192.168.204.57@tcp:36:rm.0 Request processed in 2188us (2432us total) trans 4294967776 rc 0/0 00000100:00100000:0.0:1784094412.347215:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1253 00010000:00010000:0.0:1784094412.348513:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.348530:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.348537:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.348543:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc20774f0) 00010000:00010000:0.0:1784094412.348547:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.348554:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.348566:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff907202e6b300) 00010000:00010000:0.0:1784094412.348569:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784094412.348573:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094412.348579:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723de76c00/0x9ce98053214cce08 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784094413.066002:0:104893:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffec754370 20000000:00000080:1.0:1784094413.066018:0:104893:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b32c00 uarg=0000000000000000 00010000:00010000:1.0:1784094413.069210:0:104893:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094413.069233:0:104893:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094413.069272:0:104893:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094413.069291:0:104893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094413.069307:0:104893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cca96 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094413.069316:0:104893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094413.069353:0:104893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cca96 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094413.069372:0:104893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cca96 expref: 18 pid: 5772 timeout: 1724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094413.069387:0:104893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104893:1870757024395776:0@lo:104: 00000100:00100000:1.0:1784094413.069526:0:104893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094413.069569:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395776 00000100:00100000:1.0:1784094413.069576:0:104893:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b796540 going to sleep for 11 seconds 00000100:00100000:0.0:1784094413.069577:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395776 00000100:00100000:0.0:1784094413.069626:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1784094413.069634:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:104893:x1870757024395776:12345-0@lo:104: 00010000:00010000:0.0:1784094413.069648:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094413.069730:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094413.069737:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:104893:x1870757024395776:12345-0@lo:104: Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094413.069745:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1784094413.069775:0:104893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104893:1870757024395776:0@lo:104: 00010000:00010000:1.0:1784094413.069794:0:104893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.069823:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094413.069832:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.069841:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094413.069845:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.069853:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094413.069860:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094413.069865:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094413.069902:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.069909:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094413.069936:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.069943:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77600/0x9ce98053214cca96 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cca9d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094413.069952:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094413.069965:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024395904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094413.069971:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094413.069975:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094413.069978:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094413.069998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094413.070088:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024395904 00000100:00100000:3.0:1784094413.070093:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024395904 00010000:00010000:3.0:1784094413.070112:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cca96 expref: 19 pid: 5772 timeout: 1724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094413.070176:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1784094413.070184:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024395904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094413.070194:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094413.070200:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cca96 expref: 19 pid: 5772 timeout: 1724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070211:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cca96 expref: 19 pid: 5772 timeout: 1724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070224:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214cca9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cca96 expref: 19 pid: 5772 timeout: 1724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070236:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070244:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070256:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070263:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070270:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070276:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070281:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094413.070285:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070292:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070326:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094413.070340:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094413.070381:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b84450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024395904:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094413.070388:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00010000:1.0:1784094413.070396:0:104893:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094413.070405:0:104893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094413.070410:0:104893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13400/0x9ce98053214cce16 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094413.070457:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024395904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094413.290473:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094413.455114:0:104941:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4a810f40 20000000:00000080:2.0:1784094413.455133:0:104941:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907226033c00 uarg=0000000000000000 00010000:00010000:2.0:1784094413.455373:0:104941:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094413.455388:0:104941:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094413.455405:0:104941:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094413.455781:0:104941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455804:0:104941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455815:0:104941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455822:0:104941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455829:0:104941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455836:0:104941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455842:0:104941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094413.455847:0:104941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455856:0:104941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455869:0:104941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455877:0:104941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.455884:0:104941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41400/0x9ce98053214cce1d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094413.801915:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024396032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094413.801992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094413.802363:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396032 00000100:00100000:1.0:1784094413.802518:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396032 00000100:00080000:2.0:1784094413.802703:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094413.802749:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1784094413.802763:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024396032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094413.802802:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094413.802856:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024396032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094413.802864:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1784094413.802927:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024396032:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1784094413.882479:0:104989:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd446ceec0 20000000:00000080:2.0:1784094413.882497:0:104989:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907226032000 uarg=0000000000000000 00010000:00010000:2.0:1784094413.882731:0:104989:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094413.882746:0:104989:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094413.882763:0:104989:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094413.882782:0:104989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882798:0:104989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882808:0:104989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882816:0:104989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882823:0:104989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882829:0:104989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882836:0:104989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094413.882840:0:104989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882848:0:104989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882861:0:104989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882869:0:104989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094413.882874:0:104989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41400/0x9ce98053214cce24 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094414.315141:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094414.633505:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094414.633513:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094414.633518:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094414.633560:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094414.633572:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094414.633582:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094414.633607:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024396160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094414.633686:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094414.633731:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486180 going to sleep for 11 seconds 00000100:00100000:1.0:1784094414.635002:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396160 00000100:00100000:1.0:1784094414.635013:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396160 00000100:00100000:1.0:1784094414.635058:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1784094414.635068:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024396160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094414.635082:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094414.635096:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cce2b expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094414.635120:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cce2b expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094414.635131:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce2b expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094414.635141:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12e00, rc 0) 00000100:00100000:1.0:1784094414.635192:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024396160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094414.635199:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1784094414.635486:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024396160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094414.635504:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094414.635514:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094414.635539:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094414.635544:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094414.635552:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094415.337687:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094415.764088:0:105184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff219026b0 20000000:00000080:2.0:1784094415.764111:0:105184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907226030400 uarg=0000000000000000 00010000:00010000:2.0:1784094415.764364:0:105184:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094415.764382:0:105184:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094415.764402:0:105184:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094415.764460:0:105184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094415.764478:0:105184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce2b expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094415.764488:0:105184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094415.764528:0:105184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cce2b expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094415.764548:0:105184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cce2b expref: 18 pid: 5772 timeout: 1726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094415.764563:0:105184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105184:1870757024396288:0@lo:104: 00000100:00100000:2.0:1784094415.764644:0:105184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094415.764696:0:105184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071019cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094415.764774:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396288 00000100:00100000:1.0:1784094415.764782:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396288 00000100:00100000:1.0:1784094415.764870:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1784094415.764880:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:105184:x1870757024396288:12345-0@lo:104: 00010000:00010000:1.0:1784094415.764893:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094415.764968:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094415.764974:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:105184:x1870757024396288:12345-0@lo:104: Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094415.764985:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784094415.765071:0:105184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105184:1870757024396288:0@lo:104: 00010000:00010000:3.0:1784094415.765088:0:105184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765445:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094415.765454:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765464:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094415.765468:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765477:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094415.765485:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094415.765491:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094415.765523:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765530:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094415.765552:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765565:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77e00/0x9ce98053214cce2b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce32 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094415.765572:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024396416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094415.765583:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094415.765586:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094415.765589:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094415.765612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094415.765659:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396416 00000100:00100000:0.0:1784094415.765665:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396416 00010000:00010000:0.0:1784094415.765686:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce2b expref: 19 pid: 5772 timeout: 1726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094415.765715:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784094415.765722:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024396416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094415.765731:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094415.765736:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce2b expref: 19 pid: 5772 timeout: 1726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765746:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cce2b expref: 19 pid: 5772 timeout: 1726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765763:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12e00/0x9ce98053214cce32 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cce2b expref: 19 pid: 5772 timeout: 1726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765774:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765781:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765797:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765803:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765808:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765813:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765818:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094415.765821:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765831:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765849:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094415.765857:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094415.765887:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024396416:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094415.765894:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784094415.765920:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024396416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094415.766085:0:105184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094415.766093:0:105184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094415.766099:0:105184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41c00/0x9ce98053214cce39 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094416.254720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094416.255707:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013936512 00000100:00100000:0.0:1784094416.255719:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013936512 00000100:00100000:0.0:1784094416.255788:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 972 00000100:00100000:0.0:1784094416.255799:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013936512:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094416.255882:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013936512:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 84us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.255893:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 972 00000100:00100000:0.0:1784094416.255963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094416.256023:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013936640 00000100:00100000:3.0:1784094416.256039:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013936640 00000100:00100000:0.0:1784094416.256115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094416.256150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094416.256175:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013936768 00000100:00100000:0.0:1784094416.256180:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013936768 00000100:00100000:0.0:1784094416.256216:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013936896 00000100:00100000:0.0:1784094416.256220:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013936896 00000100:00100000:0.0:1784094416.256250:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 846 00000100:00100000:0.0:1784094416.256258:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013936768:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094416.256295:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013936768:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.256303:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 846 00000100:00100000:3.0:1784094416.256314:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1097 00000100:00100000:0.0:1784094416.256321:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 847 00000100:00100000:3.0:1784094416.256353:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013936640:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094416.256353:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013936896:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094416.256402:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2352:x1870757013936896:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.256410:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 847 00000100:00100000:3.0:1784094416.256519:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d859d42d-5b91-4307-b8c2-f99991427baa+8:2352:x1870757013936640:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 183us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094416.256529:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1097 00000100:00080000:3.0:1784094416.256567:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094416.256573:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784094416.256580:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094416.361572:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094416.874820:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024396672:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.874888:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094416.874945:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024397184:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.874972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094416.875002:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784094416.875009:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024396544:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.875037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094416.875045:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396672 00000100:00100000:3.0:1784094416.875055:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396672 00000100:00100000:1.0:1784094416.875062:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024397056:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.875088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094416.875732:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024396800:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.875767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094416.875832:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024396928:0@lo:400:kworker.0 00000100:00100000:0.0:1784094416.875865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094416.875897:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397184 00000100:00100000:0.0:1784094416.875902:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397184 00000100:00100000:3.0:1784094416.875924:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397056 00000100:00100000:3.0:1784094416.875931:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397056 00000100:00100000:1.0:1784094416.875947:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094416.875956:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396928 00000100:00100000:0.0:1784094416.875961:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396928 00000100:00100000:3.0:1784094416.875965:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396800 00000100:00100000:0.0:1784094416.875990:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1784094416.875998:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024397184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876021:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094416.876053:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024396544 00000100:00100000:1.0:1784094416.876057:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396544 00000100:00100000:0.0:1784094416.876062:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024397184:12345-0@lo:400:kworker.0 Request processed in 62us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.876070:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1784094416.876090:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1784094416.876095:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1784094416.876100:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024396928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876108:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024396544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094416.876140:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024396800 00000100:00100000:0.0:1784094416.876141:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024396928:12345-0@lo:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094416.876151:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024396544:12345-0@lo:400:kworker.0 Request processed in 47us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.876153:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1784094416.876162:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1784094416.876175:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1784094416.876187:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1784094416.876188:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024396672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876195:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397312 00000100:00100000:1.0:1784094416.876200:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397312 00000100:00100000:0.0:1784094416.876204:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024397056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876224:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1784094416.876230:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024397312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094416.876247:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024397056:12345-0@lo:400:kworker.0 Request processed in 50us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.876255:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00002000:00000024:1.0:1784094416.876256:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094416.876262:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024396672:12345-0@lo:400:kworker.0 Request processed in 78us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094416.876271:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1784094416.876281:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1784094416.876291:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876295:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024397312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094416.876302:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1784094416.876333:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024396800:12345-0@lo:400:kworker.0 Request processed in 43us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094416.876340:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1784094416.876343:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024396800:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876358:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024397312:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094416.876367:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094416.876373:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094416.876375:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094416.876408:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024396928:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876411:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024396544:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876849:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024397056:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876858:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024396672:0@lo:400:kworker.0 00000100:00100000:1.0:1784094416.876864:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024397184:0@lo:400:kworker.0 10000000:01000000:3.0:1784094417.385561:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094417.385571:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094417.385577:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094417.385643:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094417.385656:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094417.385667:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094417.385702:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024397440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094417.385773:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094417.385830:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220c64300 going to sleep for 11 seconds 00000100:00100000:0.0:1784094417.386153:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397440 00000100:00100000:0.0:1784094417.386161:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397440 00000100:00100000:0.0:1784094417.386210:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1784094417.386221:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024397440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094417.386235:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094417.386251:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cce40 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094417.386276:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cce40 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094417.386291:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce40 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094417.386300:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76400, rc 0) 00010000:00010000:2.0:1784094417.386376:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094417.386465:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024397440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094417.386472:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1784094417.386545:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024397440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094417.386562:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094417.386576:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094417.386606:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094417.386612:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094417.386623:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784094417.413412:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967776 is committed 00010000:00010000:1.0:1784094418.409715:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094418.922127:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024397568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094418.922200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094418.922402:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397568 00000100:00100000:2.0:1784094418.922410:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397568 00000100:00100000:2.0:1784094418.922534:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1784094418.922555:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024397568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094418.922600:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094418.922658:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024397568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094418.922666:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1784094418.922807:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024397568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094418.922894:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094419.435914:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784094420.327383:0:105528:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23a: test mapped regular ACLs ========= 01:46:59 (1784094419) 00010000:00010000:0.0:1784094420.457641:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784094420.993185:0:105576:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23a Need 2 clients at least 00000100:00100000:0.0:1784094421.369698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094421.369748:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094421.369809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094421.369857:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094421.369917:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937024 00000100:00100000:3.0:1784094421.369943:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937152 00000100:00100000:3.0:1784094421.369956:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937152 00000100:00100000:3.0:1784094421.370032:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1101 00000100:00100000:3.0:1784094421.370045:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013937152:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094421.370094:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937024 00000100:00100000:1.0:1784094421.370164:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937408 00000100:00100000:1.0:1784094421.370178:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937408 00000100:00100000:1.0:1784094421.370243:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937280 00000100:00100000:1.0:1784094421.370247:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937280 00000100:00100000:1.0:1784094421.370277:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 850 00000100:00100000:1.0:1784094421.370287:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013937408:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094421.370387:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 851 00000100:00100000:0.0:1784094421.370401:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937280:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094421.372711:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013937152:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 2650us (3010us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094421.372730:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1101 00000100:00100000:3.0:1784094421.372831:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 975 00000100:00100000:3.0:1784094421.372851:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013937024:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094421.372865:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2354:x1870757013937408:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 2406us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094421.372883:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 850 00000100:00100000:3.0:1784094421.372935:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013937024:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 92us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094421.372944:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 975 00000100:00080000:1.0:1784094421.373016:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094421.373022:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094421.373025:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094421.374743:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937280:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 4333us (4874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094421.374758:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 851 00010000:00010000:3.0:1784094421.481851:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784094421.751152:0:105624:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23b: test mapped default ACLs ========= 01:47:01 (1784094421) 00000100:00100000:2.0:1784094421.994313:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024397696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094421.994408:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024397824:0@lo:400:kworker.0 00000100:00100000:1.0:1784094421.994666:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094421.994798:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397824 00000100:00100000:3.0:1784094421.994806:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397824 00000100:00100000:3.0:1784094421.994857:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1784094421.994869:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024397824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.994925:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024397824:12345-0@lo:400:kworker.0 Request processed in 59us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094421.994930:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024397952:0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.994937:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1784094421.994972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094421.994999:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024398080:0@lo:400:kworker.0 00000100:00100000:0.0:1784094421.995003:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024398464:0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.995041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094421.995046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094421.995112:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397952 00000100:00100000:1.0:1784094421.995117:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397952 00000100:00100000:1.0:1784094421.995145:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398080 00000100:00100000:1.0:1784094421.995148:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398080 00000100:00100000:1.0:1784094421.995174:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:1.0:1784094421.995180:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024397952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.995301:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1784094421.995310:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.995346:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024398080:12345-0@lo:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094421.995352:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1784094421.995388:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024398080:0@lo:400:kworker.0 00000100:00100000:0.0:1784094421.995440:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398464 00000100:00100000:0.0:1784094421.995446:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398464 00000100:00100000:0.0:1784094421.995478:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1784094421.995486:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024398464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784094421.995521:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094421.995526:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094421.995538:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024398336:0@lo:400:kworker.0 00000100:00100000:1.0:1784094421.995689:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024397952:12345-0@lo:400:kworker.0 Request processed in 508us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094421.995696:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:1.0:1784094421.995743:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024397952:0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.995872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094421.995889:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024398464:12345-0@lo:400:kworker.0 Request processed in 402us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094421.995897:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1784094421.995930:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398336 00000100:00100000:0.0:1784094421.995935:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398336 00000100:00100000:3.0:1784094421.995938:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024397824:0@lo:400:kworker.0 00000100:00100000:3.0:1784094421.995952:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094421.995957:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024398208:0@lo:400:kworker.0 00000100:00100000:0.0:1784094421.995972:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1784094421.995980:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024398336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094421.996008:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024398464:0@lo:400:kworker.0 00000100:00100000:0.0:1784094421.996023:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024398336:12345-0@lo:400:kworker.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094421.996031:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00080000:1.0:1784094421.996034:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094421.996096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094421.996161:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024398336:0@lo:400:kworker.0 00000100:00100000:2.0:1784094421.996207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094421.996258:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024397696 00000100:00100000:0.0:1784094421.996263:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024397696 00000100:00100000:1.0:1784094421.996274:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398208 00000100:00100000:1.0:1784094421.996281:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398208 00000100:00100000:1.0:1784094421.996453:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:1.0:1784094421.996461:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024398208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094421.996499:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024398208:12345-0@lo:400:kworker.0 Request processed in 40us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094421.996506:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00080000:3.0:1784094421.996564:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094421.996584:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024398208:0@lo:400:kworker.0 00000100:00100000:0.0:1784094421.996624:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1784094421.996634:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024397696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094421.996664:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094421.996713:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024397696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094421.996720:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1784094421.996757:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024397696:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784094422.417722:0:105672:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23b Need 2 clients at least 00010000:00010000:2.0:1784094422.505832:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784094423.221639:0:105721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 24: check nodemap proc files for LBUGs and Oopses ========================================================== 01:47:02 (1784094422) 00010000:00010000:0.0:1784094423.530157:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1784094423.706754:0:105770:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1784094423.710702:0:105770:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:0.0:1784094424.042939:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024398592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094424.043012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094424.043667:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398592 00000100:00100000:3.0:1784094424.043676:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398592 00000100:00100000:3.0:1784094424.043797:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1784094424.043812:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024398592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094424.043848:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094424.043909:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024398592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094424.043916:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00080000:1.0:1784094424.043972:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094424.043998:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024398592:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1784094424.121580:0:105818:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1c1a8040 20000000:00000080:2.0:1784094424.121593:0:105818:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb16c00 uarg=0000000000000000 10000000:01000000:2.0:1784094424.122134:0:105818:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094424.122153:0:105818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094424.122170:0:105818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce40 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094424.122177:0:105818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094424.122209:0:105818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cce40 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094424.122222:0:105818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cce40 expref: 18 pid: 5771 timeout: 1735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094424.122236:0:105818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105818:1870757024398720:0@lo:104: 00000100:00100000:2.0:1784094424.122288:0:105818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094424.122341:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398720 00000100:00100000:0.0:1784094424.122348:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398720 00000100:00100000:2.0:1784094424.122395:0:105818:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af5480 going to sleep for 11 seconds 00000100:00100000:0.0:1784094424.122415:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1784094424.122449:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:105818:x1870757024398720:12345-0@lo:104: 00010000:00010000:0.0:1784094424.122461:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.122524:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094424.122530:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:105818:x1870757024398720:12345-0@lo:104: Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094424.122536:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1784094424.122547:0:105818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105818:1870757024398720:0@lo:104: 00010000:00010000:2.0:1784094424.122562:0:105818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094424.122610:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094424.122615:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094424.122622:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094424.122626:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094424.122635:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094424.122642:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094424.122649:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094424.122719:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094424.122726:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094424.122756:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094424.122763:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69800/0x9ce98053214cce40 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce47 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094424.122776:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094424.122778:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094424.122779:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094424.122835:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024398848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094424.122862:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094424.122951:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398848 00000100:00100000:0.0:1784094424.122956:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398848 00010000:00010000:0.0:1784094424.122972:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce40 expref: 19 pid: 5771 timeout: 1735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094424.123002:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784094424.123011:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024398848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094424.123021:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094424.123026:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce40 expref: 19 pid: 5771 timeout: 1735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123036:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cce40 expref: 19 pid: 5771 timeout: 1735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123047:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76400/0x9ce98053214cce47 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cce40 expref: 19 pid: 5771 timeout: 1735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123059:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123071:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123083:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123089:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123096:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123102:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123108:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094424.123112:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.123120:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094424.123250:0:105818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094424.123258:0:105818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.124189:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.124199:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cce4e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.124212:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094424.125564:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024398848:12345-0@lo:103:ldlm_bl.0 Request processed in 2550us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094424.125575:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1784094424.125645:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024398848:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1784094424.512298:0:105866:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1c0ac3b0 20000000:00000080:3.0:1784094424.512316:0:105866:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90710192a400 uarg=0000000000000000 10000000:01000000:3.0:1784094424.512759:0:105866:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094424.512781:0:105866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512797:0:105866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512809:0:105866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512814:0:105866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512822:0:105866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512828:0:105866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512835:0:105866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094424.512839:0:105866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512847:0:105866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512861:0:105866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512869:0:105866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.512875:0:105866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214cce55 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094424.553913:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094424.888857:0:105914:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd85dbc460 20000000:00000080:0.0:1784094424.888870:0:105914:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d997000 uarg=0000000000000000 10000000:01000000:0.0:1784094424.889048:0:105914:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094424.889069:0:105914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889084:0:105914:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889095:0:105914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889102:0:105914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889109:0:105914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889116:0:105914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889122:0:105914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094424.889126:0:105914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889134:0:105914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889148:0:105914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889159:0:105914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094424.889166:0:105914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214cce5c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094425.257780:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094425.257788:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094425.257792:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094425.257845:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.257858:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.257868:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094425.257894:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024398976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094425.257963:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094425.258364:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b7963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094425.258400:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024398976 00000100:00100000:2.0:1784094425.258408:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024398976 00000100:00100000:2.0:1784094425.258496:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1784094425.258511:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024398976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094425.258609:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094425.258623:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cce63 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.258648:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cce63 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.258660:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce63 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.258670:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784094425.258718:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024398976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094425.258725:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1784094425.258766:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024398976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094425.258784:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.258795:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094425.258881:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094425.258888:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.258896:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784094425.294553:0:105962:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfa739e50 20000000:00000080:2.0:1784094425.294567:0:105962:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb14400 uarg=0000000000000000 10000000:01000000:2.0:1784094425.294743:0:105962:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094425.294762:0:105962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.294777:0:105962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce63 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.294785:0:105962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.294823:0:105962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cce63 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.294838:0:105962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cce63 expref: 18 pid: 5770 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094425.294853:0:105962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105962:1870757024399104:0@lo:104: 00000100:00100000:2.0:1784094425.294912:0:105962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094425.295010:0:105962:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af5840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094425.295060:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784094425.295075:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399104 00000100:00100000:1.0:1784094425.295081:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399104 00000100:00100000:1.0:1784094425.295132:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1784094425.295141:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:105962:x1870757024399104:12345-0@lo:104: 00010000:00010000:1.0:1784094425.295153:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.295291:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094425.295298:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:105962:x1870757024399104:12345-0@lo:104: Request processed in 159us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094425.295305:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:3.0:1784094425.295310:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094425.295375:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094425.295385:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094425.295389:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094425.295403:0:105962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105962:1870757024399104:0@lo:104: 00010000:00010000:3.0:1784094425.295407:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094425.295416:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094425.295434:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094425.295480:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094425.295487:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094425.295503:0:105962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094425.295531:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094425.295540:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de76c00/0x9ce98053214cce63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce6a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094425.295558:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094425.295560:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094425.295562:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024399232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094425.295563:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094425.295594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094425.295630:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399232 00000100:00100000:0.0:1784094425.295637:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399232 00010000:00010000:0.0:1784094425.295660:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce63 expref: 19 pid: 5770 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094425.295692:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784094425.295699:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024399232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094425.295711:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094425.295717:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce63 expref: 19 pid: 5770 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295727:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cce63 expref: 19 pid: 5770 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295740:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214cce6a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cce63 expref: 19 pid: 5770 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295767:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295775:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295786:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295797:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295803:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295809:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295814:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094425.295818:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295824:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295837:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094425.295845:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094425.295860:0:105962:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.295869:0:105962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094425.295879:0:105962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41200/0x9ce98053214cce71 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094425.295895:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024399232:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094425.295903:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1784094425.296614:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024399232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094425.579669:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094425.670584:0:106010:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd04c1b20 20000000:00000080:1.0:1784094425.670600:0:106010:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907230b45c00 uarg=0000000000000000 10000000:01000000:1.0:1784094425.670776:0:106010:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094425.670797:0:106010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670812:0:106010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670822:0:106010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670826:0:106010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670831:0:106010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670839:0:106010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670843:0:106010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094425.670846:0:106010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670851:0:106010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670861:0:106010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670865:0:106010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094425.670869:0:106010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214cce78 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094426.034332:0:106058:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3eccb610 20000000:00000080:0.0:1784094426.034346:0:106058:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d994000 uarg=0000000000000000 10000000:01000000:0.0:1784094426.035041:0:106058:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094426.035062:0:106058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035084:0:106058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035095:0:106058:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035102:0:106058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035109:0:106058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035117:0:106058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035124:0:106058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094426.035129:0:106058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035137:0:106058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035150:0:106058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035158:0:106058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094426.035165:0:106058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214cce7f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094426.493956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094426.493998:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094426.494034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094426.494064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094426.494143:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937792 00000100:00100000:2.0:1784094426.494153:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937792 00000100:00100000:2.0:1784094426.494213:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937920 00000100:00100000:2.0:1784094426.494216:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937920 00000100:00100000:2.0:1784094426.494237:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 854 00000100:00100000:2.0:1784094426.494246:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937792:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094426.494308:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937792:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 64us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094426.494316:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 854 00000100:00100000:2.0:1784094426.494335:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 855 00000100:00100000:3.0:1784094426.494338:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937664 00000100:00100000:2.0:1784094426.494344:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937920:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094426.494345:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937664 00000100:00100000:2.0:1784094426.494373:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937920:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094426.494380:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 855 00000100:00100000:3.0:1784094426.494394:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1105 00000100:00100000:3.0:1784094426.494404:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937664:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094426.494487:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013937664:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 85us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094426.494496:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1105 00000100:00080000:0.0:1784094426.494605:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094426.494610:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094426.494612:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094426.496222:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013937536 00000100:00100000:1.0:1784094426.496232:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013937536 00000100:00100000:1.0:1784094426.496288:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 978 00000100:00100000:1.0:1784094426.496297:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013937536:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094426.496368:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013937536:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 71us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094426.496374:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 978 10000000:01000000:3.0:1784094426.540357:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094426.540363:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094426.540367:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094426.540411:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094426.540504:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094426.540514:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094426.540538:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024399360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094426.540621:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094426.540668:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094426.540713:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399360 00000100:00100000:2.0:1784094426.540722:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399360 00000100:00100000:2.0:1784094426.540780:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1784094426.540790:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024399360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094426.540803:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094426.540818:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cce86 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094426.540844:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cce86 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094426.540856:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce86 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094426.540866:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784094426.540991:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024399360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094426.540998:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1784094426.541093:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024399360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094426.541108:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094426.541117:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094426.541137:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094426.541143:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094426.541151:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094426.601610:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094427.113578:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024399488:0@lo:400:kworker.0 00000100:00100000:1.0:1784094427.113623:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024399744:0@lo:400:kworker.0 00000100:00100000:0.0:1784094427.113655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094427.113668:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094427.113724:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024400000:0@lo:400:kworker.0 00000100:00100000:0.0:1784094427.113756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094427.113762:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024399616:0@lo:400:kworker.0 00000100:00100000:0.0:1784094427.113801:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399744 00000100:00100000:3.0:1784094427.113802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094427.113810:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399744 00000100:00100000:3.0:1784094427.113834:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024400128:0@lo:400:kworker.0 00000100:00100000:3.0:1784094427.113862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094427.113868:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400000 00000100:00100000:2.0:1784094427.113874:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399616 00000100:00100000:0.0:1784094427.113874:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400000 00000100:00100000:2.0:1784094427.113881:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399616 00000100:00100000:0.0:1784094427.113908:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1784094427.113916:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1784094427.113920:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024399744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094427.113926:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1784094427.113929:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024400000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094427.113939:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024399616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.113992:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024400000:12345-0@lo:400:kworker.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094427.113992:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024399744:12345-0@lo:400:kworker.0 Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094427.113999:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024399616:12345-0@lo:400:kworker.0 Request processed in 61us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094427.114005:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1784094427.114016:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00080000:0.0:1784094427.114040:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094427.114051:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024399744:0@lo:400:kworker.0 00000100:00100000:0.0:1784094427.114064:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024400000:0@lo:400:kworker.0 00000100:00100000:1.0:1784094427.114068:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094427.114075:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024399872:0@lo:400:kworker.0 00000100:00100000:1.0:1784094427.114099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094427.114132:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399488 00000100:00100000:1.0:1784094427.114136:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399488 00000100:00100000:2.0:1784094427.114143:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400128 00000100:00100000:2.0:1784094427.114148:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400128 00000100:00100000:1.0:1784094427.114172:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1784094427.114179:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024399872 00000100:00100000:2.0:1784094427.114182:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024399872 00000100:00080000:0.0:1784094427.114192:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094427.114196:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024399488:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094427.114198:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094427.114246:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024399488:12345-0@lo:400:kworker.0 Request processed in 57us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094427.114253:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1784094427.114261:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024399488:0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.114278:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1784094427.114289:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024400128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.114333:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024400128:12345-0@lo:400:kworker.0 Request processed in 47us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094427.114340:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1784094427.114355:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1784094427.114363:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d75e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024399872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.114405:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d75e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024399872:12345-0@lo:400:kworker.0 Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094427.114446:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024399872:0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.114479:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1784094427.114534:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1784094427.114597:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094427.114605:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024400256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094427.114641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094427.114679:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024399616:0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.114680:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400256 00000100:00100000:2.0:1784094427.114686:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400256 00000100:00100000:3.0:1784094427.114694:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024400128:0@lo:400:kworker.0 00000100:00100000:2.0:1784094427.114718:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1784094427.114727:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024400256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094427.114764:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094427.114807:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024400256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094427.114814:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1784094427.114881:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024400256:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1784094427.245796:0:106205:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2be59980 20000000:00000080:0.0:1784094427.245810:0:106205:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237500000 uarg=0000000000000000 10000000:01000000:0.0:1784094427.245975:0:106205:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094427.245991:0:106205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.246005:0:106205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cce86 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.246011:0:106205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.246043:0:106205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cce86 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.246055:0:106205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cce86 expref: 18 pid: 5771 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094427.246070:0:106205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106205:1870757024400384:0@lo:104: 00000100:00100000:0.0:1784094427.246135:0:106205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094427.246235:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400384 00000100:00100000:0.0:1784094427.246239:0:106205:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094427.246243:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400384 00000100:00100000:3.0:1784094427.246294:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784094427.246303:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:106205:x1870757024400384:12345-0@lo:104: 00010000:00010000:3.0:1784094427.246316:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094427.246371:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094427.246377:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:106205:x1870757024400384:12345-0@lo:104: Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094427.246384:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784094427.246390:0:106205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106205:1870757024400384:0@lo:104: 00010000:00010000:2.0:1784094427.246401:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094427.246442:0:106205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094427.246546:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094427.246556:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094427.246561:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094427.246570:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094427.246577:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094427.246596:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094427.246628:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094427.246635:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094427.246657:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094427.246666:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024400512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094427.246666:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cce86 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cce8d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094427.246688:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094427.246691:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094427.246694:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094427.246704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094427.246731:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400512 00000100:00100000:1.0:1784094427.246736:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400512 00010000:00010000:1.0:1784094427.246757:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce86 expref: 19 pid: 5771 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094427.246781:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1784094427.246788:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024400512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094427.246797:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094427.246802:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cce86 expref: 19 pid: 5771 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246813:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cce86 expref: 19 pid: 5771 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246829:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214cce8d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cce86 expref: 19 pid: 5771 timeout: 1738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246843:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246851:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246864:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246871:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246879:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246886:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246891:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094427.246896:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246903:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246922:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094427.246937:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784094427.246972:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024400512:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094427.246980:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1784094427.247009:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024400512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094427.247027:0:106205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.247035:0:106205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.247041:0:106205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214cce94 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094427.626764:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094427.661761:0:106255:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffda5ac200 20000000:00000080:0.0:1784094427.661779:0:106255:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d996400 uarg=0000000000000000 10000000:01000000:0.0:1784094427.662208:0:106255:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094427.662229:0:106255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662250:0:106255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662261:0:106255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662268:0:106255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662274:0:106255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662280:0:106255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662286:0:106255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094427.662290:0:106255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662298:0:106255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662310:0:106255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662321:0:106255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094427.662327:0:106255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214cce9b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094428.329524:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094428.329532:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094428.329539:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094428.329588:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094428.329600:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094428.329611:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094428.329650:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024400640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094428.329718:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094428.329775:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210f1c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094428.330034:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400640 00000100:00100000:2.0:1784094428.330042:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400640 00000100:00100000:2.0:1784094428.330102:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1784094428.330112:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024400640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094428.330126:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094428.330140:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccea2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094428.330164:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094428.330176:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094428.330186:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41200, rc 0) 00000100:00100000:2.0:1784094428.330232:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024400640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094428.330239:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1784094428.330371:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024400640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094428.330385:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094428.330406:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094428.330465:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094428.330471:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094428.330480:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094428.649606:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094429.162130:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024400768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094429.162190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094429.162269:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400768 00000100:00100000:3.0:1784094429.162278:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400768 00000100:00100000:3.0:1784094429.162355:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1784094429.162367:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024400768:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094429.162370:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784094429.162418:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094429.162499:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024400768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094429.162506:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:0.0:1784094429.162633:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024400768:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784094429.470530:0:106450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe020f6080 20000000:00000080:0.0:1784094429.470545:0:106450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90722d995400 uarg=0000000000000000 00010000:00010000:0.0:1784094429.470742:0:106450:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1784094429.470766:0:106450:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1784094429.470781:0:106450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094429.470799:0:106450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.470815:0:106450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.470824:0:106450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.470862:0:106450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.470881:0:106450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 18 pid: 5771 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094429.470966:0:106450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106450:1870757024400896:0@lo:104: 00000100:00100000:0.0:1784094429.471021:0:106450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094429.471135:0:106450:0:(client.c:2702:ptlrpc_set_wait()) set ffff907210af5840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094429.471174:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024400896 00000100:00100000:1.0:1784094429.471180:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024400896 00000100:00100000:1.0:1784094429.471248:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1784094429.471257:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:106450:x1870757024400896:12345-0@lo:104: 00010000:00010000:1.0:1784094429.471269:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094429.471332:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094429.471337:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:106450:x1870757024400896:12345-0@lo:104: Request processed in 82us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094429.471344:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1784094429.471492:0:106450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106450:1870757024400896:0@lo:104: 00010000:00010000:3.0:1784094429.471496:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094429.471504:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094429.471511:0:106450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094429.471514:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094429.471521:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094429.471534:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094429.471541:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094429.471556:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094429.471590:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094429.471601:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094429.471646:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094429.471654:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214ccea2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccea9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094429.471661:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784094429.471674:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094429.471677:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094429.471678:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094429.471686:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024401024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094429.471718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094429.471771:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401024 00000100:00100000:0.0:1784094429.471776:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401024 00010000:00010000:0.0:1784094429.471793:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 19 pid: 5771 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094429.471846:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1784094429.471853:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024401024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094429.471862:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094429.471867:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 19 pid: 5771 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.471877:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 19 pid: 5771 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.471969:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41200/0x9ce98053214ccea9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccea2 expref: 19 pid: 5771 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.471983:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.471991:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472007:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472014:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472021:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472027:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472033:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094429.472037:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472043:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472057:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094429.472064:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094429.472093:0:106450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094429.472104:0:106450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094429.472112:0:106450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214cceb0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094429.472133:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024401024:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094429.472141:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1784094429.472180:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024401024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094429.673786:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094430.697540:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784094430.761565:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094430.761573:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094430.761578:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094430.761623:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094430.761636:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094430.761647:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094430.761674:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024401152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094430.761755:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094430.761804:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103720480 going to sleep for 11 seconds 00000100:00100000:1.0:1784094430.763333:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401152 00000100:00100000:1.0:1784094430.763356:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401152 00000100:00100000:1.0:1784094430.763413:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1784094430.763450:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024401152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094430.763465:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094430.763484:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cceb7 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094430.763507:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094430.763524:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094430.763534:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784094430.763593:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024401152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094430.763600:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1784094430.763830:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024401152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094430.763850:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094430.763861:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094430.763884:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094430.763890:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094430.763898:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094431.611873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094431.611908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094431.611945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094431.611983:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094431.612041:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938176 00000100:00100000:1.0:1784094431.612050:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938176 00000100:00100000:1.0:1784094431.612103:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1109 00000100:00100000:1.0:1784094431.612111:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938176:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094431.612166:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938176:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094431.612170:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1109 00000100:00100000:1.0:1784094431.612188:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938304 00000100:00100000:1.0:1784094431.612191:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938304 00000100:00100000:1.0:1784094431.612206:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938432 00000100:00100000:1.0:1784094431.612208:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938432 00000100:00100000:1.0:1784094431.612219:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 858 00000100:00100000:1.0:1784094431.612223:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938304:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094431.612237:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938304:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 14us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094431.612241:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 858 00000100:00100000:1.0:1784094431.612247:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 859 00000100:00100000:1.0:1784094431.612251:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938432:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094431.612267:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938432:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 16us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094431.612270:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 859 00000100:00080000:0.0:1784094431.612323:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094431.612335:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094431.612338:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094431.612386:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938048 00000100:00100000:3.0:1784094431.612390:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938048 00000100:00100000:1.0:1784094431.612463:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 983 00000100:00100000:1.0:1784094431.612474:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013938048:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094431.612563:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013938048:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 91us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094431.612570:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 983 00010000:00010000:0.0:1784094431.721565:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094432.012809:0:106694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8f3b0cd0 20000000:00000080:3.0:1784094432.012828:0:106694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b31000 uarg=0000000000000000 00010000:00010000:3.0:1784094432.016115:0:106694:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094432.016135:0:106694:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094432.016160:0:106694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094432.016177:0:106694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094432.016193:0:106694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094432.016201:0:106694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094432.016236:0:106694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094432.016252:0:106694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 18 pid: 5772 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094432.016267:0:106694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106694:1870757024401280:0@lo:104: 00000100:00100000:3.0:1784094432.016372:0:106694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094432.016666:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401280 00000100:00100000:1.0:1784094432.016680:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401280 00000100:00100000:3.0:1784094432.016793:0:106694:0:(client.c:2702:ptlrpc_set_wait()) set ffff907237b79540 going to sleep for 11 seconds 00000100:00100000:1.0:1784094432.016838:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1784094432.016849:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:106694:x1870757024401280:12345-0@lo:104: 00010000:00010000:1.0:1784094432.016862:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.016947:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094432.016953:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:106694:x1870757024401280:12345-0@lo:104: Request processed in 107us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094432.016959:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784094432.017020:0:106694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106694:1870757024401280:0@lo:104: 00010000:00010000:3.0:1784094432.017036:0:106694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.017077:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094432.017085:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.017094:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094432.017098:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.017107:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094432.017115:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094432.017121:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094432.017159:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.017167:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094432.017192:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.017200:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40a00/0x9ce98053214cceb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccebe expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094432.017214:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024401408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094432.017219:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094432.017222:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094432.017224:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094432.017249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094432.017595:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401408 00000100:00100000:2.0:1784094432.017601:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401408 00010000:00010000:2.0:1784094432.017624:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 19 pid: 5772 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094432.017656:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1784094432.017665:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024401408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094432.017676:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094432.017682:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 19 pid: 5772 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018043:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 19 pid: 5772 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018057:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13c00/0x9ce98053214ccebe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cceb7 expref: 19 pid: 5772 timeout: 1743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018070:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018078:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018093:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018101:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018108:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018115:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018126:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094432.018130:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018137:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018153:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094432.018164:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094432.018178:0:106694:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094432.018192:0:106694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094432.018199:0:106694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccec5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094432.018219:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024401408:12345-0@lo:103:ldlm_bl.0 Request processed in 553us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094432.018228:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1784094432.021253:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024401408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094432.235852:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024401536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094432.235929:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094432.236349:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024401792:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094432.236414:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094432.236442:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024401664:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094432.236495:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024402048:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094432.236537:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094432.236542:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024401920:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236568:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094432.236598:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401792 00000100:00100000:2.0:1784094432.236605:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401792 00000100:00100000:2.0:1784094432.236659:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401664 00000100:00100000:2.0:1784094432.236663:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401664 00000100:00100000:2.0:1784094432.236679:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402048 00000100:00100000:2.0:1784094432.236682:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402048 00000100:00100000:2.0:1784094432.236701:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1784094432.236708:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024401792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236761:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907231086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024401792:12345-0@lo:400:kworker.0 Request processed in 52us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094432.236769:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1784094432.236787:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1784094432.236793:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024401664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236819:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024401664:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094432.236825:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1784094432.236836:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1784094432.236843:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024402048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236871:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024402048:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094432.236876:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1784094432.236894:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401920 00000100:00100000:2.0:1784094432.236897:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401920 00000100:00100000:2.0:1784094432.236922:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1784094432.236929:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024401920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.236959:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024401920:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094432.236968:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:2.0:1784094432.236984:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094432.236988:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094432.237016:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024401664:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.237026:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024401792:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.237051:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024401920:0@lo:400:kworker.0 00000100:00100000:2.0:1784094432.237060:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024402048:0@lo:400:kworker.0 00000100:00100000:0.0:1784094432.237373:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024401536 00000100:00100000:0.0:1784094432.237378:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024401536 00000100:00100000:0.0:1784094432.237444:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1784094432.237452:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024401536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094432.237480:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094432.237542:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024401536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094432.237549:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1784094432.237631:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024401536:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784094432.237719:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1784094432.539352:0:106742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec8969e60 20000000:00000080:1.0:1784094432.539368:0:106742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d53c00 uarg=0000000000000000 00010000:00010000:1.0:1784094432.539874:0:106742:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094432.539889:0:106742:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094432.539905:0:106742:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094432.539924:0:106742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539939:0:106742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539950:0:106742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539957:0:106742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539964:0:106742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539971:0:106742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539977:0:106742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094432.539982:0:106742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.539990:0:106742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.540001:0:106742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.540008:0:106742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.540086:0:106742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12c00/0x9ce98053214ccecc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094432.747708:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094433.166509:0:106791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebde7bd80 20000000:00000080:1.0:1784094433.166527:0:106791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d52800 uarg=0000000000000000 00010000:00010000:1.0:1784094433.167268:0:106791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1784094433.167284:0:106791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1784094433.167316:0:106791:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094433.167337:0:106791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167351:0:106791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167362:0:106791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167368:0:106791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167375:0:106791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167382:0:106791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167388:0:106791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094433.167392:0:106791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167400:0:106791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167412:0:106791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167613:0:106791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094433.167621:0:106791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214cced3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094433.577483:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094433.577492:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094433.577497:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094433.577543:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094433.577557:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094433.577568:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094433.577593:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024402176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094433.577661:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094433.577756:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784094433.577826:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402176 00000100:00100000:2.0:1784094433.577833:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402176 00000100:00100000:2.0:1784094433.577881:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:2.0:1784094433.577893:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024402176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094433.577907:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094433.577921:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cceda expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094433.577945:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cceda expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094433.577955:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cceda expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094433.577964:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41c00, rc 0) 00000100:00100000:2.0:1784094433.578003:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024402176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094433.578012:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1784094433.580413:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024402176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094433.580457:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094433.580470:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094433.580492:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094433.580499:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094433.580507:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094433.769743:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094434.281638:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094434.281660:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024402304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094434.281729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094434.284066:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402304 00000100:00100000:0.0:1784094434.284078:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402304 00000100:00100000:0.0:1784094434.284135:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1784094434.284143:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024402304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094434.284182:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094434.284267:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024402304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094434.284274:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1784094434.284336:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024402304:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094434.284394:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094434.794359:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094435.817761:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094436.735206:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094436.735265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094436.735311:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938688 00000100:00100000:2.0:1784094436.735330:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938688 00000100:00100000:2.0:1784094436.735396:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1113 00000100:00100000:2.0:1784094436.735407:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938688:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094436.735523:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013938688:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 117us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094436.735531:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1113 00000100:00080000:2.0:1784094436.735554:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094436.738406:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938560 00000100:00100000:3.0:1784094436.738456:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938560 00000100:00100000:3.0:1784094436.738540:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 985 00000100:00100000:3.0:1784094436.738552:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013938560:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094436.738640:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013938560:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 90us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094436.738649:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 985 00000100:00100000:1.0:1784094436.750058:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094436.750107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094436.750140:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938816 00000100:00100000:1.0:1784094436.750150:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938816 00000100:00100000:1.0:1784094436.750211:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:1.0:1784094436.750222:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013938816:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:1.0:1784094436.750265:0:6572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cc708 00000100:00080000:1.0:1784094436.750274:0:6572:0:(import.c:65:import_set_state_nolock()) ffff907102d92000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784094436.750314:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1784094436.750609:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013938816:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 388us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094436.750618:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 648 00000100:00100000:1.0:1784094436.750633:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013938944 00000100:00100000:1.0:1784094436.750637:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013938944 00000100:00100000:1.0:1784094436.750663:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 649 00000100:00100000:1.0:1784094436.750671:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013938944:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:1.0:1784094436.750686:0:6572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cc7b7 00000100:00080000:1.0:1784094436.750691:0:6572:0:(import.c:65:import_set_state_nolock()) ffff90723d246000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784094436.750710:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1784094436.750845:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d859d42d-5b91-4307-b8c2-f99991427baa+2:2351:x1870757013938944:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 175us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094436.750852:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 649 00010000:00010000:1.0:1784094436.750872:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784094436.750882:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094436.750886:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094436.751148:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094436.841855:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094437.289808:0:106986:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc442a23e0 20000000:00000080:2.0:1784094437.289838:0:106986:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3bc800 uarg=0000000000000000 00010000:00010000:2.0:1784094437.290154:0:106986:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1784094437.290728:0:106986:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1784094437.290758:0:106986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094437.290784:0:106986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094437.290806:0:106986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cceda expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094437.290816:0:106986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094437.290865:0:106986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cceda expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094437.290884:0:106986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cceda expref: 18 pid: 5771 timeout: 1748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094437.290909:0:106986:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106986:1870757024402432:0@lo:104: 00000100:00100000:2.0:1784094437.291102:0:106986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094437.291151:0:106986:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094437.419898:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402432 00000100:00100000:3.0:1784094437.419918:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402432 00000100:00100000:3.0:1784094437.420004:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1784094437.420014:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:106986:x1870757024402432:12345-0@lo:104: 00010000:00010000:3.0:1784094437.420032:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.420125:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094437.420131:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:106986:x1870757024402432:12345-0@lo:104: Request processed in 119us (129030us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094437.420139:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00010000:3.0:1784094437.420272:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094437.420278:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.420286:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094437.420527:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.420539:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094437.420548:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094437.420554:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094437.420580:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.420652:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094437.420660:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.420667:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cceda lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccee1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.420685:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094437.420687:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094437.420689:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094437.420749:0:106986:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106986:1870757024402432:0@lo:104: 00010000:00010000:3.0:1784094437.420770:0:106986:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094437.420803:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024402944:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.420843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.420885:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784094437.420891:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024402560:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.420917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.421208:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024403072:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.421250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.421280:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402560 00000100:00100000:3.0:1784094437.421285:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402560 00000100:00100000:3.0:1784094437.421517:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1784094437.421525:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024402560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.421576:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024402560:12345-0@lo:400:kworker.0 Request processed in 52us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094437.421583:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1784094437.421635:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024402560:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.421667:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024402816:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.421690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.421708:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024403328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094437.421732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.421747:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784094437.421753:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024402688:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.421775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.421788:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024403200:0@lo:400:kworker.0 00000100:00100000:3.0:1784094437.421805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094437.421829:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403072 00000100:00100000:3.0:1784094437.421832:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403072 00000100:00100000:3.0:1784094437.421870:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402816 00000100:00100000:3.0:1784094437.421873:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402816 00000100:00100000:3.0:1784094437.421891:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402688 00000100:00100000:3.0:1784094437.421894:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402688 00000100:00100000:3.0:1784094437.421907:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1784094437.421913:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024403072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422074:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1784094437.422084:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024402816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422123:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024402816:12345-0@lo:400:kworker.0 Request processed in 42us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094437.422133:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1784094437.422144:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1784094437.422150:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024402688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422173:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024402688:12345-0@lo:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094437.422179:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1784094437.422200:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024402944 00000100:00100000:0.0:1784094437.422203:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024402944 00000100:00100000:0.0:1784094437.422243:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403200 00000100:00100000:0.0:1784094437.422246:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403200 00000100:00100000:0.0:1784094437.422268:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1784094437.422274:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024402944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422318:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024402944:12345-0@lo:400:kworker.0 Request processed in 44us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094437.422324:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1784094437.422334:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1784094437.422340:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024403200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422364:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024403200:12345-0@lo:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094437.422370:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1784094437.422409:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024402688:0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422442:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024403200:0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422453:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024402816:0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422487:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024402944:0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.422517:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403328 00000100:00100000:0.0:1784094437.422520:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403328 00010000:00010000:0.0:1784094437.422539:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cceda expref: 19 pid: 5771 timeout: 1748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094437.422561:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1784094437.422566:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024403328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094437.422575:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094437.422580:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cceda expref: 19 pid: 5771 timeout: 1748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422592:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cceda expref: 19 pid: 5771 timeout: 1748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422606:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41c00/0x9ce98053214ccee1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cceda expref: 19 pid: 5771 timeout: 1748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422623:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422630:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422644:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422652:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422660:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422671:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422677:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094437.422681:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422689:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422702:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094437.422712:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094437.422736:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024403328:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094437.422744:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1784094437.422786:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024403328:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1784094437.422806:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094437.422809:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094437.422811:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094437.423245:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024403072:12345-0@lo:400:kworker.0 Request processed in 1330us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094437.423252:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00010000:00010000:3.0:1784094437.423278:0:106986:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.423288:0:106986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094437.423303:0:106986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214ccee8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094437.424099:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024403072:0@lo:400:kworker.0 00000100:00100000:0.0:1784094437.455132:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024403456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094437.455203:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094437.455272:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403456 00000100:00100000:1.0:1784094437.455281:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403456 00000100:00100000:1.0:1784094437.455340:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1784094437.455350:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024403456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094437.455388:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094437.455700:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024403456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 350us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094437.455709:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1784094437.455742:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024403456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784094437.886200:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094438.894994:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784094439.273931:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094439.273940:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094439.273946:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094439.274004:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094439.274027:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094439.274038:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094439.274065:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024403584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094439.274136:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094439.274203:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094439.274625:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403584 00000100:00100000:3.0:1784094439.274634:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403584 00000100:00100000:3.0:1784094439.274694:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1784094439.274704:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024403584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094439.274721:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094439.274734:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cceef expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094439.274755:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cceef expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094439.274766:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cceef expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094439.274776:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784094439.274821:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024403584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094439.274828:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1784094439.274870:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024403584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094439.274883:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094439.274891:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094439.274911:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094439.274916:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094439.274923:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094439.402881:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094439.402907:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024403712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094439.402980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094439.403861:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403712 00000100:00100000:0.0:1784094439.403870:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403712 00000100:00100000:0.0:1784094439.403930:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1784094439.403940:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024403712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094439.403975:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094439.404211:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024403712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 272us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094439.404220:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00080000:0.0:1784094439.404255:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094439.404296:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024403712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094439.920891:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094440.938057:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784094441.535354:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784094441.535363:0:6598:0:(genops.c:906:class_export_put()) final put ffff907102d93800/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784094441.535383:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff907102d93800/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0000 00000020:00000080:2.0:1784094441.535444:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907102d92000 for lustre-OST0000 00000001:00100000:2.0:1784094441.541257:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:2.0:1784094441.541265:0:7469:0:(genops.c:906:class_export_put()) final put ffff90723d245800/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:0.0:1784094441.541313:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff90723d245800/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-OST0001 00000020:00000080:0.0:1784094441.541350:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90723d246000 for lustre-OST0001 00000100:00100000:3.0:1784094441.852189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094441.852319:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094441.852542:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939200 00000100:00100000:1.0:1784094441.852556:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939200 00000100:00100000:1.0:1784094441.852672:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1117 00000100:00100000:1.0:1784094441.852696:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013939200:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094441.852799:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+5:2355:x1870757013939200:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 106us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094441.852808:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1117 00000100:00080000:2.0:1784094441.853579:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094441.853784:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939072 00000100:00100000:0.0:1784094441.853796:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939072 00000100:00100000:1.0:1784094441.853964:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 988 00000100:00100000:1.0:1784094441.853974:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013939072:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094441.854045:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2355:x1870757013939072:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 72us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094441.854053:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 988 00010000:00010000:3.0:1784094441.974157:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094442.476348:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094442.476371:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094442.476462:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094442.476636:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403840 00000100:00100000:3.0:1784094442.476653:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403840 00000100:00100000:3.0:1784094442.476754:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:3.0:1784094442.476767:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024403840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094442.476818:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094442.476903:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024403840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094442.476912:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00080000:2.0:1784094442.477158:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094442.477223:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094442.477240:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094442.477319:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024404096:0@lo:400:kworker.0 00000100:00100000:2.0:1784094442.477375:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094442.477401:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024404224:0@lo:400:kworker.0 00000100:00100000:2.0:1784094442.477471:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404096 00000100:00100000:2.0:1784094442.477479:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404096 00000100:00100000:3.0:1784094442.477506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094442.480023:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024404352:0@lo:400:kworker.0 00000100:00100000:0.0:1784094442.480094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094442.480149:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024403968:0@lo:400:kworker.0 00000100:00100000:0.0:1784094442.480180:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094442.481179:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024403968 00000100:00100000:1.0:1784094442.481187:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024403968 00000100:00100000:1.0:1784094442.481236:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1784094442.481245:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024403968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094442.481914:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024403968:12345-0@lo:400:kworker.0 Request processed in 56us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094442.481924:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1784094442.482063:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404352 00000100:00100000:1.0:1784094442.482069:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404352 00000100:00100000:1.0:1784094442.482110:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1784094442.482116:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024404352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094442.482172:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024404352:12345-0@lo:400:kworker.0 Request processed in 57us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094442.482179:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1784094442.482228:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103ace300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024404352:0@lo:400:kworker.0 00000100:00100000:1.0:1784094442.482240:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024403968:0@lo:400:kworker.0 00000100:00100000:1.0:1784094442.482260:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094442.482268:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024404480:0@lo:400:kworker.0 00000100:00100000:1.0:1784094442.482298:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094442.482466:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404224 00000100:00100000:2.0:1784094442.482480:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404224 00000100:00080000:2.0:1784094442.482524:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094442.482557:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094442.482695:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1784094442.482902:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1784094442.482917:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024404224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094442.482986:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024404224:12345-0@lo:400:kworker.0 Request processed in 76us (5486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094442.482994:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1784094442.483039:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024404224:0@lo:400:kworker.0 00000100:00100000:2.0:1784094442.489859:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094442.490187:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024404096:12345-0@lo:400:kworker.0 Request processed in 7480us (12810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094442.490199:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1784094442.493770:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024404096:0@lo:400:kworker.0 00000100:00100000:3.0:1784094442.509084:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404480 00000100:00100000:3.0:1784094442.509098:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404480 00000100:00100000:3.0:1784094442.509199:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1784094442.509209:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094442.509813:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024404480:0@lo:400:kworker.0 00000100:00100000:3.0:1784094442.509906:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024404480:12345-0@lo:400:kworker.0 Request processed in 697us (27606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094442.509915:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:2.0:1784094442.510136:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094442.985895:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094444.009720:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094444.522223:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024404608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094444.522315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094444.523164:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404608 00000100:00100000:3.0:1784094444.523174:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404608 00000100:00100000:3.0:1784094444.523245:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1784094444.523256:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024404608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094444.523312:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094444.523373:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024404608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094444.523382:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1784094444.523612:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024404608:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784094444.523934:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094445.033790:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094446.059920:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094446.969695:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094446.969751:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094446.969889:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939328 00000100:00100000:1.0:1784094446.969900:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939328 00000100:00100000:1.0:1784094446.969952:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 990 00000100:00100000:1.0:1784094446.969961:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013939328:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094446.970050:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013939328:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094446.970059:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 990 00000100:00100000:0.0:1784094446.970957:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939456 00000100:00100000:0.0:1784094446.970971:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939456 00000100:00100000:0.0:1784094446.971082:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1121 00000100:00100000:0.0:1784094446.971094:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013939456:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094446.971187:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d859d42d-5b91-4307-b8c2-f99991427baa+5:2353:x1870757013939456:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 96us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094446.971196:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1121 00000100:00080000:1.0:1784094446.971450:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094447.083113:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094447.593699:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094447.593730:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024404736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094447.593819:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094447.593908:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404736 00000100:00100000:2.0:1784094447.593918:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404736 00000100:00100000:2.0:1784094447.593989:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1784094447.594001:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024404736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094447.594060:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094447.594116:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024404736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094447.594125:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1784094447.594185:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024404736:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1784094447.595046:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094447.595163:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024404992:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595213:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094447.595241:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784094447.595247:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024404864:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595284:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094447.595312:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024405376:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595336:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094447.595370:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404992 00000100:00100000:2.0:1784094447.595376:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404992 00000100:00100000:2.0:1784094447.595414:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405376 00000100:00100000:2.0:1784094447.595416:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405376 00000100:00100000:2.0:1784094447.595466:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1784094447.595474:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595539:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024404992:12345-0@lo:400:kworker.0 Request processed in 65us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094447.595547:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1784094447.595561:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1784094447.595568:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024405376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595594:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024405376:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094447.595601:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1784094447.595619:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024404864 00000100:00100000:2.0:1784094447.595623:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024404864 00000100:00100000:2.0:1784094447.595648:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1784094447.595654:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595683:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024404864:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094447.595689:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1784094447.595742:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024404864:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595754:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024405376:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595763:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024404992:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595786:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024405120:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595810:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094447.595829:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094447.595834:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024405248:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094447.595886:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405120 00000100:00100000:2.0:1784094447.595890:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405120 00000100:00100000:2.0:1784094447.595915:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1784094447.595921:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.595954:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024405120:12345-0@lo:400:kworker.0 Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094447.595960:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1784094447.595978:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405248 00000100:00100000:2.0:1784094447.595982:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405248 00000100:00100000:2.0:1784094447.596012:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1784094447.596019:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024405248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.596067:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024405248:12345-0@lo:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094447.596073:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1784094447.596103:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024405248:0@lo:400:kworker.0 00000100:00100000:2.0:1784094447.596113:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024405120:0@lo:400:kworker.0 00000100:00080000:1.0:1784094447.596347:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094447.596353:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094448.106099:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784094448.297648:0:107335:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25a: test save and reload nodemap config ========================================================== 01:47:27 (1784094447) 00010000:00010000:3.0:1784094449.129743:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094449.693150:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024405504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094449.693250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094449.693344:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405504 00000100:00100000:2.0:1784094449.693364:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405504 00000100:00080000:0.0:1784094449.693413:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094449.693460:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1784094449.693470:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024405504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094449.693518:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094449.693583:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024405504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094449.693591:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1784094449.694187:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024405504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094450.153681:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094450.543782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094450.543853:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939584 00000100:00100000:3.0:1784094450.543864:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939584 00000100:00100000:3.0:1784094450.543987:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1254 00000100:00100000:3.0:1784094450.544000:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+5:65383:x1870757013939584:12345-192.168.204.57@tcp:101:lsof.0 00010000:00010000:3.0:1784094450.544024:0:8381:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094450.544049:0:8381:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccefd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf602f expref: -99 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094450.544138:0:8381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccf04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094450.544153:0:8381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccf04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094450.544167:0:8381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccf04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784094450.544375:0:8381:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784094450.544380:0:8381:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784094450.544540:0:8381:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccf04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8381 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094450.544566:0:8381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68400/0x9ce98053214ccefd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf602f expref: 7 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094450.544582:0:8381:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccf04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf602f expref: 6 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094450.544591:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce300) 00010000:00010000:3.0:1784094450.544594:0:8381:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784094450.544598:0:8381:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784094450.545981:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d859d42d-5b91-4307-b8c2-f99991427baa+6:65383:x1870757013939584:12345-192.168.204.57@tcp:101:lsof.0 Request processed in 1969us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094450.545992:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1254 00000100:00080000:0.0:1784094450.546977:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784094451.177758:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094452.084645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094452.084696:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094452.084733:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094452.084841:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939712 00000100:00100000:2.0:1784094452.084851:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939712 00000100:00100000:2.0:1784094452.084912:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939840 00000100:00100000:2.0:1784094452.084915:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939840 00000100:00100000:2.0:1784094452.084933:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013939968 00000100:00100000:2.0:1784094452.084935:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013939968 00000100:00100000:2.0:1784094452.084965:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 19 00000100:00100000:2.0:1784094452.084974:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5205dc3-a433-43a2-957d-d95a1b026cd2+12:2353:x1870757013939712:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784094452.084993:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094452.085012:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69e00/0x9ce98053214c6e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf4f88 expref: 12 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094452.085028:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094452.085075:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5205dc3-a433-43a2-957d-d95a1b026cd2+11:2353:x1870757013939712:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 102us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.085083:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 19 00000100:00100000:2.0:1784094452.085099:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 20 00000100:00100000:2.0:1784094452.085104:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5205dc3-a433-43a2-957d-d95a1b026cd2+10:2353:x1870757013939840:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784094452.085111:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094452.085119:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9072014a1e00/0x9ce98053214c6df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf4f50 expref: 10 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094452.085128:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094452.085142:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5205dc3-a433-43a2-957d-d95a1b026cd2+9:2353:x1870757013939840:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 38us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.085147:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 20 00000100:00100000:2.0:1784094452.085157:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 21 00000100:00100000:2.0:1784094452.085162:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5205dc3-a433-43a2-957d-d95a1b026cd2+8:2352:x1870757013939968:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784094452.085168:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094452.085175:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68600/0x9ce98053214c6f03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf4f9d expref: 8 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094452.085182:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094452.085194:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5205dc3-a433-43a2-957d-d95a1b026cd2+7:2352:x1870757013939968:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 33us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.085200:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 21 00000100:00100000:1.0:1784094452.090022:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094452.090107:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013940096 00000100:00100000:2.0:1784094452.090118:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013940096 00000100:00100000:2.0:1784094452.090204:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1125 00000100:00100000:2.0:1784094452.090215:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013940096:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094452.090287:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d859d42d-5b91-4307-b8c2-f99991427baa+6:2353:x1870757013940096:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.090295:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1125 00000100:00080000:1.0:1784094452.090899:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094452.107921:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094452.108035:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013940352 00000100:00100000:1.0:1784094452.108045:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013940352 00000100:00100000:1.0:1784094452.108109:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1255 00000100:00100000:1.0:1784094452.108120:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+6:2351:x1870757013940352:12345-192.168.204.57@tcp:39:umount.0 00000020:00000080:1.0:1784094452.108158:0:5809:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214c6e00 00000020:00010000:1.0:1784094452.108168:0:5809:0:(genops.c:1942:obd_stale_export_put()) Put export ffff907101e1b800: total 0 00000100:00080000:1.0:1784094452.108172:0:5809:0:(import.c:65:import_set_state_nolock()) ffff90723786b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784094452.108206:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967776 00000100:00100000:1.0:1784094452.108651:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d859d42d-5b91-4307-b8c2-f99991427baa+5:2351:x1870757013940352:12345-192.168.204.57@tcp:39:umount.0 Request processed in 532us (740us total) trans 4294967777 rc 0/0 00000100:00100000:1.0:1784094452.108660:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1255 00000020:00010000:0.0:1784094452.108902:0:5767:0:(genops.c:1928:obd_stale_export_get()) Get export ffff907101e1b800: total 0 00010000:00010000:0.0:1784094452.108956:0:5767:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907101e1b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094452.108991:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907204fce300) 00010000:00010000:0.0:1784094452.108995:0:5767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784094452.109003:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90720bb68a00/0x9ce98053214ccf04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf602f expref: 4 pid: 8381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094452.109026:0:5767:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907101e1b800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784094452.109037:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094452.109039:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094452.109041:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094452.137617:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094452.140790:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013940608 00000100:00100000:1.0:1784094452.140806:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013940608 00000100:00100000:1.0:1784094452.141005:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 992 00000100:00100000:1.0:1784094452.141016:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+7:2351:x1870757013940608:12345-192.168.204.57@tcp:251:umount.0 00000020:00000080:1.0:1784094452.141062:0:5772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214c6ddd 00000020:00010000:1.0:1784094452.141070:0:5772:0:(genops.c:1942:obd_stale_export_put()) Put export ffff907102047000: total 0 00000100:00080000:1.0:1784094452.141074:0:5772:0:(import.c:65:import_set_state_nolock()) ffff907102040000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784094452.141186:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5205dc3-a433-43a2-957d-d95a1b026cd2+3:2351:x1870757013940608:12345-192.168.204.57@tcp:251:umount.0 Request processed in 171us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094452.141195:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 992 00000020:00010000:3.0:1784094452.145468:0:7456:0:(genops.c:1928:obd_stale_export_get()) Get export ffff907102047000: total 0 00010000:00010000:3.0:1784094452.145557:0:7456:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907102047000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784094452.145596:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907202cce600/0x9ce98053214c6e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf4f8f expref: 2 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094452.145616:0:7456:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907102047000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784094452.145626:0:7456:0:(genops.c:906:class_export_put()) final put ffff907102047000/d5205dc3-a433-43a2-957d-d95a1b026cd2 00010000:00010000:3.0:1784094452.145735:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094452.145738:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094452.145740:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094452.147341:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff907102047000/d5205dc3-a433-43a2-957d-d95a1b026cd2 for MGS 00000020:00000080:0.0:1784094452.147403:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907102040000 for MGS 00010000:00010000:3.0:1784094452.201913:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094452.713661:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094452.713683:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024405632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094452.713750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094452.713808:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405632 00000100:00100000:2.0:1784094452.713816:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405632 00000100:00100000:2.0:1784094452.713870:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1784094452.713878:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024405632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094452.713914:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094452.714062:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024405632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.714070:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:2.0:1784094452.714091:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094452.714330:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024405888:0@lo:400:kworker.0 00000100:00100000:1.0:1784094452.714362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094452.714381:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094452.714386:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024406016:0@lo:400:kworker.0 00000100:00100000:1.0:1784094452.714408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094452.714991:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405888 00000100:00100000:2.0:1784094452.714999:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405888 00000100:00100000:2.0:1784094452.715034:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406016 00000100:00100000:2.0:1784094452.715037:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406016 00000100:00100000:2.0:1784094452.715061:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1784094452.715067:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024405888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715128:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024405888:12345-0@lo:400:kworker.0 Request processed in 61us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.715134:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1784094452.715145:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1784094452.715151:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024406016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715171:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024406016:12345-0@lo:400:kworker.0 Request processed in 21us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.715176:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00080000:2.0:1784094452.715194:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094452.715202:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024406144:0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094452.715245:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784094452.715250:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024405760:0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094452.715300:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024406272:0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094452.715342:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406144 00000100:00100000:2.0:1784094452.715346:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406144 00000100:00100000:2.0:1784094452.715377:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1784094452.715384:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024406144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715416:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024406144:12345-0@lo:400:kworker.0 Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.715421:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1784094452.715456:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024405760 00000100:00100000:2.0:1784094452.715460:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024405760 00000100:00100000:2.0:1784094452.715483:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1784094452.715489:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024405760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715517:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024405760:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094452.715523:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00080000:2.0:1784094452.715551:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094452.715579:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024406016:0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715589:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024405888:0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715615:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024405760:0@lo:400:kworker.0 00000100:00100000:2.0:1784094452.715623:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024406144:0@lo:400:kworker.0 00000100:00100000:3.0:1784094452.716015:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024405632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094452.716040:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406272 00000100:00100000:3.0:1784094452.716043:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406272 00000100:00100000:3.0:1784094452.716076:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784094452.716083:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024406272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094452.716123:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024406272:12345-0@lo:400:kworker.0 Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094452.716129:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:3.0:1784094452.716148:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094452.716163:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024406272:0@lo:400:kworker.0 00000004:00000400:0.0:1784094452.856038:0:107384:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1784094452.856044:0:107384:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1784094453.227191:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784094453.334906:0:5800:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d859d42d-5b91-4307-b8c2-f99991427baa 00000001:00080000:1.0:1784094453.334942:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967777 is committed 00000020:00000080:1.0:1784094453.334951:0:5800:0:(genops.c:906:class_export_put()) final put ffff907101e1b800/d859d42d-5b91-4307-b8c2-f99991427baa 00000020:00000080:0.0:1784094453.335007:0:73479:0:(genops.c:865:class_export_destroy()) destroying export ffff907101e1b800/d859d42d-5b91-4307-b8c2-f99991427baa for lustre-MDT0000 00000020:00000080:0.0:1784094453.335083:0:73479:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90723786b800 for lustre-MDT0000 00000020:00000080:1.0:1784094453.738723:0:107433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef2addbc0 20000000:00000080:1.0:1784094453.739347:0:107433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062c800 uarg=0000000000000000 10000000:01000000:1.0:1784094453.741551:0:107433:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094453.741577:0:107433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094453.741594:0:107433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cceef expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094453.741602:0:107433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094453.741640:0:107433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cceef expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094453.741658:0:107433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cceef expref: 18 pid: 5771 timeout: 1764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094453.742138:0:107433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107433:1870757024406400:0@lo:104: 00000100:00100000:1.0:1784094453.742213:0:107433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094453.742312:0:107433:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722d9816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094453.742391:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406400 00000100:00100000:3.0:1784094453.742405:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406400 00000100:00100000:3.0:1784094453.742620:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784094453.742631:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:107433:x1870757024406400:12345-0@lo:104: 00010000:00010000:3.0:1784094453.742648:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094453.742772:0:107433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107433:1870757024406400:0@lo:104: 00010000:00010000:1.0:1784094453.742791:0:107433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094453.742845:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094453.742852:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:107433:x1870757024406400:12345-0@lo:104: Request processed in 224us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094453.742860:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:2.0:1784094453.743041:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094453.743053:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743062:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094453.743066:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743074:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094453.743082:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094453.743087:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094453.743124:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743137:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784094453.743182:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024406528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094453.743219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784094453.743388:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743396:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41600/0x9ce98053214cceef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccef6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743414:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094453.743416:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094453.743418:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094453.743444:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406528 00000100:00100000:2.0:1784094453.743449:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406528 00010000:00010000:2.0:1784094453.743468:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cceef expref: 19 pid: 5771 timeout: 1764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094453.743490:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1784094453.743497:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024406528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094453.743508:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094453.743514:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cceef expref: 19 pid: 5771 timeout: 1764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743524:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cceef expref: 19 pid: 5771 timeout: 1764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743538:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccef6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cceef expref: 19 pid: 5771 timeout: 1764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743551:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743564:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743577:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743584:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743592:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743598:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743604:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094453.743609:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743616:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743629:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094453.743642:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094453.743884:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024406528:12345-0@lo:103:ldlm_bl.0 Request processed in 387us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094453.743892:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1784094453.744026:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024406528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094453.744052:0:107433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094453.744061:0:107433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094453.744067:0:107433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214ccf0b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.250095:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094454.743154:0:107481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd865e3e0 20000000:00000080:3.0:1784094454.743171:0:107481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720b845000 uarg=0000000000000000 10000000:01000000:3.0:1784094454.743407:0:107481:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094454.743444:0:107481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743459:0:107481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743470:0:107481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743476:0:107481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743482:0:107481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743488:0:107481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743494:0:107481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094454.743498:0:107481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743505:0:107481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743517:0:107481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743524:0:107481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094454.743530:0:107481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68400/0x9ce98053214ccf12 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094454.763474:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094454.763498:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024406656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094454.763569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094454.764432:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406656 00000100:00100000:3.0:1784094454.764441:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406656 00000100:00080000:0.0:1784094454.764482:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094454.764531:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1784094454.764542:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024406656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784094454.764582:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094454.764649:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024406656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094454.764658:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1784094454.764814:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024406656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094455.273538:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094455.320528:0:107529:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe16b82e20 20000000:00000080:1.0:1784094455.320545:0:107529:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062c000 uarg=0000000000000000 10000000:01000000:1.0:1784094455.320747:0:107529:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094455.320771:0:107529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320788:0:107529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320800:0:107529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320806:0:107529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320812:0:107529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320818:0:107529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320824:0:107529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094455.320828:0:107529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320836:0:107529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320846:0:107529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320852:0:107529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094455.320859:0:107529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf19 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094455.786514:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094455.786526:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094455.786532:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094455.786591:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094455.786605:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094455.786618:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094455.786662:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024406784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094455.786953:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094455.787025:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784094455.787662:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406784 00000100:00100000:3.0:1784094455.787673:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406784 00000100:00100000:3.0:1784094455.787749:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1784094455.787759:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024406784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094455.787776:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094455.787794:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccf20 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094455.787822:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094455.787834:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094455.787844:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69000, rc 0) 00000100:00100000:3.0:1784094455.788303:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024406784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 543us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094455.788311:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1784094455.788755:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024406784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094455.788781:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094455.788793:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094455.788819:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094455.788825:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094455.788834:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784094456.252780:0:107577:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe59212170 20000000:00000080:0.0:1784094456.252800:0:107577:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e231800 uarg=0000000000000000 10000000:01000000:0.0:1784094456.253051:0:107577:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094456.253073:0:107577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.253189:0:107577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.253199:0:107577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.253245:0:107577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.253260:0:107577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 18 pid: 5772 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094456.253278:0:107577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107577:1870757024406912:0@lo:104: 00000100:00100000:0.0:1784094456.253581:0:107577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094456.253738:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024406912 00000100:00100000:1.0:1784094456.253747:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024406912 00000100:00100000:1.0:1784094456.253832:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1784094456.253843:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:107577:x1870757024406912:12345-0@lo:104: 00010000:00010000:1.0:1784094456.253858:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094456.253929:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094456.253934:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:107577:x1870757024406912:12345-0@lo:104: Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094456.253942:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:3.0:1784094456.253986:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094456.253994:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254003:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094456.254007:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254016:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094456.254024:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094456.254029:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094456.254066:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254072:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094456.254106:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254113:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccf20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf27 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254131:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094456.254133:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094456.254134:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094456.254156:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024407040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094456.254186:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094456.254221:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407040 00000100:00100000:3.0:1784094456.254225:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407040 00010000:00010000:3.0:1784094456.254243:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 19 pid: 5772 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094456.254263:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1784094456.254268:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024407040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094456.254278:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094456.254282:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 19 pid: 5772 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254292:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 19 pid: 5772 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254308:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254317:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254349:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254357:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254365:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254372:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254382:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094456.254390:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254398:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254406:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094456.254418:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094456.254467:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024407040:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094456.254477:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1784094456.254860:0:107577:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134ac00 going to sleep for 11 seconds 00010000:00010000:0.0:1784094456.254893:0:107577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69000/0x9ce98053214ccf27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccf20 expref: 18 pid: 5772 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094456.254903:0:107577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107577:1870757024406912:0@lo:104: 00010000:00010000:0.0:1784094456.254923:0:107577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.254933:0:107577:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.254939:0:107577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094456.254944:0:107577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77000/0x9ce98053214ccf2e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094456.255710:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024407040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094456.314374:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094456.890063:0:107625:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3a21fd80 20000000:00000080:2.0:1784094456.890080:0:107625:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb3dc00 uarg=0000000000000000 10000000:01000000:2.0:1784094456.890586:0:107625:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094456.890609:0:107625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890625:0:107625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890635:0:107625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890643:0:107625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890651:0:107625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890726:0:107625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890734:0:107625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094456.890740:0:107625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890749:0:107625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890763:0:107625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890771:0:107625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094456.890782:0:107625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41c00/0x9ce98053214ccf35 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.321760:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094457.514960:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094457.514969:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094457.514974:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094457.515018:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.515030:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.515041:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094457.515085:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024407168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094457.515285:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094457.515462:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407168 00000100:00100000:2.0:1784094457.515470:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407168 00000100:00100000:2.0:1784094457.515522:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1784094457.515531:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024407168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094457.515544:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094457.515558:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccf3c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.515581:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.515593:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.515602:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094457.515636:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024407168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094457.515643:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1784094457.515827:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a180 going to sleep for 11 seconds 00000100:00100000:0.0:1784094457.516051:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024407168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094457.516246:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.516256:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094457.516277:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094457.516282:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.516289:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784094457.793822:0:107673:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffddce7eca0 20000000:00000080:2.0:1784094457.793852:0:107673:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90720bb3f400 uarg=0000000000000000 10000000:01000000:2.0:1784094457.794216:0:107673:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094457.794242:0:107673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.795522:0:107673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.795538:0:107673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.795590:0:107673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094457.795607:0:107673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 18 pid: 5771 timeout: 1768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094457.795622:0:107673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107673:1870757024407296:0@lo:104: 00000100:00100000:2.0:1784094457.796501:0:107673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094457.796602:0:107673:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfe000 going to sleep for 11 seconds 00000100:00100000:2.0:1784094457.806915:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784094457.807189:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407296 00000100:00100000:0.0:1784094457.807199:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407296 00000100:00100000:0.0:1784094457.807264:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784094457.807274:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230b47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:107673:x1870757024407296:12345-0@lo:104: 00010000:00010000:0.0:1784094457.807290:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.807401:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094457.807408:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230b47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:107673:x1870757024407296:12345-0@lo:104: Request processed in 136us (10910us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094457.807415:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:1.0:1784094457.807675:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094457.807683:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094457.807704:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094457.807708:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094457.807718:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094457.807726:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094457.807737:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094457.807782:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094457.807788:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094457.807806:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094457.807813:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77c00/0x9ce98053214ccf3c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf43 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094457.807831:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094457.807843:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094457.807844:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094457.808109:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024407424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094457.808155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094457.808276:0:107673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107673:1870757024407296:0@lo:104: 00010000:00010000:3.0:1784094457.808299:0:107673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094457.815503:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407424 00000100:00100000:0.0:1784094457.815518:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407424 00010000:00010000:0.0:1784094457.815567:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 19 pid: 5771 timeout: 1768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094457.815646:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1784094457.815656:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024407424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094457.815670:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094457.815676:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 19 pid: 5771 timeout: 1768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815699:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 19 pid: 5771 timeout: 1768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815717:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214ccf43 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccf3c expref: 19 pid: 5771 timeout: 1768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815734:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815743:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815761:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815769:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815776:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815783:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815789:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094457.815794:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815802:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815828:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094457.815848:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094457.818006:0:107673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094457.818023:0:107673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094457.818030:0:107673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40800/0x9ce98053214ccf4a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094457.820479:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024407424:12345-0@lo:103:ldlm_bl.0 Request processed in 4816us (12314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094457.820495:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1784094457.821509:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024407424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094457.833584:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024407552:0@lo:400:kworker.0 00000100:00100000:1.0:1784094457.833658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094457.833768:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407552 00000100:00100000:3.0:1784094457.833777:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407552 00000100:00100000:3.0:1784094457.833828:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1784094457.833849:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094457.840222:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024407552:12345-0@lo:400:kworker.0 Request processed in 6364us (6552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094457.840239:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1784094457.840502:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024407808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094457.840561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094457.840618:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407808 00000100:00100000:3.0:1784094457.840625:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407808 00000100:00100000:3.0:1784094457.840799:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1784094457.840807:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024407808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094457.840852:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094457.840959:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024407808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094457.840966:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00080000:3.0:1784094457.840982:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094457.841015:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024407808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094457.841242:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024407680:0@lo:400:kworker.0 00000100:00100000:0.0:1784094457.841276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094457.841300:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094457.841306:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024408064:0@lo:400:kworker.0 00000100:00100000:0.0:1784094457.841330:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094457.841357:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407680 00000100:00100000:0.0:1784094457.841361:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407680 00000100:00100000:0.0:1784094457.841395:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408064 00000100:00100000:0.0:1784094457.841398:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408064 00000100:00100000:0.0:1784094457.841418:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1784094457.841442:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024407680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094457.841480:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024407680:12345-0@lo:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094457.841486:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1784094457.841499:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1784094457.841505:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024408064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094457.841522:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094457.841531:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024407936:0@lo:400:kworker.0 00000100:00100000:0.0:1784094457.841533:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024408064:12345-0@lo:400:kworker.0 Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094457.841538:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00080000:0.0:1784094457.841558:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094457.841559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094457.841586:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024407936 00000100:00100000:2.0:1784094457.841590:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024407936 00000100:00100000:2.0:1784094457.841620:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1784094457.841626:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024407936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094457.841652:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024408064:0@lo:400:kworker.0 00000100:00100000:0.0:1784094457.841662:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024407680:0@lo:400:kworker.0 00000100:00100000:2.0:1784094457.841669:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024407936:12345-0@lo:400:kworker.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094457.841675:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00080000:2.0:1784094457.841798:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094457.841816:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024407936:0@lo:400:kworker.0 00000100:00100000:1.0:1784094457.844548:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024407552:0@lo:400:kworker.0 00010000:00010000:3.0:1784094458.346404:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094459.113859:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094459.113866:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094459.113871:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094459.113913:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094459.113931:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094459.113942:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094459.113967:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024408192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094459.114030:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094459.114083:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209368c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784094459.114357:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408192 00000100:00100000:1.0:1784094459.114364:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408192 00000100:00100000:1.0:1784094459.114435:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1784094459.114444:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024408192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094459.114457:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094459.114470:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccf51 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094459.114506:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094459.114518:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094459.114527:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094459.114569:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024408192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094459.114576:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1784094459.114918:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024408192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094459.114935:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094459.114944:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094459.114962:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094459.114967:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094459.114973:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094459.370075:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094459.885788:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024408320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094459.885867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094459.886711:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408320 00000100:00100000:0.0:1784094459.886721:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408320 00000100:00100000:0.0:1784094459.886781:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1784094459.886791:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024408320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094459.886843:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094459.886899:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024408320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094459.886906:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00080000:3.0:1784094459.887111:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094459.887153:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024408320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784094460.437828:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094461.152825:0:107822:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff453db680 20000000:00000080:0.0:1784094461.152853:0:107822:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101bbe800 uarg=0000000000000000 10000000:01000000:0.0:1784094461.153559:0:107822:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094461.153587:0:107822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094461.153609:0:107822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094461.153697:0:107822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094461.153758:0:107822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094461.153788:0:107822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 18 pid: 5772 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094461.153815:0:107822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107822:1870757024408448:0@lo:104: 00000100:00100000:0.0:1784094461.153910:0:107822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094461.154062:0:107822:0:(client.c:2702:ptlrpc_set_wait()) set ffff907209d28840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094461.154566:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408448 00000100:00100000:1.0:1784094461.154577:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408448 00000100:00100000:1.0:1784094461.154642:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1784094461.154654:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:107822:x1870757024408448:12345-0@lo:104: 00010000:00010000:1.0:1784094461.154673:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094461.154781:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094461.154789:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:107822:x1870757024408448:12345-0@lo:104: Request processed in 137us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094461.154796:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1784094461.154825:0:107822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d706a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107822:1870757024408448:0@lo:104: 00010000:00010000:0.0:1784094461.154850:0:107822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.154868:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094461.154878:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.154886:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094461.154891:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.154901:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094461.154908:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094461.154913:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094461.154956:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.154963:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094461.154997:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.155004:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccf51 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf58 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.155022:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094461.155025:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094461.155026:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094461.155065:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094461.155079:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024408576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094461.155121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094461.155229:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408576 00000100:00100000:2.0:1784094461.155235:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408576 00010000:00010000:2.0:1784094461.155258:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 19 pid: 5772 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094461.155536:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1784094461.155545:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024408576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094461.155558:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094461.155564:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 19 pid: 5772 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.155576:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 19 pid: 5772 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.155592:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13a00/0x9ce98053214ccf58 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccf51 expref: 19 pid: 5772 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.155608:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094461.155627:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155683:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155692:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155700:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155707:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155713:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094461.155718:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155731:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155754:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.155765:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094461.155825:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024408576:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094461.155833:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1784094461.155859:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024408576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094461.155914:0:107822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094461.155924:0:107822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094461.155930:0:107822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76c00/0x9ce98053214ccf5f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094461.509819:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094462.410186:0:107870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb9b77dc0 20000000:00000080:1.0:1784094462.410204:0:107870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062c000 uarg=0000000000000000 10000000:01000000:1.0:1784094462.410584:0:107870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094462.410604:0:107870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410621:0:107870:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410632:0:107870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410639:0:107870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410647:0:107870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410654:0:107870:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410661:0:107870:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094462.410666:0:107870:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410675:0:107870:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410688:0:107870:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410696:0:107870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.410703:0:107870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12200/0x9ce98053214ccf66 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094462.507633:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784094462.890331:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094462.890342:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094462.890349:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094462.890406:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.890418:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094462.890472:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094462.890520:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024408704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094462.890617:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094462.890665:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720683d840 going to sleep for 11 seconds 00000100:00100000:2.0:1784094462.890895:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408704 00000100:00100000:2.0:1784094462.890905:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408704 00000100:00100000:2.0:1784094462.890958:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1784094462.890966:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024408704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094462.890978:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094462.890990:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccf6d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094462.891007:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094462.891015:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094462.891022:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40600, rc 0) 00000100:00100000:2.0:1784094462.891054:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024408704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094462.891058:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1784094462.891995:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024408704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094462.892015:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094462.892025:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094462.892046:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094462.892052:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094462.892059:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094462.955069:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094462.955091:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024408832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094462.955167:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094462.955526:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024409216:0@lo:400:kworker.0 00000100:00100000:2.0:1784094462.955571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094462.955591:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094462.955596:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024409344:0@lo:400:kworker.0 00000100:00100000:2.0:1784094462.955619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094462.955777:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409344 00000100:00100000:2.0:1784094462.955787:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409344 00000100:00100000:2.0:1784094462.955847:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1784094462.955856:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024409344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094462.955913:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024409344:12345-0@lo:400:kworker.0 Request processed in 58us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094462.955921:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1784094462.955962:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024409344:0@lo:400:kworker.0 00000100:00100000:0.0:1784094462.956030:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024408960:0@lo:400:kworker.0 00000100:00100000:0.0:1784094462.956066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094462.956100:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024409472:0@lo:400:kworker.0 00000100:00100000:0.0:1784094462.956124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094462.956160:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094462.956166:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024409088:0@lo:400:kworker.0 00000100:00100000:0.0:1784094462.956189:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094462.956478:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409216 00000100:00100000:0.0:1784094462.956484:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409216 00000100:00100000:0.0:1784094462.956516:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409472 00000100:00100000:0.0:1784094462.956519:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409472 00000100:00100000:0.0:1784094462.956538:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409088 00000100:00100000:0.0:1784094462.956541:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409088 00000100:00100000:3.0:1784094462.956672:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408832 00000100:00100000:3.0:1784094462.956676:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408832 00000100:00100000:3.0:1784094462.956712:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1784094462.956720:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024408832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094462.956767:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094462.956814:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024408832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094462.956820:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1784094462.956845:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1784094462.956853:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024409216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094462.956889:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024409216:12345-0@lo:400:kworker.0 Request processed in 36us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094462.956895:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1784094462.956908:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1784094462.956914:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024409472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094462.956947:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024409472:12345-0@lo:400:kworker.0 Request processed in 33us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094462.956953:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00080000:3.0:1784094462.956969:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094462.956973:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784094462.956975:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094462.957002:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024409472:0@lo:400:kworker.0 00000100:00100000:3.0:1784094462.957027:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024409216:0@lo:400:kworker.0 00000100:00100000:3.0:1784094462.957042:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024408832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094462.957185:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1784094462.957191:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024409088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094462.957310:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024408960 00000100:00100000:0.0:1784094462.957860:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024409088:12345-0@lo:400:kworker.0 Request processed in 667us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094462.957868:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1784094462.958138:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024408960 00000100:00100000:2.0:1784094462.958175:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1784094462.958182:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024408960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094462.958384:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024409088:0@lo:400:kworker.0 00000100:00100000:3.0:1784094462.959176:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024408960:12345-0@lo:400:kworker.0 Request processed in 992us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094462.959185:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1784094462.959387:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024408960:0@lo:400:kworker.0 00010000:00010000:2.0:1784094463.529864:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094464.571016:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094465.003031:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094465.003065:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024409600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094465.003387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094465.005392:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409600 00000100:00100000:1.0:1784094465.005503:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409600 00000100:00100000:1.0:1784094465.005879:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1784094465.005894:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024409600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094465.005947:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094465.006055:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024409600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094465.006065:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1784094465.006143:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024409600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094465.007783:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784094465.578419:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094466.134159:0:108069:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda43fcb80 20000000:00000080:1.0:1784094466.134178:0:108069:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90721062d400 uarg=0000000000000000 10000000:01000000:1.0:1784094466.135843:0:108069:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094466.135867:0:108069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094466.135883:0:108069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094466.135892:0:108069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094466.135933:0:108069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094466.135949:0:108069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 18 pid: 5770 timeout: 1777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094466.135962:0:108069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108069:1870757024409728:0@lo:104: 00000100:00100000:1.0:1784094466.136283:0:108069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094466.136382:0:108069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071019cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1784094466.136643:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409728 00000100:00100000:2.0:1784094466.136651:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409728 00000100:00100000:0.0:1784094466.136873:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1784094466.136884:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:108069:x1870757024409728:12345-0@lo:104: 00010000:00010000:0.0:1784094466.136900:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094466.137031:0:108069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108069:1870757024409728:0@lo:104: 00010000:00010000:2.0:1784094466.137052:0:108069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094466.137188:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094466.137198:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:108069:x1870757024409728:12345-0@lo:104: Request processed in 315us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094466.137206:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:3.0:1784094466.142724:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094466.142804:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.142817:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094466.142820:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.142830:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094466.142842:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094466.142847:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094466.142913:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.142920:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094466.142944:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.142951:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13800/0x9ce98053214ccf6d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf74 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.142972:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094466.142974:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094466.142976:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094466.142999:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024409856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094466.143135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094466.143599:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409856 00000100:00100000:3.0:1784094466.143607:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409856 00010000:00010000:3.0:1784094466.143640:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 19 pid: 5770 timeout: 1777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094466.143673:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1784094466.143851:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024409856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094466.143869:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094466.143875:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 19 pid: 5770 timeout: 1777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143887:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 19 pid: 5770 timeout: 1777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143902:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214ccf74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccf6d expref: 19 pid: 5770 timeout: 1777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143917:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143925:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143941:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143947:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143954:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143961:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143967:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094466.143970:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.143979:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.144007:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094466.144084:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094466.144133:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024409856:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094466.144141:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00010000:2.0:1784094466.144203:0:108069:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094466.144212:0:108069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094466.144219:0:108069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12a00/0x9ce98053214ccf7b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094466.155839:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024409856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094466.603975:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094467.503389:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094467.503398:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094467.503404:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094467.503474:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094467.503487:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094467.503500:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094467.503530:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024409984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094467.503599:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094467.503666:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220dfa000 going to sleep for 11 seconds 00000100:00100000:1.0:1784094467.504452:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024409984 00000100:00100000:1.0:1784094467.504463:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024409984 00000100:00100000:1.0:1784094467.504599:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1784094467.504610:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024409984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094467.504626:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094467.504643:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccf82 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094467.504744:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094467.504757:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094467.504767:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13c00, rc 0) 00000100:00100000:1.0:1784094467.504824:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024409984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094467.504832:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1784094467.504921:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024409984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094467.504941:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094467.504951:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094467.504977:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094467.504982:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094467.504990:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094467.626830:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094468.074925:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024410368:0@lo:400:kworker.0 00000100:00100000:0.0:1784094468.075003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094468.075068:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784094468.075075:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024410240:0@lo:400:kworker.0 00000100:00100000:0.0:1784094468.075098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094468.075115:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024410752:0@lo:400:kworker.0 00000100:00100000:0.0:1784094468.075143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094468.075179:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410368 00000100:00100000:0.0:1784094468.075187:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410368 00000100:00100000:0.0:1784094468.075241:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410240 00000100:00100000:0.0:1784094468.075244:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410240 00000100:00100000:0.0:1784094468.075264:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784094468.075274:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024410368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094468.075327:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024410368:12345-0@lo:400:kworker.0 Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094468.075348:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784094468.075366:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1784094468.075372:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094468.075399:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024410240:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094468.075406:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:0.0:1784094468.075970:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094468.076014:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024410240:0@lo:400:kworker.0 00000100:00100000:0.0:1784094468.076028:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024410368:0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.076273:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024410496:0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.076316:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094468.076358:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784094468.076364:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024410112:0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.076390:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094468.076415:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024410624:0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.076843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094468.076879:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410752 00000100:00100000:2.0:1784094468.076885:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410752 00000100:00100000:2.0:1784094468.076929:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410496 00000100:00100000:2.0:1784094468.076933:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410496 00000100:00100000:2.0:1784094468.076955:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1784094468.076963:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024410752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.077012:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024410752:12345-0@lo:400:kworker.0 Request processed in 50us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094468.077018:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1784094468.077032:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:2.0:1784094468.077038:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.077070:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024410496:12345-0@lo:400:kworker.0 Request processed in 32us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094468.077076:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:2.0:1784094468.077096:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410112 00000100:00100000:2.0:1784094468.077099:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410112 00000100:00100000:2.0:1784094468.077121:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1784094468.077127:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024410112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.077157:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024410112:12345-0@lo:400:kworker.0 Request processed in 29us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094468.077163:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1784094468.077190:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410624 00000100:00100000:2.0:1784094468.077193:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410624 00000100:00100000:2.0:1784094468.077221:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1784094468.077227:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024410624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.077257:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024410624:12345-0@lo:400:kworker.0 Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094468.077264:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1784094468.077298:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024410112:0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.077310:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024410624:0@lo:400:kworker.0 00000100:00100000:2.0:1784094468.077318:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024410496:0@lo:400:kworker.0 00000100:00080000:2.0:1784094468.077353:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094468.077357:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094468.077360:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094468.077380:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024410752:0@lo:400:kworker.0 00000100:00100000:3.0:1784094468.080650:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024410880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094468.081438:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094468.082468:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024410880 00000100:00100000:2.0:1784094468.082490:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024410880 00000100:00100000:2.0:1784094468.082544:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1784094468.082554:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024410880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094468.082592:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094468.082664:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024410880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094468.082672:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1784094468.082739:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024410880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784094468.653075:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094469.673811:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094470.133941:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094470.133964:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024411008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094470.134036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094470.134887:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411008 00000100:00100000:1.0:1784094470.134899:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411008 00000100:00100000:1.0:1784094470.134974:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1784094470.134985:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024411008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094470.135024:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094470.135079:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024411008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094470.135088:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00080000:2.0:1784094470.135138:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094470.135206:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024411008:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1784094470.496810:0:108266:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa824eb50 20000000:00000080:3.0:1784094470.496829:0:108266:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d6bc00 uarg=0000000000000000 10000000:01000000:3.0:1784094470.497297:0:108266:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094470.497318:0:108266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.497337:0:108266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.497345:0:108266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.497382:0:108266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.497397:0:108266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 18 pid: 5772 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094470.497416:0:108266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108266:1870757024411136:0@lo:104: 00000100:00100000:3.0:1784094470.497511:0:108266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094470.497562:0:108266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071019cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094470.497659:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411136 00000100:00100000:1.0:1784094470.497667:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411136 00000100:00100000:1.0:1784094470.497724:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1784094470.497735:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:108266:x1870757024411136:12345-0@lo:104: 00010000:00010000:1.0:1784094470.497747:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094470.497805:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094470.497811:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:108266:x1870757024411136:12345-0@lo:104: Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094470.497818:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:1.0:1784094470.497836:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094470.497841:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094470.497848:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094470.497852:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094470.497860:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094470.497867:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094470.497873:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784094470.497901:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094470.497908:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094470.497934:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094470.497942:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69600/0x9ce98053214ccf82 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccf89 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094470.497955:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094470.497957:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094470.497959:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094470.497974:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094470.497984:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024411264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094470.498014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094470.498048:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411264 00000100:00100000:0.0:1784094470.498052:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411264 00010000:00010000:0.0:1784094470.498085:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 19 pid: 5772 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094470.498116:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784094470.498123:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024411264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094470.498134:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094470.498139:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 19 pid: 5772 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498149:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 19 pid: 5772 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498164:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498172:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498189:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498196:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498203:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498209:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498215:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094470.498219:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498226:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498234:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.498243:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094470.498273:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024411264:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094470.498280:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1784094470.498455:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024411264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094470.499828:0:108266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13c00/0x9ce98053214ccf89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccf82 expref: 18 pid: 5772 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094470.499845:0:108266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108266:1870757024411136:0@lo:104: 00010000:00010000:3.0:1784094470.499865:0:108266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.499874:0:108266:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.499881:0:108266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094470.499887:0:108266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68800/0x9ce98053214ccf90 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094470.698715:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094471.631119:0:108314:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe385f1d00 20000000:00000080:0.0:1784094471.631137:0:108314:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e232000 uarg=0000000000000000 10000000:01000000:0.0:1784094471.631362:0:108314:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094471.631385:0:108314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631404:0:108314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631416:0:108314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631454:0:108314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631462:0:108314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631469:0:108314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631475:0:108314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094471.631479:0:108314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631486:0:108314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631499:0:108314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631507:0:108314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.631514:0:108314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76e00/0x9ce98053214ccf97 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094471.724585:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784094472.041558:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094472.041581:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094472.041585:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094472.041638:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094472.041650:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094472.041662:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094472.041692:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024411392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094472.041773:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094472.041846:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720683da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784094472.042011:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411392 00000100:00100000:0.0:1784094472.042019:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411392 00000100:00100000:0.0:1784094472.042079:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1784094472.042090:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024411392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094472.042105:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094472.042120:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccf9e expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094472.042144:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094472.042155:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094472.042165:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094472.042226:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024411392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094472.042233:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1784094472.042308:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723ca62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024411392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094472.042324:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094472.042334:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094472.042354:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784094472.042359:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094472.042367:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094472.763667:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094473.194405:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094473.194452:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024411520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094473.194627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094473.194696:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024412032:0@lo:400:kworker.0 00000100:00100000:1.0:1784094473.194734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094473.194753:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024411648:0@lo:400:kworker.0 00000100:00100000:1.0:1784094473.194775:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024411776:0@lo:400:kworker.0 00000100:00100000:1.0:1784094473.194805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094473.194824:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024412288:0@lo:400:kworker.0 00000100:00100000:1.0:1784094473.194843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094473.194860:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094473.194864:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024411904:0@lo:400:kworker.0 00000100:00100000:1.0:1784094473.194882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094473.194909:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412032 00000100:00100000:1.0:1784094473.194917:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412032 00000100:00100000:1.0:1784094473.194968:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412288 00000100:00100000:1.0:1784094473.194972:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412288 00000100:00100000:0.0:1784094473.194988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094473.195003:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1784094473.195013:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024412032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094473.195026:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024412160:0@lo:400:kworker.0 00000100:00100000:3.0:1784094473.195036:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411520 00000100:00100000:3.0:1784094473.195042:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411520 00000100:00100000:0.0:1784094473.195067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094473.195074:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1784094473.195074:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024412032:12345-0@lo:400:kworker.0 Request processed in 61us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094473.195082:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1784094473.195083:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024411520:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094473.195101:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1784094473.195108:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024412288:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1784094473.195111:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094473.195125:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411776 00000100:00100000:0.0:1784094473.195130:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411776 00000100:00100000:1.0:1784094473.195141:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1870757024412288:12345-0@lo:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094473.195149:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1784094473.195150:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1870757024411520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094473.195156:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1784094473.195168:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411904 00000100:00100000:1.0:1784094473.195173:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412160 00000100:00100000:0.0:1784094473.195173:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411904 00000100:00100000:1.0:1784094473.195179:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412160 00000100:00100000:0.0:1784094473.195212:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1784094473.195219:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:0.0:1784094473.195224:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024411776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094473.195226:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784094473.195229:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024411904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094473.195235:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024412160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094473.195269:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024411904:12345-0@lo:400:kworker.0 Request processed in 43us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094473.195275:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00080000:1.0:1784094473.195293:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094473.195297:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094473.195299:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094473.195314:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024411648 00000100:00100000:1.0:1784094473.195317:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024411648 00000100:00100000:1.0:1784094473.195340:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1784094473.195345:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024411648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094473.201003:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024412032:0@lo:400:kworker.0 00000100:00100000:2.0:1784094473.201058:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024411904:0@lo:400:kworker.0 00000100:00100000:2.0:1784094473.201073:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024411776:0@lo:400:kworker.0 00000100:00100000:2.0:1784094473.201090:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024412288:0@lo:400:kworker.0 00000100:00100000:3.0:1784094473.201191:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024412160:12345-0@lo:400:kworker.0 Request processed in 5953us (6122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094473.201203:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1784094473.202965:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024411776:12345-0@lo:400:kworker.0 Request processed in 7740us (8153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094473.202978:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1784094473.203082:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024412160:0@lo:400:kworker.0 00000100:00100000:2.0:1784094473.203106:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024411520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094473.206871:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024411648:12345-0@lo:400:kworker.0 Request processed in 11147us (11506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094473.206885:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1784094473.219734:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024411648:0@lo:400:kworker.0 00010000:00010000:0.0:1784094473.772598:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094474.795175:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094475.241638:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024412416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094475.241713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094475.241811:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412416 00000100:00100000:0.0:1784094475.241819:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412416 00000100:00100000:0.0:1784094475.241881:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1784094475.241891:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024412416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094475.241926:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784094475.242048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094475.242172:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024412416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 282us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094475.242180:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1784094475.242515:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024412416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094475.817649:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094475.971385:0:108512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca32ebe40 20000000:00000080:3.0:1784094475.971404:0:108512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907210d68400 uarg=0000000000000000 10000000:01000000:3.0:1784094475.972046:0:108512:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094475.973124:0:108512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.973149:0:108512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.973158:0:108512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.973209:0:108512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.973226:0:108512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 18 pid: 5770 timeout: 1787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094475.973241:0:108512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108512:1870757024412544:0@lo:104: 00000100:00100000:3.0:1784094475.973312:0:108512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094475.973528:0:108512:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1784094475.977878:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412544 00000100:00100000:0.0:1784094475.977896:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412544 00000100:00100000:0.0:1784094475.979733:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1784094475.979758:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:108512:x1870757024412544:12345-0@lo:104: 00010000:00010000:0.0:1784094475.979782:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094475.979979:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094475.979987:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:108512:x1870757024412544:12345-0@lo:104: Request processed in 242us (6675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094475.979995:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:2.0:1784094475.982754:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094475.982768:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.982781:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094475.982786:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.982797:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094475.982805:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094475.982811:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094475.982866:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.982872:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094475.982908:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.982916:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df13400/0x9ce98053214ccf9e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfa5 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.982945:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094475.982946:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094475.982948:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094475.982971:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024412672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094475.983035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094475.983104:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412672 00000100:00100000:2.0:1784094475.983110:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412672 00010000:00010000:2.0:1784094475.983141:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 19 pid: 5770 timeout: 1787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094475.983168:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784094475.983176:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024412672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094475.983188:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094475.983193:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 19 pid: 5770 timeout: 1787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983204:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 19 pid: 5770 timeout: 1787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983221:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983230:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983244:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983252:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983259:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983266:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983271:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094475.983275:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983283:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983291:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094475.983299:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094475.983332:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024412672:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094475.983339:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1784094475.983377:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024412672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094475.983636:0:108512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214ccfa5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccf9e expref: 18 pid: 5770 timeout: 1787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094475.983648:0:108512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108512:1870757024412544:0@lo:104: 00010000:00010000:3.0:1784094475.983661:0:108512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.983670:0:108512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.983677:0:108512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094475.983683:0:108512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68800/0x9ce98053214ccfac lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094476.843564:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094477.054107:0:108560:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea71d3170 20000000:00000080:0.0:1784094477.054128:0:108560:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9071019dd800 uarg=0000000000000000 20000000:01000000:0.0:1784094477.054163:0:108560:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='nodemap..fileset=/c0dir' 20000000:01000000:0.0:1784094477.054170:0:108560:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'nodemap..fileset=/c0dir' 20000000:01000000:0.0:1784094477.054175:0:108560:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/nodemap..fileset=/c0dir del=0 00000040:00080000:2.0:1784094477.055389:0:108561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1784094477.055877:0:108560:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.nodemap..fileset=/c0dir in log params 00000040:00080000:1.0:1784094477.063565:0:108560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1784094477.063617:0:108560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 112 off9648 00000040:00080000:1.0:1784094477.063780:0:108560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9872 10000000:01000000:1.0:1784094477.063800:0:108560:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784094477.063820:0:108560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.063837:0:108560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 17 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.063845:0:108560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.063853:0:108560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 17 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.063860:0:108560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.063901:0:108560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 17 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.063918:0:108560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 17 pid: 5770 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094477.063932:0:108560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108560:1870757024412800:0@lo:104: 00000100:00100000:1.0:1784094477.064100:0:108560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094477.064182:0:108560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.064190:0:108560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094477.064201:0:108560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108560:1870757024412928:0@lo:104: 00000100:00100000:1.0:1784094477.064223:0:108560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094477.064249:0:108560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 17 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.064257:0:108560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 17 pid: 5772 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094477.064265:0:108560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108560:1870757024413056:0@lo:104: 00000100:00100000:0.0:1784094477.064456:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412800 00000100:00100000:0.0:1784094477.064463:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412800 00000100:00100000:0.0:1784094477.064526:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024412928 00000100:00100000:0.0:1784094477.064530:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024412928 00000100:00100000:0.0:1784094477.064544:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784094477.064552:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+4:108560:x1870757024412800:12345-0@lo:104: 00010000:00010000:0.0:1784094477.064566:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064619:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094477.064624:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+4:108560:x1870757024412800:12345-0@lo:104: Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094477.064647:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1784094477.064665:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1784094477.064671:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:108560:x1870757024412928:12345-0@lo:104: 00010000:00010000:0.0:1784094477.064679:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064711:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784094477.064716:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:108560:x1870757024412928:12345-0@lo:104: Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094477.064721:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:0.0:1784094477.064743:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784094477.064748:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064755:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094477.064759:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064768:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094477.064775:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094477.064780:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784094477.064809:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064815:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094477.064834:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064840:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69a00/0x9ce98053214c6ef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6efc expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064853:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094477.064856:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064862:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9072421ddc00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094477.064865:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064871:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094477.064877:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094477.064882:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784094477.064893:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064898:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094477.064911:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064917:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff9072421ddc00/0x9ce98053214c6ee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6eee expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.064929:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094477.064930:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094477.064932:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094477.065227:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094477.065239:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024413184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094477.065272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094477.065319:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413184 00000100:00100000:2.0:1784094477.065323:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413184 00010000:00010000:2.0:1784094477.065341:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 18 pid: 5770 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094477.065364:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784094477.065370:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024413184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094477.065380:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094477.065384:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 18 pid: 5770 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094477.065392:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 18 pid: 5770 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094477.065408:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094477.065446:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024413184:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094477.065452:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1784094477.065497:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024413184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094477.065801:0:108560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094477.065832:0:108560:0:(client.c:2702:ptlrpc_set_wait()) set ffff907230d07000 going to sleep for 11 seconds 00010000:00010000:1.0:1784094477.065847:0:108560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907242052000/0x9ce98053214c6efc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c6ef5 expref: 17 pid: 5770 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094477.065858:0:108560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d4d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108560:1870757024412800:0@lo:104: 00000100:00100000:1.0:1784094477.065867:0:108560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108560:1870757024412928:0@lo:104: 00000100:00100000:3.0:1784094477.066058:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784094477.066073:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413056 00000100:00100000:3.0:1784094477.066079:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413056 00000100:00100000:3.0:1784094477.066109:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784094477.066117:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720bb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:108560:x1870757024413056:12345-0@lo:104: 00010000:00010000:3.0:1784094477.066127:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.066321:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094477.066342:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094477.066354:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024413312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094477.066389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094477.066448:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413312 00000100:00100000:0.0:1784094477.066452:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413312 00010000:00010000:0.0:1784094477.066481:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094477.066503:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1784094477.066510:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+17:3304:x1870757024413312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094477.066518:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094477.066524:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.066533:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.066546:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907202ccf600/0x9ce98053214c6eee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c6ee7 expref: 17 pid: 5771 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.066557:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094477.066584:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+16:3304:x1870757024413312:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094477.066590:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1784094477.066616:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024413312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094477.066719:0:108560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108560:1870757024413056:0@lo:104: 00010000:00010000:1.0:1784094477.066743:0:108560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.071123:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094477.071143:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720bb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:108560:x1870757024413056:12345-0@lo:104: Request processed in 5022us (5335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.071155:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:0.0:1784094477.071296:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094477.071305:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.071320:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907202ccfe00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094477.071325:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.071335:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094477.071342:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094477.071348:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784094477.071397:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.071403:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094477.071450:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.071458:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907202ccfe00/0x9ce98053214c6ed9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214c6ee0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.071485:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094477.071487:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094477.071489:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094477.071497:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094477.071512:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024413440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094477.071573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.071846:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413440 00000100:00100000:3.0:1784094477.071854:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413440 00010000:00010000:3.0:1784094477.071883:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 16 pid: 5772 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094477.071916:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1784094477.071924:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+16:3303:x1870757024413440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094477.071937:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094477.072035:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 16 pid: 5772 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072048:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 16 pid: 5772 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072063:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907242052800/0x9ce98053214c6ee0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214c6ed9 expref: 16 pid: 5772 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072077:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072085:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072101:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072108:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072115:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072121:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072126:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094477.072130:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072138:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072158:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.072167:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094477.072203:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+15:3303:x1870757024413440:12345-0@lo:103:ldlm_bl.0 Request processed in 280us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.072209:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1784094477.072237:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024413440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094477.072296:0:108560:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.072304:0:108560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094477.072309:0:108560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214ccfb3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094477.270375:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784094477.270382:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff907237a1c800 from 7 10000000:01000000:3.0:1784094477.270386:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784094477.271573:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.271590:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.271605:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094477.271634:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024413568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.271707:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.271799:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486600 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.272089:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413568 00000100:00100000:3.0:1784094477.272099:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413568 00000100:00100000:3.0:1784094477.272157:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1784094477.272168:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+15:5775:x1870757024413568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094477.272188:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094477.272206:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccfba expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.272231:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccfba expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.272242:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfba expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.272252:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68400, rc 0) 00000100:00100000:3.0:1784094477.272294:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024413568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.272301:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1784094477.272452:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024413568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094477.272481:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.272492:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094477.272546:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024413696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.272572:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.272588:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486600 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.272601:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413696 00000100:00100000:3.0:1784094477.272605:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413696 00000100:00100000:3.0:1784094477.272629:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1784094477.272635:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024413696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.272866:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024413696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.272873:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1784094477.272903:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024413696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.272929:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024413824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.272964:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.272977:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486600 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.272987:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413824 00000100:00100000:3.0:1784094477.272991:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413824 00000100:00100000:3.0:1784094477.273010:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1784094477.273016:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024413824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.273151:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024413824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.273157:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1784094477.273191:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024413824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.273349:0:108573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108573:1870757024413952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.273381:0:108573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.273398:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024413952 00000100:00100000:3.0:1784094477.273402:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024413952 00000100:00100000:3.0:1784094477.273439:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1784094477.273445:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:108573:x1870757024413952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.273574:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:108573:x1870757024413952:12345-0@lo:502:llog_process_th.0 Request processed in 129us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.273582:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1784094477.273610:0:108573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.273622:0:108573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108573:1870757024413952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784094477.273642:0:108573:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784094477.273651:0:108573:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784094477.273653:0:108573:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:3.0:1784094477.273659:0:108573:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff907237a1c800 00000020:00000080:3.0:1784094477.273662:0:108573:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:00020000:3.0:1784094477.288107:0:108573:0:(obd_config.c:1430:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 14431us 00000100:00100000:3.0:1784094477.320299:0:108573:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108573:1870757024414080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.320392:0:108573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.320457:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414080 00000100:00100000:3.0:1784094477.320477:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414080 00000100:00100000:3.0:1784094477.320528:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1784094477.320538:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:108573:x1870757024414080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.320763:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+16:108573:x1870757024414080:12345-0@lo:502:llog_process_th.0 Request processed in 224us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.320771:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1784094477.320830:0:108573:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.320853:0:108573:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108573:1870757024414080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784094477.320883:0:108573:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784094477.320890:0:108573:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784094477.320892:0:108573:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:3.0:1784094477.320896:0:108573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784094477.320956:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784094477.320971:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784094477.320981:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.320992:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094477.321003:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094477.321005:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094477.321008:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094477.321039:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321047:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321056:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094477.321075:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.321102:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.321117:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.321130:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414208 00000100:00100000:3.0:1784094477.321133:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414208 00000100:00100000:3.0:1784094477.321155:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1784094477.321162:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024414208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094477.321187:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094477.321201:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccfc8 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321220:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321230:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321237:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb69c00, rc 0) 00000100:00100000:3.0:1784094477.321266:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024414208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.321272:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1784094477.321299:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094477.321310:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321319:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094477.321334:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094477.321338:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321345:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094477.321351:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784094477.321353:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff90720a9c7800 from 7 10000000:01000000:3.0:1784094477.321355:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784094477.321368:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321374:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321382:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094477.321394:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.321419:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.321458:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.321481:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414336 00000100:00100000:3.0:1784094477.321484:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414336 00000100:00100000:3.0:1784094477.321505:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1784094477.321511:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024414336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094477.321517:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094477.321525:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccfd6 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321537:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321546:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321552:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68600, rc 0) 00000100:00100000:3.0:1784094477.321579:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024414336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.321585:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1784094477.321615:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094477.321625:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.321633:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094477.321670:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.321693:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.321705:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.321715:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414464 00000100:00100000:3.0:1784094477.321718:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414464 00000100:00100000:3.0:1784094477.321737:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1784094477.321743:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024414464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.321945:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024414464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.321951:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1784094477.321977:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.322000:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.322035:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.322047:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486780 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.322057:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414592 00000100:00100000:3.0:1784094477.322060:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414592 00000100:00100000:3.0:1784094477.322080:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1784094477.322086:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024414592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.322202:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024414592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.322208:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1784094477.322243:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784094477.333351:0:108576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108576:1870757024414720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784094477.333460:0:108576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094477.333517:0:108576:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a240 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.333589:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414720 00000100:00100000:3.0:1784094477.333597:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414720 00000100:00100000:3.0:1784094477.333648:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1784094477.333658:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:108576:x1870757024414720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.333873:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:108576:x1870757024414720:12345-0@lo:502:llog_process_th.0 Request processed in 216us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.333882:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1784094477.336331:0:108576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108576:1870757024414720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784094477.336393:0:108576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784094477.336404:0:108576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784094477.336406:0:108576:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:0.0:1784094477.336413:0:108576:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff90720a9c7800 00000020:00000080:0.0:1784094477.336416:0:108576:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1784094477.336916:0:108576:0:(obd_config.c:1430:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 472us 00000100:00100000:0.0:1784094477.336962:0:108576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108576:1870757024414848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784094477.337045:0:108576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094477.338887:0:108576:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784094477.344523:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414848 00000100:00100000:1.0:1784094477.344539:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414848 00000100:00100000:1.0:1784094477.344862:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1784094477.344873:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:108576:x1870757024414848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784094477.345131:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:108576:x1870757024414848:12345-0@lo:502:llog_process_th.0 Request processed in 259us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094477.345139:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1784094477.351442:0:108576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108576:1870757024414848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784094477.351552:0:108576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784094477.351562:0:108576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784094477.351564:0:108576:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1784094477.351569:0:108576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784094477.351636:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784094477.351653:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784094477.351664:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.351676:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094477.351686:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784094477.351689:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff907210f89000 from 7 10000000:01000000:0.0:1784094477.351691:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784094477.351725:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.351733:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.351743:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094477.351764:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094477.351825:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094477.354373:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a240 going to sleep for 11 seconds 00000100:00100000:0.0:1784094477.354399:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024414976 00000100:00100000:0.0:1784094477.354407:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024414976 00000100:00100000:0.0:1784094477.354475:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1784094477.354484:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024414976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094477.354509:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094477.354528:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccfe4 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.354555:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.354567:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.354576:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77800, rc 0) 00000100:00100000:0.0:1784094477.354630:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024414976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094477.354636:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1784094477.354683:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024414976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094477.354699:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.354708:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094477.354766:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024415104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784094477.354790:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094477.354802:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a240 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.355589:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415104 00000100:00100000:3.0:1784094477.355597:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415104 00000100:00100000:3.0:1784094477.355625:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1784094477.355633:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024415104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.355873:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024415104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.355880:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1784094477.355919:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024415104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.355954:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024415232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.355988:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.356008:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b7963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.356017:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415232 00000100:00100000:3.0:1784094477.356020:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415232 00000100:00100000:3.0:1784094477.356037:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1784094477.356042:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024415232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.356155:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024415232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.356165:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1784094477.358724:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024415232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094477.361973:0:108578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108578:1870757024415360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.362078:0:108578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094477.372713:0:108578:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b7963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094477.373991:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415360 00000100:00100000:1.0:1784094477.374005:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415360 00000100:00100000:1.0:1784094477.374070:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1784094477.374081:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:108578:x1870757024415360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784094477.374622:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:108578:x1870757024415360:12345-0@lo:502:llog_process_th.0 Request processed in 542us (12543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094477.374631:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1784094477.375054:0:108578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108578:1870757024415360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784094477.375091:0:108578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784094477.375100:0:108578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784094477.375103:0:108578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:3.0:1784094477.375110:0:108578:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff907210f89000 00000020:00000080:3.0:1784094477.375112:0:108578:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:00020000:1.0:1784094477.385207:0:108578:0:(obd_config.c:1430:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 10077us 00000100:00100000:1.0:1784094477.385290:0:108578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108578:1870757024415488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784094477.385389:0:108578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094477.385455:0:108578:0:(client.c:2702:ptlrpc_set_wait()) set ffff907220c9fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784094477.387133:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415488 00000100:00100000:3.0:1784094477.387151:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415488 00000100:00100000:3.0:1784094477.387231:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1784094477.387242:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:108578:x1870757024415488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784094477.387681:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:108578:x1870757024415488:12345-0@lo:502:llog_process_th.0 Request processed in 439us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094477.387690:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1784094477.388062:0:108578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:31e066cd-86a8-435a-b479-ca191a99cec7:108578:1870757024415488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784094477.388102:0:108578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784094477.388110:0:108578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784094477.388112:0:108578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:1.0:1784094477.388116:0:108578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784094477.391140:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784094477.391343:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784094477.391356:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094477.391368:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094477.867280:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094478.313934:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094478.313958:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024415616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094478.314026:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094478.314285:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024416128:0@lo:400:kworker.0 00000100:00100000:2.0:1784094478.314320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094478.314349:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784094478.314355:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024415744:0@lo:400:kworker.0 00000100:00100000:2.0:1784094478.314381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094478.314399:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024416256:0@lo:400:kworker.0 00000100:00100000:2.0:1784094478.314458:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094478.314490:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416256 00000100:00100000:2.0:1784094478.314511:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416256 00000100:00100000:2.0:1784094478.314569:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1784094478.314578:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024416256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094478.314644:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024416256:12345-0@lo:400:kworker.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094478.314651:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00080000:2.0:1784094478.314672:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094478.314701:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024416256:0@lo:400:kworker.0 00000100:00100000:1.0:1784094478.314868:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416128 00000100:00100000:1.0:1784094478.314873:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416128 00000100:00100000:1.0:1784094478.314914:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1784094478.314922:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094478.314961:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024416128:12345-0@lo:400:kworker.0 Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094478.314971:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1784094478.314988:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415744 00000100:00100000:1.0:1784094478.314992:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415744 00000100:00100000:1.0:1784094478.315010:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1784094478.315015:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024415744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094478.315039:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024415744:12345-0@lo:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094478.315045:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1784094478.315180:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415616 00000100:00100000:3.0:1784094478.315185:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415616 00000100:00100000:3.0:1784094478.315227:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1784094478.315235:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024415616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094478.315264:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094478.315307:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024415616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094478.315314:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1784094478.315334:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024415872:0@lo:400:kworker.0 00000100:00100000:3.0:1784094478.315360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094478.315379:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094478.315385:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024416000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094478.315406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094478.315464:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024415872 00000100:00100000:3.0:1784094478.315468:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024415872 00000100:00100000:3.0:1784094478.315701:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416000 00000100:00100000:3.0:1784094478.315705:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416000 00000100:00100000:3.0:1784094478.315732:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1784094478.315738:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024415872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094478.315772:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024415872:12345-0@lo:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094478.315778:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1784094478.315788:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1784094478.315793:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024416000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094478.315814:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024416000:12345-0@lo:400:kworker.0 Request processed in 22us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094478.315819:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1784094478.315849:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024416000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094478.315857:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024415872:0@lo:400:kworker.0 00000100:00100000:1.0:1784094478.315999:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024415616:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784094478.316058:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094478.316063:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094478.316065:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094478.316082:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024415744:0@lo:400:kworker.0 00000100:00100000:2.0:1784094478.316092:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024416128:0@lo:400:kworker.0 00010000:00010000:3.0:1784094478.905458:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094479.918065:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094480.365719:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024416384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094480.365796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094480.365926:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416384 00000100:00100000:1.0:1784094480.365934:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416384 00000100:00100000:1.0:1784094480.365997:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1784094480.366006:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024416384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094480.366041:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094480.366093:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024416384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094480.366100:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00080000:2.0:1784094480.366185:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094480.366231:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024416384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094480.946048:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094481.961592:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094482.999577:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094483.435888:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094483.435921:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024416512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094483.436002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094483.436317:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416512 00000100:00100000:3.0:1784094483.436327:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416512 00000100:00100000:3.0:1784094483.436412:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1784094483.436439:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024416512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784094483.436478:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784094483.436533:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024416512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094483.436540:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1784094483.436587:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024416512:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784094483.436650:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094483.438452:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024416640:0@lo:400:kworker.0 00000100:00100000:0.0:1784094483.438517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094483.438650:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024416768:0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.438683:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094483.438772:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416640 00000100:00100000:3.0:1784094483.438779:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416640 00000100:00100000:3.0:1784094483.438827:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1784094483.438836:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024416640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.441788:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094483.441806:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024417152:0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.441867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094483.441919:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024416896:0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.441944:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094483.441967:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094483.441972:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024417024:0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.441996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094483.442025:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417024 00000100:00100000:1.0:1784094483.442032:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417024 00000100:00100000:1.0:1784094483.442088:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1784094483.442098:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.442147:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024417024:12345-0@lo:400:kworker.0 Request processed in 51us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094483.442154:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00080000:1.0:1784094483.442191:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094483.442218:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024417024:0@lo:400:kworker.0 00000100:00100000:2.0:1784094483.445539:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416768 00000100:00100000:2.0:1784094483.445557:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416768 00000100:00100000:2.0:1784094483.445641:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417152 00000100:00100000:2.0:1784094483.445644:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417152 00000100:00100000:2.0:1784094483.445681:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024416896 00000100:00100000:2.0:1784094483.445685:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024416896 00000100:00100000:2.0:1784094483.445706:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1784094483.445716:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024416768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094483.445815:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024416768:12345-0@lo:400:kworker.0 Request processed in 101us (7131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094483.445823:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1784094483.445840:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1784094483.445847:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024417152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094483.445874:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024417152:12345-0@lo:400:kworker.0 Request processed in 28us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094483.445880:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1784094483.445891:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1784094483.445898:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024416896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094483.445928:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024416896:12345-0@lo:400:kworker.0 Request processed in 31us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094483.445933:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00080000:1.0:1784094483.446016:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094483.446059:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024417152:0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.446075:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024416768:0@lo:400:kworker.0 00000100:00100000:1.0:1784094483.446120:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024416896:0@lo:400:kworker.0 00000100:00100000:3.0:1784094483.446324:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024416640:12345-0@lo:400:kworker.0 Request processed in 7488us (7805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094483.446334:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1784094483.448328:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024416640:0@lo:400:kworker.0 00010000:00010000:0.0:1784094484.011987:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784094484.891412:0:108860:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: start setup 01:48:03 (1784094483) === 00010000:00010000:0.0:1784094485.034547:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094485.481963:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094485.481989:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024417280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094485.482077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094485.482292:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417280 00000100:00100000:1.0:1784094485.482324:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417280 00000100:00100000:1.0:1784094485.482387:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1784094485.482396:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024417280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094485.482457:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094485.482503:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024417280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094485.482514:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00080000:3.0:1784094485.482575:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094485.482612:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024417280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094486.059108:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094487.086563:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094488.106528:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094488.555563:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024417664:0@lo:400:kworker.0 00000100:00100000:3.0:1784094488.555642:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094488.555693:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094488.555699:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024417792:0@lo:400:kworker.0 00000100:00100000:3.0:1784094488.555725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094488.557335:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024417408:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094488.557473:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024417920:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557500:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094488.557526:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784094488.557532:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024417536:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094488.557575:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024418048:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094488.557631:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417792 00000100:00100000:1.0:1784094488.557638:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417792 00000100:00100000:2.0:1784094488.557685:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417664 00000100:00100000:1.0:1784094488.557689:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418048 00000100:00100000:2.0:1784094488.557690:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417664 00000100:00100000:1.0:1784094488.557692:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418048 00000100:00100000:1.0:1784094488.557713:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1784094488.557715:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417920 00000100:00100000:2.0:1784094488.557718:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417920 00000100:00100000:1.0:1784094488.557721:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024417792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557776:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024417792:12345-0@lo:400:kworker.0 Request processed in 55us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094488.557783:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1784094488.557799:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1784094488.557805:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024418048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094488.557808:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417536 00000100:00100000:2.0:1784094488.557811:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417536 00000100:00100000:2.0:1784094488.557824:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1784094488.557830:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024417664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557835:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024418048:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094488.557840:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1784094488.557862:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1784094488.557863:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024417664:12345-0@lo:400:kworker.0 Request processed in 34us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094488.557868:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024417920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094488.557869:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1784094488.557879:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1784094488.557884:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024417536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557894:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024417920:12345-0@lo:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094488.557900:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1784094488.557905:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024417536:12345-0@lo:400:kworker.0 Request processed in 22us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094488.557910:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00080000:1.0:1784094488.557922:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094488.557926:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094488.557928:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094488.557964:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024417792:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.557976:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024417664:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.558007:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024417536:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.558016:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024418048:0@lo:400:kworker.0 00000100:00100000:1.0:1784094488.558023:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024417920:0@lo:400:kworker.0 00000100:00100000:3.0:1784094488.559338:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024417408 00000100:00100000:3.0:1784094488.559353:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024417408 00000100:00100000:3.0:1784094488.559401:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1784094488.559409:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024417408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094488.559493:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024417408:12345-0@lo:400:kworker.0 Request processed in 85us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094488.559500:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1784094488.559614:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024417408:0@lo:400:kworker.0 00000100:00100000:0.0:1784094488.560795:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094488.560812:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024418176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094488.560862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094488.560904:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418176 00000100:00100000:0.0:1784094488.560910:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418176 00000100:00100000:0.0:1784094488.560948:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1784094488.560957:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024418176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094488.560989:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094488.561034:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024418176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094488.561040:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1784094488.561079:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024418176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784094489.129600:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094490.153962:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094490.605658:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024418304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094490.605780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094490.605956:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418304 00000100:00100000:1.0:1784094490.605965:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418304 00000100:00100000:1.0:1784094490.606041:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1784094490.606051:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024418304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094490.606089:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094490.606137:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024418304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094490.606144:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00080000:3.0:1784094490.606376:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094490.606416:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024418304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094491.180340:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094492.201671:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094493.225646:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094493.673685:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094493.673721:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024418432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094493.673793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094493.673981:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418432 00000100:00100000:0.0:1784094493.673989:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418432 00000100:00100000:0.0:1784094493.674063:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1784094493.674073:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024418432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094493.674106:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094493.674166:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024418432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094493.674175:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1784094493.674328:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024418432:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784094493.674801:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094493.675350:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024418688:0@lo:400:kworker.0 00000100:00100000:3.0:1784094493.675407:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094493.675544:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094493.675556:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024418560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.675592:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094493.675640:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418560 00000100:00100000:1.0:1784094493.675645:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418560 00000100:00100000:1.0:1784094493.675679:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1784094493.675686:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024418560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094493.675884:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418688 00000100:00100000:0.0:1784094493.675888:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418688 00000100:00100000:0.0:1784094493.675917:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1784094493.675924:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024418688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.679601:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024418560:12345-0@lo:400:kworker.0 Request processed in 3904us (3996us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094493.679615:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1784094493.679711:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024418560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.679769:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024418816:0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.679806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094493.679846:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418816 00000100:00100000:1.0:1784094493.679852:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418816 00000100:00100000:1.0:1784094493.679905:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1784094493.679913:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024418816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.679958:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024418816:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094493.679963:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1784094493.679992:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024418816:0@lo:400:kworker.0 00000100:00080000:1.0:1784094493.680015:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094493.686711:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024418688:12345-0@lo:400:kworker.0 Request processed in 10773us (11288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094493.686726:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1784094493.686760:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024419072:0@lo:400:kworker.0 00000100:00100000:0.0:1784094493.686815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094493.686850:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094493.686857:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024418944:0@lo:400:kworker.0 00000100:00100000:0.0:1784094493.686884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094493.686910:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419072 00000100:00100000:0.0:1784094493.686917:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419072 00000100:00100000:0.0:1784094493.687199:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1784094493.687212:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094493.687265:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024419072:12345-0@lo:400:kworker.0 Request processed in 57us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094493.687333:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024418944 00000100:00100000:1.0:1784094493.687337:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024418944 00000100:00100000:1.0:1784094493.687379:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1784094493.687387:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024418944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.687440:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024418944:12345-0@lo:400:kworker.0 Request processed in 54us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094493.687447:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00080000:1.0:1784094493.687471:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094493.687475:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094493.687520:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024418944:0@lo:400:kworker.0 00000100:00100000:1.0:1784094493.687530:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024419072:0@lo:400:kworker.0 00000100:00100000:3.0:1784094493.694593:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024418688:0@lo:400:kworker.0 00000100:00100000:0.0:1784094493.696618:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00010000:00010000:0.0:1784094494.249690:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094495.273634:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094495.721830:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094495.721857:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024419200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094495.721934:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094495.722031:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419200 00000100:00100000:0.0:1784094495.722041:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419200 00000100:00100000:0.0:1784094495.722127:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00080000:1.0:1784094495.722136:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094495.722139:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024419200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094495.722180:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094495.722243:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024419200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094495.722250:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1784094495.722534:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024419200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094496.297883:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094497.321946:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094498.365314:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094498.794719:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094498.794742:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024419328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094498.794808:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094498.794890:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419328 00000100:00100000:0.0:1784094498.794898:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419328 00000100:00100000:0.0:1784094498.794952:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1784094498.794962:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024419328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094498.794998:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094498.795048:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024419328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094498.795056:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00080000:0.0:1784094498.795087:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094498.795121:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024419328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094498.796602:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024419584:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.796656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094498.796704:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784094498.796710:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024419456:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.796737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094498.796758:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024419968:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.796780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094498.796808:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419456 00000100:00100000:2.0:1784094498.796815:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419456 00000100:00100000:2.0:1784094498.796853:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1784094498.796861:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024419456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.796919:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024419456:12345-0@lo:400:kworker.0 Request processed in 58us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094498.796926:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1784094498.796958:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419584 00000100:00100000:2.0:1784094498.796962:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419584 00000100:00100000:2.0:1784094498.796988:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419968 00000100:00100000:2.0:1784094498.796991:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419968 00000100:00100000:2.0:1784094498.797017:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1784094498.797022:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024419584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797072:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024419584:12345-0@lo:400:kworker.0 Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094498.797079:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1784094498.797091:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1784094498.797100:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024419968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797125:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024419968:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094498.797130:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1784094498.797154:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024419840:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797181:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094498.797202:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094498.797207:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024419712:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094498.797245:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419840 00000100:00100000:2.0:1784094498.797248:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419840 00000100:00100000:2.0:1784094498.797275:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1784094498.797280:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024419840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797312:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024419840:12345-0@lo:400:kworker.0 Request processed in 32us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094498.797318:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1784094498.797351:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024419840:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797373:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024419456:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797381:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024419968:0@lo:400:kworker.0 00000100:00100000:2.0:1784094498.797389:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024419584:0@lo:400:kworker.0 00000100:00100000:0.0:1784094498.797620:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024419712 00000100:00100000:0.0:1784094498.797625:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024419712 00000100:00100000:0.0:1784094498.797664:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1784094498.797672:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024419712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094498.797718:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024419712:12345-0@lo:400:kworker.0 Request processed in 47us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094498.797725:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00080000:0.0:1784094498.797741:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784094498.797745:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094498.797762:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024419712:0@lo:400:kworker.0 00010000:00010000:1.0:1784094499.375457:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784094500.265925:0:109268:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg457-server.virtnet: executing load_modules_local 00010000:00010000:0.0:1784094500.393773:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094500.856193:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094500.856223:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024420096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094500.856299:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094500.857973:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420096 00000100:00100000:2.0:1784094500.857983:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420096 00000100:00100000:2.0:1784094500.858053:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1784094500.858063:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024420096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094500.858101:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094500.858158:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024420096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094500.858166:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00080000:2.0:1784094500.858194:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094500.862357:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024420096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094501.427311:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094502.441568:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094503.468453:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094503.913541:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094503.913564:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024420352:0@lo:400:kworker.0 00000100:00100000:3.0:1784094503.913584:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024420608:0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.913663:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024420736:0@lo:400:kworker.0 00000100:00100000:0.0:1784094503.917853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094503.917935:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024420224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094503.917994:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094503.918028:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024420864:0@lo:400:kworker.0 00000100:00100000:0.0:1784094503.918054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094503.918101:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420224 00000100:00100000:0.0:1784094503.918109:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420224 00000100:00100000:0.0:1784094503.918161:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1784094503.918171:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024420224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094503.918207:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094503.918790:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024420224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 618us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094503.918799:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1784094503.918830:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420864 00000100:00100000:0.0:1784094503.918834:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420864 00000100:00100000:0.0:1784094503.918865:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1784094503.918873:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024420864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094503.918906:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024420864:12345-0@lo:400:kworker.0 Request processed in 34us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094503.918912:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00080000:0.0:1784094503.918926:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094503.918929:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094503.918972:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024420864:0@lo:400:kworker.0 00000100:00100000:0.0:1784094503.918989:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024420224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094503.921100:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420352 00000100:00100000:1.0:1784094503.921112:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420352 00000100:00100000:1.0:1784094503.921162:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1784094503.921171:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024420352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921251:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024420352:12345-0@lo:400:kworker.0 Request processed in 81us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094503.921258:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1784094503.921299:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024420480:0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094503.921360:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024420992:0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094503.921418:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420480 00000100:00100000:1.0:1784094503.921437:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420480 00000100:00100000:1.0:1784094503.921479:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1784094503.921486:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024420480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921522:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024420480:12345-0@lo:400:kworker.0 Request processed in 36us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094503.921528:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1784094503.921547:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420992 00000100:00100000:1.0:1784094503.921550:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420992 00000100:00100000:1.0:1784094503.921573:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1784094503.921578:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024420992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921608:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024420992:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094503.921614:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1784094503.921648:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024420480:0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921658:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024420992:0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921693:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024420352:0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094503.921737:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420736 00000100:00100000:1.0:1784094503.921740:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420736 00000100:00100000:1.0:1784094503.921771:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:1.0:1784094503.921793:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024420736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094503.921825:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024420736:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094503.921831:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00080000:1.0:1784094503.921845:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094503.921867:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024420736:0@lo:400:kworker.0 00000100:00100000:3.0:1784094503.922392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094503.922457:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024420608 00000100:00100000:3.0:1784094503.922568:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024420608 00000100:00100000:3.0:1784094503.922617:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1784094503.922625:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024420608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094503.922668:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024420608:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094503.922675:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1784094503.922707:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024420608:0@lo:400:kworker.0 00000100:00080000:2.0:1784094503.922751:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784094504.489795:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784094505.131829:0:109530:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=7196, dev=0 00010000:00010000:0.0:1784094505.513739:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094505.962172:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784094505.962199:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024421120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094505.962262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094505.962324:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421120 00000100:00100000:1.0:1784094505.962332:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421120 00000100:00100000:1.0:1784094505.962391:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1784094505.962399:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024421120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094505.962461:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094505.962505:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024421120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094505.962511:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:1.0:1784094505.962531:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094505.962562:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024421120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094506.537655:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094507.569016:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784094507.600119:0:109678:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=7196, dev=0 00000020:00000004:3.0:1784094507.609090:0:109679:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=7196, dev=0 00000020:00000004:3.0:1784094507.634141:0:109680:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from lsi ino=7196, dev=0 00010000:00010000:0.0:1784094508.585602:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094508.613391:0:109728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd28cb500 20000000:00000080:3.0:1784094508.613406:0:109728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff907230e05800 uarg=0000000000000000 20000000:01000000:3.0:1784094508.613562:0:109728:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784094508.613569:0:109728:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784094508.613573:0:109728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784094508.614303:0:109729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1784094508.614627:0:109728:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784094508.623000:0:109728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784094508.623119:0:109728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.623205:0:109728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfba expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.623213:0:109728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.623219:0:109728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.623226:0:109728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.623273:0:109728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.623289:0:109728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 18 pid: 5772 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094508.623302:0:109728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109728:1870757024421248:0@lo:104: 00000100:00100000:1.0:1784094508.623378:0:109728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094508.624099:0:109728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.624110:0:109728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 18 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094508.624119:0:109728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109728:1870757024421376:0@lo:104: 00000100:00100000:1.0:1784094508.624159:0:109728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784094508.624182:0:109728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccfba expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094508.624189:0:109728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccfba expref: 18 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094508.624196:0:109728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109728:1870757024421504:0@lo:104: 00000100:00100000:1.0:1784094508.624215:0:109728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094508.624230:0:109728:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720aab19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784094508.624325:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421248 00000100:00100000:3.0:1784094508.624333:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421248 00000100:00100000:3.0:1784094508.624372:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421376 00000100:00100000:3.0:1784094508.624375:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421376 00000100:00100000:3.0:1784094508.624383:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421504 00000100:00100000:3.0:1784094508.624385:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421504 00000100:00100000:3.0:1784094508.624397:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784094508.624405:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+5:109728:x1870757024421248:12345-0@lo:104: 00010000:00010000:3.0:1784094508.624418:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624493:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094508.624499:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+5:109728:x1870757024421248:12345-0@lo:104: Request processed in 95us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094508.624509:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784094508.624527:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784094508.624532:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+4:109728:x1870757024421376:12345-0@lo:104: 00010000:00010000:3.0:1784094508.624540:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624572:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784094508.624577:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+4:109728:x1870757024421376:12345-0@lo:104: Request processed in 45us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094508.624582:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784094508.624592:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1784094508.624597:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:109728:x1870757024421504:12345-0@lo:104: 00010000:00010000:3.0:1784094508.624604:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624633:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784094508.624638:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:109728:x1870757024421504:12345-0@lo:104: Request processed in 41us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094508.624644:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:3.0:1784094508.624662:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784094508.624667:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624674:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094508.624678:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624702:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094508.624710:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094508.624716:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784094508.624745:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624752:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094508.624772:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624779:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77400/0x9ce98053214ccfe4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfeb expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624791:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784094508.624793:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624799:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68a00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094508.624802:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624808:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094508.624815:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094508.624954:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784094508.624969:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624975:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094508.624981:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624988:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68a00/0x9ce98053214ccfd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfdd expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.624996:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094508.624999:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.625005:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094508.625007:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.625014:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094508.625019:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094508.625025:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784094508.625036:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.625042:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094508.625058:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.625065:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb68800/0x9ce98053214ccfba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfc1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.625078:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094508.625079:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094508.625081:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094508.625092:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024421632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094508.625123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094508.625149:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094508.625154:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024421760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094508.625171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094508.625197:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024421888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094508.625216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094508.625246:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421632 00000100:00100000:3.0:1784094508.625250:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421632 00010000:00010000:3.0:1784094508.625270:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 19 pid: 5772 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094508.625289:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421760 00000100:00100000:3.0:1784094508.625291:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421760 00010000:00010000:3.0:1784094508.625300:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 20 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094508.625315:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024421888 00000100:00100000:3.0:1784094508.625317:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024421888 00000100:00100000:1.0:1784094508.625464:0:109728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109728:1870757024421248:0@lo:104: 00000100:00100000:1.0:1784094508.625474:0:109728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109728:1870757024421376:0@lo:104: 00000100:00100000:1.0:1784094508.625480:0:109728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109728:1870757024421504:0@lo:104: 00010000:00010000:1.0:1784094508.625502:0:109728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625662:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094508.625667:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094508.625689:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1784094508.625699:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+21:3301:x1870757024421632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094508.625710:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094508.625715:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 21 pid: 5772 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625726:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 21 pid: 5772 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625737:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77800/0x9ce98053214ccfeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccfe4 expref: 21 pid: 5772 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625748:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094508.625845:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+20:3301:x1870757024421632:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094508.625851:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1784094508.625898:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1784094508.625904:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024421760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094508.625910:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094508.625914:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 19 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625924:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 19 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625933:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68600/0x9ce98053214ccfdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccfd6 expref: 19 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.625941:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094508.625959:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024421760:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094508.625965:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00010000:00010000:3.0:1784094508.626073:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfba expref: 21 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094508.626107:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784094508.626115:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+17:3303:x1870757024421888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094508.626123:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094508.626127:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfba expref: 17 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626147:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccfba expref: 17 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626157:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68400/0x9ce98053214ccfc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccfba expref: 17 pid: 5770 timeout: 1819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626168:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626177:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626189:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626197:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626202:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626209:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626219:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13000 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094508.626222:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626229:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626242:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094508.626249:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094508.626276:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+16:3303:x1870757024421888:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094508.626283:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784094508.626312:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024421888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094508.626469:0:109728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.626477:0:109728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094508.626483:0:109728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214ccff2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094508.627502:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024421632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094508.627521:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024421760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094509.037108:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024422016:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.037217:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024422528:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.037270:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094509.037275:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024422400:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.037321:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024422144:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.037357:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024422656:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.037388:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094509.037392:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024422272:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.037469:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422016 00000100:00100000:2.0:1784094509.037476:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422016 00000100:00100000:2.0:1784094509.037518:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1784094509.037527:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+16:3304:x1870757024422016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037574:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+16:3304:x1870757024422016:12345-0@lo:400:kworker.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.037581:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1784094509.037613:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422400 00000100:00100000:2.0:1784094509.037618:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422400 00000100:00100000:2.0:1784094509.037650:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422656 00000100:00100000:2.0:1784094509.037653:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422656 00000100:00100000:2.0:1784094509.037674:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1784094509.037680:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024422400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037753:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024422400:12345-0@lo:400:kworker.0 Request processed in 73us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.037759:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1784094509.037770:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1784094509.037776:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024422656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.037806:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024422656:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.038861:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1784094509.038908:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422528 00000100:00100000:2.0:1784094509.038915:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422528 00000100:00100000:2.0:1784094509.038949:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422144 00000100:00100000:2.0:1784094509.038953:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422144 00000100:00100000:2.0:1784094509.038980:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422272 00000100:00100000:2.0:1784094509.038983:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422272 00000100:00100000:2.0:1784094509.039001:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1784094509.039007:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024422528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039174:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024422528:12345-0@lo:400:kworker.0 Request processed in 166us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.039181:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1784094509.039195:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1784094509.039200:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024422144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039230:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024422144:12345-0@lo:400:kworker.0 Request processed in 30us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.039236:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1784094509.039246:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1784094509.039252:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024422272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039277:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024422272:12345-0@lo:400:kworker.0 Request processed in 25us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.039282:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:2.0:1784094509.039309:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784094509.039314:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094509.039315:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094509.039355:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024422272:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039368:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024422144:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039379:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024422656:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039414:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024422400:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039443:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024422016:0@lo:400:kworker.0 00000100:00100000:2.0:1784094509.039452:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103acca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024422528:0@lo:400:kworker.0 00000100:00100000:0.0:1784094509.042641:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784094509.042666:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024422784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094509.042773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094509.042905:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422784 00000100:00100000:2.0:1784094509.042913:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422784 00000100:00100000:2.0:1784094509.042959:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1784094509.043109:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024422784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094509.043145:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094509.043188:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024422784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 222us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.043196:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1784094509.043587:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024422784:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784094509.614673:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784094509.891371:0:109778:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=7458, dev=0 10000000:01000000:0.0:1784094509.994253:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784094509.994261:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff907237a1c800 from 10 10000000:01000000:0.0:1784094509.994266:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784094509.994310:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094509.994396:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094509.994410:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094509.994454:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024422912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094509.994979:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094509.995049:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710599f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784094509.995093:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024422912 00000100:00100000:2.0:1784094509.995101:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024422912 00000100:00100000:2.0:1784094509.995149:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1784094509.995158:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024422912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094509.995170:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094509.995184:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214ccff9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094509.995207:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 17 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094509.995229:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 17 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094509.995240:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40c00, rc 0) 00000100:00100000:2.0:1784094509.995284:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024422912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.995291:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1784094509.995913:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024422912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094509.995935:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094509.995945:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094509.996015:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784094509.996067:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094509.996085:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710599f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784094509.996299:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423040 00000100:00100000:2.0:1784094509.996304:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423040 00000100:00100000:2.0:1784094509.996338:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1784094509.996345:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024423040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094509.996590:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024423040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094509.996598:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1784094510.002635:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9071026bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784094510.002766:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784094510.002836:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094510.002885:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b935e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784094510.002927:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423168 00000100:00100000:2.0:1784094510.002934:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423168 00000100:00100000:2.0:1784094510.002983:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1784094510.002991:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024423168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.003164:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024423168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094510.003171:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1784094510.003309:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784094510.004800:0:109788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784094510.007161:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784094510.007190:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784094510.007201:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.007224:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094510.007237:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784094510.007241:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff90720a9c7800 from 10 10000000:01000000:2.0:1784094510.007244:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784094510.007280:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.007288:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.007299:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094510.007324:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.007384:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094510.007437:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a840 going to sleep for 11 seconds 00000100:00100000:2.0:1784094510.007456:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423296 00000100:00100000:2.0:1784094510.007462:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423296 00000100:00100000:2.0:1784094510.007675:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1784094510.007684:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024423296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094510.007697:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094510.007718:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd007 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.007741:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd007 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.007751:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd007 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.007760:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41e00, rc 0) 00000100:00100000:2.0:1784094510.007800:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024423296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094510.007808:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1784094510.007931:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094510.007945:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094510.007954:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094510.007999:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784094510.008025:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094510.008046:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720b935480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094510.008082:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423424 00000100:00100000:2.0:1784094510.008086:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423424 00000100:00100000:2.0:1784094510.008113:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1784094510.008119:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024423424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.008350:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024423424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094510.008358:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1784094510.008384:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.008412:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.008471:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094510.008482:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094510.008590:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423552 00000100:00100000:1.0:1784094510.008594:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423552 00000100:00100000:1.0:1784094510.008616:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1784094510.008622:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024423552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784094510.008763:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024423552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094510.008770:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1784094510.008969:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784094510.010080:0:109789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784094510.013567:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784094510.013607:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784094510.013619:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094510.013632:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094510.014315:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784094510.014319:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff907210f89000 from 10 10000000:01000000:2.0:1784094510.014323:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784094510.014360:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.014369:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094510.014380:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094510.014403:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.014596:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094510.015613:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a540 going to sleep for 11 seconds 00000100:00100000:1.0:1784094510.017936:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423680 00000100:00100000:1.0:1784094510.017954:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423680 00000100:00100000:1.0:1784094510.018035:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1784094510.018045:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024423680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094510.018063:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094510.018083:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd015 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094510.018114:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd015 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094510.018126:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd015 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094510.018136:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13e00, rc 0) 00000100:00100000:1.0:1784094510.018218:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024423680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094510.018230:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1784094510.018292:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094510.018310:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094510.018319:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094510.018384:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784094510.018416:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094510.018460:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219c94e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784094510.018473:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423808 00000100:00100000:1.0:1784094510.018477:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423808 00000100:00100000:1.0:1784094510.018502:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1784094510.018509:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024423808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784094510.018786:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024423808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094510.018794:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1784094510.018872:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.018907:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784094510.018947:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094510.026157:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710134a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784094510.027836:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024423936 00000100:00100000:3.0:1784094510.027860:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024423936 00000100:00100000:3.0:1784094510.027902:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1784094510.027911:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024423936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094510.028126:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024423936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (9178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094510.028135:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1784094510.028192:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024423936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784094510.036945:0:109792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784094510.037049:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784094510.037078:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784094510.037091:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094510.037103:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094510.639806:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094511.086611:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024424064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094511.086684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094511.086808:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424064 00000100:00100000:1.0:1784094511.086817:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424064 00000100:00100000:1.0:1784094511.086889:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1784094511.086900:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024424064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094511.086943:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094511.086993:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024424064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094511.087004:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1784094511.087051:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024424064:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784094511.088197:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094511.658152:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094512.683812:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784094512.763714:0:109929:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=7458, dev=0 00000020:00000004:0.0:1784094512.775945:0:109930:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=7458, dev=0 00000020:00000004:3.0:1784094512.799169:0:109931:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from lsi ino=7458, dev=0 00010000:00010000:3.0:1784094513.706847:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094514.153858:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024424192:0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.153932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094514.153981:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024424704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.154009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094514.154272:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024424448:0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.154304:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094514.154326:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784094514.154333:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024424320:0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.154354:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094514.154372:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024424832:0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.154395:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094514.154443:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424704 00000100:00100000:2.0:1784094514.154449:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424704 00000100:00100000:2.0:1784094514.154499:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424448 00000100:00100000:2.0:1784094514.154502:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424448 00000100:00100000:2.0:1784094514.154523:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424320 00000100:00100000:2.0:1784094514.154526:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424320 00000100:00100000:2.0:1784094514.154541:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1784094514.154549:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024424704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.154829:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024424704:12345-0@lo:400:kworker.0 Request processed in 279us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094514.154837:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1784094514.154859:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1784094514.154866:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024424448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.154902:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024424448:12345-0@lo:400:kworker.0 Request processed in 37us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094514.154908:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1784094514.154920:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1784094514.154927:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024424320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.154956:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024424320:12345-0@lo:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094514.154961:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1784094514.155075:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024424704:0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.155095:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094514.155101:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024424576:0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.155126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094514.155169:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424832 00000100:00100000:1.0:1784094514.155173:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424832 00000100:00100000:1.0:1784094514.155201:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424576 00000100:00100000:1.0:1784094514.155203:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424576 00000100:00100000:1.0:1784094514.155225:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1784094514.155232:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024424832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.155262:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024424832:12345-0@lo:400:kworker.0 Request processed in 31us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094514.155267:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1784094514.155279:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1784094514.155284:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024424576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.155314:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024424576:12345-0@lo:400:kworker.0 Request processed in 30us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094514.155320:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1784094514.155351:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024424576:0@lo:400:kworker.0 00000100:00080000:1.0:1784094514.155392:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094514.155396:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094514.155399:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094514.155869:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024424320:0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.155882:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024424832:0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.155891:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024424448:0@lo:400:kworker.0 00000100:00100000:1.0:1784094514.156804:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094514.156815:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024424960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094514.156858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094514.156892:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424960 00000100:00100000:1.0:1784094514.156898:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424960 00000100:00100000:1.0:1784094514.156932:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1784094514.156939:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024424960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094514.157399:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094514.157464:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024424960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 525us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094514.157471:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1784094514.157515:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024424960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094514.157700:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024424192 00000100:00100000:2.0:1784094514.157706:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024424192 00000100:00100000:2.0:1784094514.157738:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1784094514.157745:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024424192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094514.157801:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024424192:12345-0@lo:400:kworker.0 Request processed in 56us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094514.157807:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1784094514.157842:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024424192:0@lo:400:kworker.0 00010000:00010000:3.0:1784094514.732577:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094515.762323:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094516.202026:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094516.202065:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024425088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094516.202136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094516.202325:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425088 00000100:00100000:1.0:1784094516.202334:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425088 00000100:00100000:1.0:1784094516.202419:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1784094516.202462:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024425088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094516.202508:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094516.202575:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024425088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094516.202582:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:0.0:1784094516.202664:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094516.202715:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024425088:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1784094516.358376:0:110076:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=48775, dev=0 00010000:00010000:0.0:1784094516.777578:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094517.808892:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094518.835189:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094519.275656:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024425216:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.275742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094519.275793:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024425728:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.275821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094519.275848:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094519.276006:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024425600:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.276037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094519.276071:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024425344:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.276094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094519.276117:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024425856:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.276143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094519.276161:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094519.276166:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024425472:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.276185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094519.276213:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425728 00000100:00100000:1.0:1784094519.276221:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425728 00000100:00100000:1.0:1784094519.276273:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425344 00000100:00100000:1.0:1784094519.276277:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425344 00000100:00100000:1.0:1784094519.276297:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425472 00000100:00100000:1.0:1784094519.276300:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425472 00000100:00100000:1.0:1784094519.276319:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1784094519.276328:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024425728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.276381:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024425728:12345-0@lo:400:kworker.0 Request processed in 54us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094519.276388:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1784094519.276408:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1784094519.276415:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024425344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094519.276656:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1784094519.276664:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024425472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094519.277485:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024425984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094519.278073:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024425472:12345-0@lo:400:kworker.0 Request processed in 1407us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094519.278083:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1784094519.278147:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024425472:0@lo:400:kworker.0 00000100:00100000:0.0:1784094519.278224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094519.278274:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425216 00000100:00100000:0.0:1784094519.278281:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425216 00000100:00100000:1.0:1784094519.278299:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024425344:12345-0@lo:400:kworker.0 Request processed in 1882us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094519.278323:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1784094519.278353:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425600 00000100:00100000:1.0:1784094519.278358:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425600 00000100:00100000:1.0:1784094519.278387:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425856 00000100:00100000:1.0:1784094519.278391:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425856 00000100:00100000:1.0:1784094519.278412:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1784094519.278434:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024425600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.278598:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024425600:12345-0@lo:400:kworker.0 Request processed in 179us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094519.278605:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1784094519.278617:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1784094519.278623:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024425856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.278652:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024425856:12345-0@lo:400:kworker.0 Request processed in 30us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094519.278657:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00080000:1.0:1784094519.278697:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094519.278701:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094519.278704:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094519.279189:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024425600:0@lo:400:kworker.0 00000100:00100000:1.0:1784094519.279203:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024425728:0@lo:400:kworker.0 00000100:00100000:0.0:1784094519.279364:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1784094519.279365:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024425344:0@lo:400:kworker.0 00000100:00100000:0.0:1784094519.279379:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024425216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094519.279386:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024425856:0@lo:400:kworker.0 00000100:00100000:0.0:1784094519.279461:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024425216:12345-0@lo:400:kworker.0 Request processed in 87us (3717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094519.279470:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024425216:0@lo:400:kworker.0 00000100:00100000:0.0:1784094519.279471:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1784094519.279516:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024425984 00000100:00100000:0.0:1784094519.279522:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024425984 00000100:00100000:0.0:1784094519.279560:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1784094519.279568:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024425984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094519.279597:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094519.279642:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024425984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094519.279649:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1784094519.279701:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024425984:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1784094519.584589:0:110225:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=48775, dev=0 00000020:00000004:2.0:1784094519.592544:0:110226:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=48775, dev=0 00000020:00000004:0.0:1784094519.614248:0:110227:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from lsi ino=48775, dev=0 00010000:00010000:0.0:1784094519.851116:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094520.874004:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094521.321706:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024426112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094521.321790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094521.321947:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426112 00000100:00100000:1.0:1784094521.321956:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426112 00000100:00100000:1.0:1784094521.322016:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1784094521.322025:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024426112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094521.322056:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094521.322099:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024426112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.322106:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00080000:3.0:1784094521.322215:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094521.322251:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024426112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094521.617538:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.617656:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013940736 00000100:00100000:2.0:1784094521.617667:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013940736 00000100:00100000:2.0:1784094521.617714:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1037 00000100:00100000:2.0:1784094521.617722:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1870757013940736:12345-192.168.204.57@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784094521.617749:0:5771:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e3b77607-df53-4cb2-a6b9-19cd645e31df@192.168.204.57@tcp t0 exp 0000000000000000 cur 1682 last 0 00000020:00000080:2.0:1784094521.617774:0:5771:0:(genops.c:1406:class_connect()) connect: client e3b77607-df53-4cb2-a6b9-19cd645e31df, cookie 0x9ce98053214cd023 00000100:00080000:2.0:1784094521.617813:0:5771:0:(import.c:65:import_set_state_nolock()) ffff907225c8e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784094521.617877:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+5:2351:x1870757013940736:12345-192.168.204.57@tcp:250:mount.lustre.0 Request processed in 155us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.617885:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1037 00000100:00100000:2.0:1784094521.660844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094521.661222:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013940864 00000100:00100000:0.0:1784094521.661233:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013940864 00000100:00100000:0.0:1784094521.661297:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1038 00000100:00100000:0.0:1784094521.661308:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+5:67017:x1870757013940864:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784094521.661324:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094521.661342:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214cd02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf6044 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094521.661368:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214cd02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6044 expref: 6 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094521.661379:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77e00/0x9ce98053214cd02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6044 expref: 6 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094521.661388:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094521.661476:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+6:67017:x1870757013940864:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 169us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094521.661483:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1038 00000100:00100000:0.0:1784094521.676643:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.677124:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013940992 00000100:00100000:2.0:1784094521.677135:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013940992 00000100:00100000:2.0:1784094521.677205:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1039 00000100:00100000:2.0:1784094521.677216:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+6:67017:x1870757013940992:12345-192.168.204.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784094521.677640:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+6:67017:x1870757013940992:12345-192.168.204.57@tcp:501:mount.lustre.0 Request processed in 415us (1005us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784094521.677649:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1039 00000100:00100000:1.0:1784094521.683485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.683571:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941120 00000100:00100000:2.0:1784094521.683580:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941120 00000100:00100000:2.0:1784094521.683640:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1040 00000100:00100000:2.0:1784094521.683652:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+6:67017:x1870757013941120:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784094521.683670:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094521.683686:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cd031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf604b expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094521.683713:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cd031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf604b expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094521.683725:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40200/0x9ce98053214cd031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf604b expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094521.683734:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40200, rc 0) 00000100:00100000:2.0:1784094521.683794:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+7:67017:x1870757013941120:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 144us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.683801:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1040 00000100:00100000:3.0:1784094521.687529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094521.687824:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941248 00000100:00100000:0.0:1784094521.687835:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941248 00000100:00100000:0.0:1784094521.687948:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1041 00000100:00100000:0.0:1784094521.687959:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+7:67017:x1870757013941248:12345-192.168.204.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784094521.688305:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67017:x1870757013941248:12345-192.168.204.57@tcp:501:mount.lustre.0 Request processed in 347us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094521.688313:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1041 00000100:00100000:0.0:1784094521.691840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094521.692009:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941376 00000100:00100000:1.0:1784094521.692019:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941376 00000100:00100000:1.0:1784094521.692113:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1042 00000100:00100000:1.0:1784094521.692123:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67017:x1870757013941376:12345-192.168.204.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784094521.692534:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67017:x1870757013941376:12345-192.168.204.57@tcp:503:mount.lustre.0 Request processed in 411us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.692542:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1042 00000100:00100000:1.0:1784094521.703839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094521.704042:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941504 00000100:00100000:0.0:1784094521.704053:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941504 00000100:00100000:0.0:1784094521.704119:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1043 00000100:00100000:0.0:1784094521.704130:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67036:x1870757013941504:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784094521.704536:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67036:x1870757013941504:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 406us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094521.704544:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1043 00000100:00100000:3.0:1784094521.738771:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094521.738833:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941632 00000100:00100000:1.0:1784094521.738845:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941632 00000100:00100000:1.0:1784094521.739733:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1044 00000100:00100000:1.0:1784094521.739754:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67036:x1870757013941632:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784094521.740855:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67036:x1870757013941632:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 1104us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.740864:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1044 00000100:00100000:3.0:1784094521.750945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.751116:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941760 00000100:00100000:2.0:1784094521.751126:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941760 00000100:00100000:2.0:1784094521.751186:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1045 00000100:00100000:2.0:1784094521.751196:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:67017:x1870757013941760:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784094521.751213:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094521.751233:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e41800/0x9ce98053214cd038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf6075 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094521.751261:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41800/0x9ce98053214cd038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6075 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094521.751272:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e41800/0x9ce98053214cd038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6075 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094521.751286:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e41800, rc 0) 00000100:00100000:2.0:1784094521.751344:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+9:67017:x1870757013941760:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 149us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.751351:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1045 00000100:00100000:3.0:1784094521.754306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094521.758214:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013941888 00000100:00100000:0.0:1784094521.758233:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013941888 00000100:00100000:0.0:1784094521.758315:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1046 00000100:00100000:0.0:1784094521.758328:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+9:67017:x1870757013941888:12345-192.168.204.57@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784094521.758357:0:5772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784094521.758386:0:5772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784094521.758391:0:5772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784094521.758394:0:5772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784094521.758397:0:5772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1784094521.761269:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+9:67017:x1870757013941888:12345-192.168.204.57@tcp:256:mount.lustre.0 Request processed in 2932us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094521.761284:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1046 00000100:00100000:3.0:1784094521.771756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094521.771867:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942016 00000100:00100000:1.0:1784094521.771878:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942016 00000100:00100000:1.0:1784094521.772055:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1047 00000100:00100000:1.0:1784094521.772067:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+9:67017:x1870757013942016:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784094521.772084:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094521.772108:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf607c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094521.772141:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 10 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094521.772152:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 10 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094521.772162:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12800, rc 0) 00000100:00100000:1.0:1784094521.772218:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67017:x1870757013942016:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 153us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.772225:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1047 00000100:00100000:3.0:1784094521.779007:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094521.779115:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942144 00000100:00100000:0.0:1784094521.779126:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942144 00000100:00100000:0.0:1784094521.779361:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1048 00000100:00100000:0.0:1784094521.779373:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67017:x1870757013942144:12345-192.168.204.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784094521.779727:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67017:x1870757013942144:12345-192.168.204.57@tcp:501:mount.lustre.0 Request processed in 356us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094521.779736:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1048 00000100:00100000:3.0:1784094521.782779:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094521.783202:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942272 00000100:00100000:1.0:1784094521.783220:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942272 00000100:00100000:1.0:1784094521.783290:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1049 00000100:00100000:1.0:1784094521.783301:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67017:x1870757013942272:12345-192.168.204.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784094521.784363:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67017:x1870757013942272:12345-192.168.204.57@tcp:503:mount.lustre.0 Request processed in 1060us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.784374:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1049 00000100:00100000:3.0:1784094521.795789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094521.796714:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942400 00000100:00100000:0.0:1784094521.796726:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942400 00000100:00100000:1.0:1784094521.796919:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1050 00000100:00100000:1.0:1784094521.796930:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67040:x1870757013942400:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784094521.797205:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67040:x1870757013942400:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 276us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.797214:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1050 00000100:00100000:3.0:1784094521.828256:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094521.828542:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942528 00000100:00100000:1.0:1784094521.828552:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942528 00000100:00100000:1.0:1784094521.828607:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1051 00000100:00100000:1.0:1784094521.828616:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67040:x1870757013942528:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784094521.828864:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67040:x1870757013942528:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 248us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.828872:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1051 00000100:00100000:3.0:1784094521.836590:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.836694:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942656 00000100:00100000:2.0:1784094521.836706:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942656 00000100:00100000:2.0:1784094521.836816:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1256 00000100:00100000:2.0:1784094521.836825:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1870757013942656:12345-192.168.204.57@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784094521.836855:0:5809:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 8d030ccd-515f-4c31-80a4-1407250e2bfc@192.168.204.57@tcp t0 exp 0000000000000000 cur 1682 last 0 00000020:00000080:2.0:1784094521.836902:0:5809:0:(genops.c:1406:class_connect()) connect: client 8d030ccd-515f-4c31-80a4-1407250e2bfc, cookie 0x9ce98053214cd046 00000004:00100000:2.0:1784094521.836957:0:5809:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784094521.837357:0:5809:0:(import.c:65:import_set_state_nolock()) ffff907225c88000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784094521.837659:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2351:x1870757013942656:12345-192.168.204.57@tcp:38:mount.lustre.0 Request processed in 832us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.837667:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1256 00000100:00100000:3.0:1784094521.848735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094521.848784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094521.848832:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942912 00000100:00100000:1.0:1784094521.848843:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942912 00000100:00100000:1.0:1784094521.848913:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013942784 00000100:00100000:1.0:1784094521.848917:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013942784 00000100:00100000:1.0:1784094521.848939:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1257 00000100:00100000:1.0:1784094521.848950:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d030ccd-515f-4c31-80a4-1407250e2bfc+7:67017:x1870757013942912:12345-192.168.204.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784094521.849002:0:5779:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784094521.849098:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d030ccd-515f-4c31-80a4-1407250e2bfc+7:67017:x1870757013942912:12345-192.168.204.57@tcp:41:mount.lustre.0 Request processed in 149us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.849106:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1257 00000100:00100000:1.0:1784094521.849121:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1258 00000100:00100000:1.0:1784094521.849128:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:0:x1870757013942784:12345-192.168.204.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784094521.849137:0:5779:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784094521.849157:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:0:x1870757013942784:12345-192.168.204.57@tcp:41:mount.lustre.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094521.849163:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1258 00000100:00080000:2.0:1784094521.849240:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094521.854293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.854411:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943040 00000100:00100000:2.0:1784094521.854462:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943040 00000100:00100000:2.0:1784094521.854521:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1259 00000100:00100000:2.0:1784094521.854532:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:67017:x1870757013943040:12345-192.168.204.57@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784094521.854639:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:67017:x1870757013943040:12345-192.168.204.57@tcp:40:mount.lustre.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.854647:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1259 00000100:00100000:3.0:1784094521.860256:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094521.860303:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.860465:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943168 00000100:00100000:2.0:1784094521.860475:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943168 00000100:00100000:2.0:1784094521.860521:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943296 00000100:00100000:2.0:1784094521.860524:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943296 00000100:00100000:2.0:1784094521.860553:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:2.0:1784094521.860561:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1870757013943168:12345-192.168.204.57@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784094521.860590:0:6573:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 8d030ccd-515f-4c31-80a4-1407250e2bfc@192.168.204.57@tcp t0 exp 0000000000000000 cur 1682 last 0 00000020:00000080:2.0:1784094521.860622:0:6573:0:(genops.c:1406:class_connect()) connect: client 8d030ccd-515f-4c31-80a4-1407250e2bfc, cookie 0x9ce98053214cd04d 00002000:00100000:2.0:1784094521.860671:0:6573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8d030ccd-515f-4c31-80a4-1407250e2bfc/ffff907225c8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784094521.860682:0:6573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784094521.860935:0:6573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784094521.860965:0:6573:0:(import.c:65:import_set_state_nolock()) ffff90720553b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784094521.861028:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2351:x1870757013943168:12345-192.168.204.57@tcp:8:mount.lustre.0 Request processed in 466us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.861036:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 650 00000100:00100000:2.0:1784094521.861054:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 651 00000100:00100000:2.0:1784094521.861059:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1870757013943296:12345-192.168.204.57@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784094521.861074:0:6573:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 8d030ccd-515f-4c31-80a4-1407250e2bfc@192.168.204.57@tcp t0 exp 0000000000000000 cur 1682 last 0 00000020:00000080:2.0:1784094521.861089:0:6573:0:(genops.c:1406:class_connect()) connect: client 8d030ccd-515f-4c31-80a4-1407250e2bfc, cookie 0x9ce98053214cd054 00002000:00100000:2.0:1784094521.861094:0:6573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8d030ccd-515f-4c31-80a4-1407250e2bfc/ffff9072090e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784094521.861109:0:6573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784094521.861237:0:6573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784094521.861254:0:6573:0:(import.c:65:import_set_state_nolock()) ffff9071021b2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784094521.861279:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2351:x1870757013943296:12345-192.168.204.57@tcp:8:mount.lustre.0 Request processed in 218us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.861285:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 651 00000100:00100000:3.0:1784094521.861805:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094521.862529:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943424 00000100:00100000:2.0:1784094521.862538:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943424 00000100:00100000:2.0:1784094521.862578:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 128 00000100:00100000:2.0:1784094521.862586:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907209aa0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:67017:x1870757013943424:12345-192.168.204.57@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784094521.862795:0:5781:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1784094521.863932:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907209aa0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:67017:x1870757013943424:12345-192.168.204.57@tcp:33:mount.lustre.0 Request processed in 1339us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094521.863944:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 128 00010000:00010000:0.0:1784094521.897892:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094522.125852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094522.126531:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943552 00000100:00100000:1.0:1784094522.126543:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943552 00000100:00100000:1.0:1784094522.126627:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1260 00000100:00100000:1.0:1784094522.126637:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:67060:x1870757013943552:12345-192.168.204.57@tcp:101:mkdir.0 00010000:00010000:1.0:1784094522.126660:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094522.126729:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cd05b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf60a6 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094522.126790:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cd062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094522.126806:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cd062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094522.126818:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cd062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784094522.127015:0:5777:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784094522.127020:0:5777:0:(mdt_handler.c:1579:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1784094522.127111:0:5777:0:(mdt_handler.c:2512:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cd062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094522.127135:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df13400/0x9ce98053214cd05b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60a6 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094522.127150:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cd062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60a6 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094522.127159:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784094522.127161:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094522.127165:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12400, rc 0) 00000100:00100000:1.0:1784094522.127233:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+7:67060:x1870757013943552:12345-192.168.204.57@tcp:101:mkdir.0 Request processed in 596us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094522.127240:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1260 00010000:00010000:3.0:1784094522.921967:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784094523.459569:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d030ccd-515f-4c31-80a4-1407250e2bfc 00000001:00100000:2.0:1784094523.463069:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d030ccd-515f-4c31-80a4-1407250e2bfc 00010000:00010000:0.0:1784094523.945707:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094524.246047:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094524.248248:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943680 00000100:00100000:1.0:1784094524.248264:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943680 00000100:00100000:1.0:1784094524.248383:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1261 00000100:00100000:1.0:1784094524.248395:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+7:67112:x1870757013943680:12345-192.168.204.57@tcp:41:lfs.0 00000004:00000024:1.0:1784094524.248473:0:5778:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784094524.248578:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+7:67112:x1870757013943680:12345-192.168.204.57@tcp:41:lfs.0 Request processed in 185us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094524.248596:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1261 00000100:00080000:2.0:1784094524.248680:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094524.254312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094524.257873:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943808 00000100:00100000:2.0:1784094524.257889:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943808 00000100:00100000:2.0:1784094524.257989:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 606 00000100:00100000:2.0:1784094524.258002:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:67112:x1870757013943808:12345-192.168.204.57@tcp:13:lfs.0 00002000:00000024:2.0:1784094524.258046:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094524.258133:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:67112:x1870757013943808:12345-192.168.204.57@tcp:13:lfs.0 Request processed in 133us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094524.258141:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 606 00000100:00080000:3.0:1784094524.259454:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094524.267179:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094524.267300:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013943936 00000100:00100000:2.0:1784094524.267310:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013943936 00000100:00100000:2.0:1784094524.267401:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00100000:2.0:1784094524.267414:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:67112:x1870757013943936:12345-192.168.204.57@tcp:13:lfs.0 00002000:00000024:2.0:1784094524.267485:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094524.267564:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071026bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:67112:x1870757013943936:12345-192.168.204.57@tcp:13:lfs.0 Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094524.267573:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 607 00000100:00080000:3.0:1784094524.267711:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094524.393783:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094524.393807:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024426368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094524.393887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094524.393904:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024426496:0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.393950:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024426624:0@lo:400:kworker.0 00000100:00100000:3.0:1784094524.393975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094524.393981:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426368 00000100:00100000:0.0:1784094524.393989:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426368 00000100:00100000:3.0:1784094524.394018:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024427008:0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394056:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1784094524.394061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094524.394065:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024426368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094524.394088:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00002000:00000024:0.0:1784094524.394089:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094524.394133:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024426368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094524.394140:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00080000:0.0:1784094524.394163:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094524.394175:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094524.394186:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024426240:0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394212:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024426368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094524.394214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094524.394233:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024426880:0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394242:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094524.394246:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024426752:0@lo:400:kworker.0 00000100:00100000:3.0:1784094524.394254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094524.394267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094524.394281:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427008 00000100:00100000:3.0:1784094524.394285:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427008 00000100:00100000:0.0:1784094524.394301:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426496 00000100:00100000:0.0:1784094524.394304:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426496 00000100:00100000:3.0:1784094524.394312:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426752 00000100:00100000:3.0:1784094524.394314:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426752 00000100:00100000:0.0:1784094524.394324:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426624 00000100:00100000:0.0:1784094524.394326:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426624 00000100:00100000:3.0:1784094524.394336:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1784094524.394343:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394343:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426880 00000100:00100000:0.0:1784094524.394345:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426880 00000100:00100000:0.0:1784094524.394358:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1784094524.394364:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024426496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094524.394377:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024427008:12345-0@lo:400:kworker.0 Request processed in 35us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094524.394388:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1784094524.394389:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024426496:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094524.394394:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1784094524.394399:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:0.0:1784094524.394403:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1784094524.394404:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394408:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024426624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394459:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723ca60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024426624:12345-0@lo:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094524.394465:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1784094524.394477:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1784094524.394482:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024426880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.394509:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024426880:12345-0@lo:400:kworker.0 Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094524.394515:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00080000:0.0:1784094524.394547:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094524.394551:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094524.394567:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024426624:0@lo:400:kworker.0 00000100:00100000:2.0:1784094524.394598:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024426880:0@lo:400:kworker.0 00000100:00100000:2.0:1784094524.394608:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024426496:0@lo:400:kworker.0 00000100:00100000:2.0:1784094524.394616:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024427008:0@lo:400:kworker.0 00000100:00100000:3.0:1784094524.394751:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024426752:12345-0@lo:400:kworker.0 Request processed in 345us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094524.394757:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1784094524.394840:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024426240 00000100:00100000:1.0:1784094524.394844:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024426240 00000100:00100000:1.0:1784094524.394880:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1784094524.394888:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024426240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094524.394934:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024426240:12345-0@lo:400:kworker.0 Request processed in 46us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094524.394940:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1784094524.398719:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024426240:0@lo:400:kworker.0 00000100:00100000:0.0:1784094524.398847:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024426752:0@lo:400:kworker.0 00010000:00010000:0.0:1784094524.973499:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784094524.986843:0:5800:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d030ccd-515f-4c31-80a4-1407250e2bfc 00010000:00010000:0.0:1784094525.993952:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094526.442700:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784094526.442727:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024427136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094526.442799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094526.442948:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427136 00000100:00100000:1.0:1784094526.442957:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427136 00000100:00100000:1.0:1784094526.443027:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1784094526.443037:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024427136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094526.443075:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094526.443129:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024427136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094526.443137:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1784094526.443181:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024427136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094526.443238:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1784094526.700595:0:110424:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784094527.028128:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094527.352934:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094527.353124:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094527.353165:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094527.353203:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094527.353239:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944320 00000100:00100000:0.0:1784094527.353249:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944320 00000100:00100000:0.0:1784094527.353306:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944448 00000100:00100000:0.0:1784094527.353309:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944448 00000100:00100000:0.0:1784094527.353346:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 888 00000100:00100000:0.0:1784094527.353358:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013944320:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094527.353466:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013944320:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094527.353474:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 888 00000100:00100000:0.0:1784094527.353506:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 889 00000100:00100000:0.0:1784094527.353514:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013944448:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094527.353551:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013944448:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 37us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094527.353557:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 889 00000100:00080000:0.0:1784094527.353575:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094527.353580:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094527.355201:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944192 00000100:00100000:3.0:1784094527.355214:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944192 00000100:00100000:3.0:1784094527.355297:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1171 00000100:00100000:3.0:1784094527.355309:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2354:x1870757013944192:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094527.355375:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2354:x1870757013944192:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 68us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094527.355382:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1171 00000100:00080000:0.0:1784094527.358148:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094527.362192:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944064 00000100:00100000:2.0:1784094527.362209:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944064 00000100:00100000:2.0:1784094527.362365:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1053 00000100:00100000:2.0:1784094527.362376:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:2354:x1870757013944064:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094527.362479:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:2354:x1870757013944064:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 104us (9558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094527.362488:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1053 00010000:00010000:0.0:1784094528.042592:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094529.065842:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094529.514834:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024427264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094529.514912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094529.514917:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094529.514936:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024427392:0@lo:400:kworker.0 00000100:00100000:0.0:1784094529.514981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094529.515038:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427264 00000100:00100000:0.0:1784094529.515047:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427264 00000100:00100000:2.0:1784094529.515076:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427392 00000100:00100000:2.0:1784094529.515082:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427392 00000100:00100000:0.0:1784094529.515109:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1784094529.515120:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024427264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094529.515135:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1784094529.515145:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024427392:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784094529.515161:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094529.515198:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024427392:12345-0@lo:400:kworker.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094529.515207:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1784094529.515218:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024427264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.515227:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00080000:0.0:1784094529.515251:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094529.515279:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024427392:0@lo:400:kworker.0 00000100:00100000:0.0:1784094529.515315:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024427264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094529.515372:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024427648:0@lo:400:kworker.0 00000100:00100000:0.0:1784094529.515401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094529.515418:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024427520:0@lo:400:kworker.0 00000100:00100000:0.0:1784094529.515460:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427648 00000100:00100000:0.0:1784094529.515464:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427648 00000100:00100000:0.0:1784094529.515515:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1784094529.515522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094529.515527:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024427648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094529.515559:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427520 00000100:00100000:2.0:1784094529.515564:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427520 00000100:00100000:2.0:1784094529.515588:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1784094529.515595:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024427520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094529.521647:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024427520:12345-0@lo:400:kworker.0 Request processed in 6039us (6112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094529.521664:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1784094529.521951:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024427520:0@lo:400:kworker.0 00000100:00080000:2.0:1784094529.522526:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094529.522620:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024427776:0@lo:400:kworker.0 00000100:00100000:3.0:1784094529.522676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094529.522761:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094529.522786:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024427904:0@lo:400:kworker.0 00000100:00100000:2.0:1784094529.522817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094529.522852:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427904 00000100:00100000:2.0:1784094529.522859:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427904 00000100:00100000:2.0:1784094529.522911:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1784094529.522920:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024427904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094529.522967:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024427904:12345-0@lo:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094529.522974:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00080000:2.0:1784094529.522991:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094529.523011:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024427904:0@lo:400:kworker.0 00000100:00100000:0.0:1784094529.523695:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024427648:12345-0@lo:400:kworker.0 Request processed in 8169us (8289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.523704:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1784094529.523746:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024427648:0@lo:400:kworker.0 00000100:00100000:0.0:1784094529.524803:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024427776 00000100:00100000:0.0:1784094529.524814:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024427776 00000100:00100000:0.0:1784094529.524920:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1784094529.524931:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024427776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784094529.527200:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094529.528181:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024427776:12345-0@lo:400:kworker.0 Request processed in 3247us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.528195:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:3.0:1784094529.534391:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024427776:0@lo:400:kworker.0 00000020:00000080:1.0:1784094529.609647:0:110572:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd60e5a720 20000000:00000080:1.0:1784094529.609662:0:110572:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90720bb14000 uarg=0000000000000000 20000000:01000000:1.0:1784094529.609704:0:110572:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784094529.609709:0:110572:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784094529.609712:0:110572:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784094529.610405:0:110573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1784094529.611001:0:110572:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784094529.622018:0:110572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784094529.622045:0:110572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622063:0:110572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622070:0:110572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd007 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622077:0:110572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd015 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622087:0:110572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 9 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622095:0:110572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622139:0:110572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 9 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622155:0:110572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 9 pid: 5771 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094529.622170:0:110572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428032:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094529.622279:0:110572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd015 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622287:0:110572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd015 expref: 18 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094529.622298:0:110572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428160:0@lo:104: 00000100:00100000:2.0:1784094529.622338:0:110572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784094529.622379:0:110572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd007 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622387:0:110572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd007 expref: 18 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094529.622394:0:110572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428288:0@lo:104: 00000100:00100000:2.0:1784094529.622413:0:110572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784094529.622465:0:110572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094529.622473:0:110572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 18 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094529.622491:0:110572:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428416:0@lo:104: 00000100:00100000:2.0:1784094529.622513:0:110572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094529.622527:0:110572:0:(client.c:2702:ptlrpc_set_wait()) set ffff90720a9bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1784094529.622767:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428160 00000100:00100000:0.0:1784094529.622775:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428160 00000100:00100000:0.0:1784094529.622893:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428288 00000100:00100000:0.0:1784094529.622897:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428288 00000100:00100000:0.0:1784094529.622908:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428416 00000100:00100000:0.0:1784094529.622911:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428416 00000100:00100000:0.0:1784094529.622924:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784094529.622934:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+5:110572:x1870757024428160:12345-0@lo:104: 00010000:00010000:0.0:1784094529.622946:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623051:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094529.623058:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+5:110572:x1870757024428160:12345-0@lo:104: Request processed in 125us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.623066:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1784094529.623083:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784094529.623090:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+4:110572:x1870757024428288:12345-0@lo:104: 00010000:00010000:0.0:1784094529.623098:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623133:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784094529.623139:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+4:110572:x1870757024428288:12345-0@lo:104: Request processed in 50us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.623144:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784094529.623157:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784094529.623163:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:110572:x1870757024428416:12345-0@lo:104: 00010000:00010000:0.0:1784094529.623171:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623202:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784094529.623207:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:110572:x1870757024428416:12345-0@lo:104: Request processed in 45us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.623216:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1784094529.623510:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784094529.623517:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623525:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094529.623529:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623538:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094529.623544:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094529.623549:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784094529.623580:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623587:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094529.623610:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623617:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41c00/0x9ce98053214cd015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd01c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623631:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784094529.623634:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623645:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094529.623647:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623654:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094529.623661:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094529.623666:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784094529.623679:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623685:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094529.623701:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623708:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e40800/0x9ce98053214cd007 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd00e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623718:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094529.623721:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623727:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77800 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094529.623730:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623739:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094529.623745:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094529.623750:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784094529.623762:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623767:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094529.623772:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.623777:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77800/0x9ce98053214ccff9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd000 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094529.623910:0:110572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428160:0@lo:104: 00000100:00100000:2.0:1784094529.623920:0:110572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428288:0@lo:104: 00000100:00100000:2.0:1784094529.623927:0:110572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428416:0@lo:104: 00010000:00010000:0.0:1784094529.624028:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094529.624031:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094529.624033:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094529.624040:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094529.624045:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094529.624058:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024428544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094529.624098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094529.624147:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024428672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094529.624171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094529.624192:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094529.624198:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024428800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094529.624222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094529.624250:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428544 00000100:00100000:0.0:1784094529.624255:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428544 00010000:00010000:0.0:1784094529.624278:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd015 expref: 19 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094529.624299:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428672 00000100:00100000:0.0:1784094529.624302:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428672 00010000:00010000:0.0:1784094529.624315:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd007 expref: 20 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094529.624332:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428800 00000100:00100000:0.0:1784094529.624335:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428800 00010000:00010000:0.0:1784094529.624345:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 21 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094529.624358:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1784094529.624364:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+21:3302:x1870757024428544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094529.624375:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094529.624379:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd015 expref: 21 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624387:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd015 expref: 21 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624399:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13e00/0x9ce98053214cd01c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd015 expref: 21 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624411:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094529.624726:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+20:3302:x1870757024428544:12345-0@lo:103:ldlm_bl.0 Request processed in 361us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.624736:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1784094529.624754:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1784094529.624763:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024428672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094529.624771:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094529.624775:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd007 expref: 19 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624796:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd007 expref: 19 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624806:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41e00/0x9ce98053214cd00e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd007 expref: 19 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624815:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094529.624855:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024428672:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.624861:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1784094529.624875:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1784094529.624882:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+17:3303:x1870757024428800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094529.624890:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094529.624894:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 17 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094529.624899:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024428672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094529.624905:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 17 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624918:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40c00/0x9ce98053214cd000 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccff9 expref: 17 pid: 5770 timeout: 1840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.624931:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094529.624966:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+16:3303:x1870757024428800:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094529.624973:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1784094529.625082:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024428800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094529.625111:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024428544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094529.630083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094529.630254:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944576 00000100:00100000:3.0:1784094529.630265:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944576 00010000:00010000:3.0:1784094529.630306:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 10 pid: 5771 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094529.630351:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 396 00000100:00100000:3.0:1784094529.630362:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:2353:x1870757013944576:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784094529.630377:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094529.630383:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 10 pid: 5771 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630490:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 10 pid: 5771 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630514:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630522:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630539:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630547:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630553:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630560:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630567:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094529.630572:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630579:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630588:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094529.630597:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094529.630658:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:2353:x1870757013944576:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 297us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094529.630666:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 396 00010000:00010000:2.0:1784094529.633747:0:110572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12800/0x9ce98053214cd03f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf607c expref: 9 pid: 5771 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094529.633770:0:110572:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110572:1870757024428032:192.168.204.57@tcp:104: 00010000:00010000:2.0:1784094529.633889:0:110572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.634474:0:110572:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.634493:0:110572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094529.634500:0:110572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40600/0x9ce98053214cd069 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094530.089627:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094531.118707:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094531.456418:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094531.456531:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944704 00000100:00100000:2.0:1784094531.456542:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944704 00000100:00100000:2.0:1784094531.456609:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1055 00000100:00100000:2.0:1784094531.456618:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+9:67032:x1870757013944704:12345-192.168.204.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094531.456635:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784094531.456655:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907101e40400/0x9ce98053214cd070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf60ad expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.456683:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40400/0x9ce98053214cd070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60ad expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.456694:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907101e40400/0x9ce98053214cd070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60ad expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.456704:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907101e40400, rc 0) 00000100:00100000:2.0:1784094531.456759:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67032:x1870757013944704:12345-192.168.204.57@tcp:101:ll_cfg_requeue.0 Request processed in 142us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094531.456766:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1055 00000100:00100000:1.0:1784094531.460680:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094531.462403:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944832 00000100:00100000:0.0:1784094531.462499:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944832 00000100:00100000:2.0:1784094531.467730:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1056 00000100:00100000:2.0:1784094531.467745:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67032:x1870757013944832:12345-192.168.204.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.468047:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67032:x1870757013944832:12345-192.168.204.57@tcp:501:ll_cfg_requeue.0 Request processed in 303us (7372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094531.468055:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1056 00000100:00100000:3.0:1784094531.473193:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094531.473284:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013944960 00000100:00100000:1.0:1784094531.473295:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013944960 00000100:00100000:1.0:1784094531.473358:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1057 00000100:00100000:1.0:1784094531.473369:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67032:x1870757013944960:12345-192.168.204.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784094531.473615:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:67032:x1870757013944960:12345-192.168.204.57@tcp:503:ll_cfg_requeue.0 Request processed in 247us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094531.473623:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1057 10000000:01000000:3.0:1784094531.561520:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784094531.561528:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff907237a1c800 from 10 10000000:01000000:3.0:1784094531.561534:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784094531.561566:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.561576:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.561588:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094531.561611:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094531.561680:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094531.561747:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90722a26c240 going to sleep for 11 seconds 00000100:00100000:0.0:1784094531.561764:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024428928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094531.561816:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429056 00000100:00100000:1.0:1784094531.561824:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429056 00000100:00100000:1.0:1784094531.561878:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1784094531.561886:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+16:5775:x1870757024429056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094531.561899:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094531.561914:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13a00/0x9ce98053214cd07e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd077 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094531.561935:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13a00/0x9ce98053214cd07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd077 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094531.561944:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13a00/0x9ce98053214cd07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd077 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094531.561954:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13a00, rc 0) 00000100:00100000:1.0:1784094531.561994:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024429056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094531.562001:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1784094531.562028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094531.562046:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094531.562059:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd07e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094531.562066:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024428928 00010000:00010000:1.0:1784094531.562068:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd07e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094531.562069:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024428928 00000100:00100000:0.0:1784094531.562117:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1784094531.562122:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784094531.562124:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024428928:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094531.562146:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1784094531.562150:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094531.562161:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710680e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784094531.562173:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429184 00000100:00100000:1.0:1784094531.562177:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429184 00000100:00100000:0.0:1784094531.562185:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024428928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094531.562191:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1784094531.562196:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1784094531.562201:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024429184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784094531.562224:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024428928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784094531.562460:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784094531.562464:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024429184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094531.562471:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1784094531.562499:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784094531.562526:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784094531.562563:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094531.562586:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710680e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094531.562599:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429312 00000100:00100000:2.0:1784094531.562603:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429312 00000100:00100000:2.0:1784094531.562703:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1784094531.562711:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024429312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.563485:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024429312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 773us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094531.563493:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1784094531.563644:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237377800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784094531.564993:0:110684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784094531.565984:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784094531.566011:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784094531.566022:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd07e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094531.566035:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68400/0x9ce98053214cd077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd07e expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094531.566047:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784094531.566050:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff90720a9c7800 from 10 10000000:01000000:0.0:1784094531.566053:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784094531.566156:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094531.566165:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094531.566175:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094531.566200:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094531.566340:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094531.566388:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094531.566499:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429440 00000100:00100000:3.0:1784094531.566507:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429440 00000100:00100000:3.0:1784094531.566549:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1784094531.566559:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+17:5775:x1870757024429440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094531.566572:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094531.566585:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68800/0x9ce98053214cd08c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd085 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.566608:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68800/0x9ce98053214cd08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd085 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.566620:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68800/0x9ce98053214cd08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd085 expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.566629:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68800, rc 0) 00000100:00100000:3.0:1784094531.566687:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024429440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094531.566695:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1784094531.566785:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094531.566799:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd08c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094531.566807:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd08c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094531.566854:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784094531.566879:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094531.566909:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784094531.566957:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429568 00000100:00100000:2.0:1784094531.566962:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429568 00000100:00100000:2.0:1784094531.567033:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1784094531.567041:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024429568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.567284:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024429568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094531.567291:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1784094531.567355:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784094531.567379:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784094531.567411:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094531.568855:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094531.569101:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429696 00000100:00100000:3.0:1784094531.569110:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429696 00000100:00100000:3.0:1784094531.569204:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1784094531.569213:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024429696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094531.569450:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024429696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094531.569458:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1784094531.569541:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784094531.571698:0:110685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784094531.571893:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784094531.571914:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784094531.571925:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd08c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.571937:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77200/0x9ce98053214cd085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd08c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094531.571948:0:5775:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784094531.571950:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff907210f89000 from 10 10000000:01000000:2.0:1784094531.571954:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784094531.571991:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.572000:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.572012:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094531.572038:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.573044:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094531.573088:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094531.573185:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429824 00000100:00100000:3.0:1784094531.573194:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429824 00000100:00100000:3.0:1784094531.573239:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1784094531.573248:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024429824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094531.573472:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094531.573488:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68a00/0x9ce98053214cd09a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd093 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.573562:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68a00/0x9ce98053214cd09a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd093 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.573574:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68a00/0x9ce98053214cd09a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd093 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094531.573583:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68a00, rc 0) 00000100:00100000:3.0:1784094531.573701:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024429824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 452us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094531.573861:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1784094531.573876:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094531.573893:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd09a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094531.573902:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd09a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094531.573971:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.573998:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094531.574030:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094531.576098:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024429952 00000100:00100000:3.0:1784094531.576112:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024429952 00000100:00100000:3.0:1784094531.576183:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1784094531.576194:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024429952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784094531.576523:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024429952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094531.576530:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1784094531.576677:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024429952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.576726:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024430080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784094531.576769:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094531.576895:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071025e4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784094531.576962:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430080 00000100:00100000:3.0:1784094531.576967:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430080 00000100:00100000:3.0:1784094531.577026:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1784094531.577033:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024430080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784094531.577186:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024430080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094531.577193:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1784094531.577256:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024430080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784094531.579885:0:110686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784094531.580078:0:5775:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784094531.580103:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784094531.580115:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd09a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094531.580127:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e40e00/0x9ce98053214cd093 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd09a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094532.138528:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094532.476125:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094532.476156:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094532.476180:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094532.476201:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094532.476307:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945088 00000100:00100000:3.0:1784094532.476318:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945088 00000100:00100000:3.0:1784094532.476366:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1067 00000100:00100000:3.0:1784094532.476375:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:2354:x1870757013945088:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094532.476706:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3b77607-df53-4cb2-a6b9-19cd645e31df+10:2354:x1870757013945088:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 331us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094532.476715:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1067 00000100:00100000:2.0:1784094532.476924:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945344 00000100:00100000:2.0:1784094532.476929:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945344 00000100:00100000:2.0:1784094532.476969:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945472 00000100:00100000:2.0:1784094532.476972:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945472 00000100:00100000:2.0:1784094532.476995:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 891 00000100:00100000:2.0:1784094532.477003:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013945344:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094532.477038:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013945344:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 36us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094532.477044:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 891 00000100:00100000:2.0:1784094532.477057:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 892 00000100:00100000:2.0:1784094532.477062:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013945472:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094532.477084:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2354:x1870757013945472:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 22us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094532.477090:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 892 00000100:00100000:2.0:1784094532.477107:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945216 00000100:00100000:2.0:1784094532.477110:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945216 00000100:00080000:3.0:1784094532.477142:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094532.477142:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1175 00000100:00080000:3.0:1784094532.477146:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784094532.477148:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094532.477149:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2354:x1870757013945216:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094532.477180:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2354:x1870757013945216:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094532.477186:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1175 00010000:00010000:0.0:1784094533.161631:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094534.187337:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784094534.215043:0:110773:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: finish setup 01:48:53 (1784094533) === 00000100:00100000:1.0:1784094534.633706:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094534.633734:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024430592:0@lo:400:kworker.0 00000100:00100000:2.0:1784094534.633745:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024430464:0@lo:400:kworker.0 00000100:00100000:3.0:1784094534.633847:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024430336:0@lo:400:kworker.0 00000100:00100000:0.0:1784094534.633893:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024430720:0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.636916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094534.636917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094534.637133:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430464 00000100:00100000:2.0:1784094534.637143:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430464 00000100:00100000:2.0:1784094534.637207:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1784094534.637219:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024430464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094534.637283:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024430464:12345-0@lo:400:kworker.0 Request processed in 68us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094534.637290:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:2.0:1784094534.637310:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094534.637451:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024430464:0@lo:400:kworker.0 00000100:00100000:2.0:1784094534.638111:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024430976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094534.638154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094534.638197:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430976 00000100:00100000:2.0:1784094534.638203:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430976 00000100:00100000:2.0:1784094534.638242:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1784094534.638250:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024430976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094534.638280:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094534.638321:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024430976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094534.638328:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00080000:2.0:1784094534.638347:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094534.638370:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024430976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094534.638418:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430592 00000100:00100000:2.0:1784094534.638934:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430592 00000100:00100000:3.0:1784094534.639707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094534.641770:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024430208:0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.641834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094534.641900:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430208 00000100:00100000:1.0:1784094534.641908:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430208 00000100:00100000:1.0:1784094534.641953:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1784094534.641962:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024430208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.642016:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024430208:12345-0@lo:400:kworker.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094534.642024:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1784094534.642088:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024430208:0@lo:400:kworker.0 00000100:00100000:3.0:1784094534.642958:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024430848:0@lo:400:kworker.0 00000100:00100000:3.0:1784094534.642999:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784094534.643048:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094534.643073:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430336 00000100:00100000:3.0:1784094534.643079:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430336 00000100:00100000:3.0:1784094534.643114:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1784094534.643122:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024430336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094534.643171:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024430336:12345-0@lo:400:kworker.0 Request processed in 50us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094534.643178:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1784094534.643231:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024430336:0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.643719:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430848 00000100:00100000:1.0:1784094534.643725:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430848 00000100:00100000:1.0:1784094534.643772:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1784094534.643779:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024430848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.643827:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024430848:12345-0@lo:400:kworker.0 Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094534.643832:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1784094534.643864:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024430848:0@lo:400:kworker.0 00000100:00100000:0.0:1784094534.647291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094534.647845:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1784094534.647861:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094534.647938:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024430592:12345-0@lo:400:kworker.0 Request processed in 82us (11032us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094534.648158:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:0.0:1784094534.648171:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024430592:0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.649740:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024430720 00000100:00100000:1.0:1784094534.649754:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024430720 00000100:00100000:1.0:1784094534.649843:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1784094534.649853:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024430720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094534.649942:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024430720:12345-0@lo:400:kworker.0 Request processed in 91us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094534.649950:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1784094534.650018:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024430720:0@lo:400:kworker.0 00000100:00080000:3.0:1784094534.650189:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784094535.209920:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094535.717411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094535.717499:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094535.717578:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094535.717628:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945600 00000100:00100000:0.0:1784094535.717637:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945600 00000100:00100000:0.0:1784094535.717696:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 652 00000100:00100000:0.0:1784094535.717717:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2351:x1870757013945600:12345-192.168.204.57@tcp:9:umount.0 00000020:00000080:0.0:1784094535.717745:0:8031:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cd054 00000100:00080000:0.0:1784094535.717754:0:8031:0:(import.c:65:import_set_state_nolock()) ffff9071021b2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784094535.717789:0:8031:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1784094535.718045:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8d030ccd-515f-4c31-80a4-1407250e2bfc+2:2351:x1870757013945600:12345-192.168.204.57@tcp:9:umount.0 Request processed in 341us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094535.718053:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 652 00010000:00010000:0.0:1784094535.718075:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784094535.718168:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094535.721570:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945728 00000100:00100000:2.0:1784094535.721586:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945728 00000100:00100000:0.0:1784094535.721672:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945984 00000100:00100000:0.0:1784094535.721678:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945984 00000100:00100000:0.0:1784094535.721732:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 22 00000100:00100000:0.0:1784094535.721742:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210b86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3b77607-df53-4cb2-a6b9-19cd645e31df+11:2352:x1870757013945728:12345-192.168.204.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784094535.721756:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 23 00010000:00010000:0.0:1784094535.721760:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784094535.721765:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3b77607-df53-4cb2-a6b9-19cd645e31df+11:2352:x1870757013945984:12345-192.168.204.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784094535.721773:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094535.721780:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40400/0x9ce98053214cd070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60ad expref: 11 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094535.721780:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cd031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf604b expref: 11 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094535.721798:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784094535.721805:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094535.721888:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210b86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3b77607-df53-4cb2-a6b9-19cd645e31df+9:2352:x1870757013945728:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 147us (4387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094535.721896:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 22 00000100:00100000:1.0:1784094535.725406:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:2352:x1870757013945984:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 3623us (7807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094535.725443:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 23 00000100:00100000:3.0:1784094535.725447:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094535.725476:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013945856 00000100:00100000:3.0:1784094535.725478:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094535.725483:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013945856 00000100:00100000:3.0:1784094535.725504:0:6573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013946112 00000100:00100000:3.0:1784094535.725507:0:6573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013946112 00000100:00100000:1.0:1784094535.725529:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 24 00000100:00100000:1.0:1784094535.725537:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3b77607-df53-4cb2-a6b9-19cd645e31df+8:2352:x1870757013945856:12345-192.168.204.57@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784094535.725540:0:6573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 653 00000100:00100000:3.0:1784094535.725545:0:6573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2351:x1870757013946112:12345-192.168.204.57@tcp:9:umount.0 00010000:00010000:1.0:1784094535.725549:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094535.725568:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41800/0x9ce98053214cd038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6075 expref: 8 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784094535.725570:0:6573:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cd04d 00000100:00080000:3.0:1784094535.725577:0:6573:0:(import.c:65:import_set_state_nolock()) ffff90720553b000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784094535.725585:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1784094535.725610:0:6573:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1784094535.725612:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3b77607-df53-4cb2-a6b9-19cd645e31df+7:2352:x1870757013945856:12345-192.168.204.57@tcp:103:ldlm_bl.0 Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094535.725618:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 24 00000100:00080000:1.0:1784094535.725657:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784094535.725670:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094535.725844:0:6573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d030ccd-515f-4c31-80a4-1407250e2bfc+2:2351:x1870757013946112:12345-192.168.204.57@tcp:9:umount.0 Request processed in 297us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094535.725851:0:6573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 653 00000100:00100000:0.0:1784094535.764270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094535.768737:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013946368 00000100:00100000:2.0:1784094535.768750:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013946368 00000100:00080000:1.0:1784094535.768901:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094535.768946:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1262 00000100:00100000:2.0:1784094535.768956:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d030ccd-515f-4c31-80a4-1407250e2bfc+6:2351:x1870757013946368:12345-192.168.204.57@tcp:39:umount.0 00000020:00000080:2.0:1784094535.768989:0:5779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cd046 00000020:00010000:2.0:1784094535.768996:0:5779:0:(genops.c:1942:obd_stale_export_put()) Put export ffff907225c89800: total 0 00000100:00080000:2.0:1784094535.769001:0:5779:0:(import.c:65:import_set_state_nolock()) ffff907225c88000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784094535.769032:0:5779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967777 00000100:00100000:2.0:1784094535.769415:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d030ccd-515f-4c31-80a4-1407250e2bfc+5:2351:x1870757013946368:12345-192.168.204.57@tcp:39:umount.0 Request processed in 459us (5155us total) trans 4294967778 rc 0/0 00000100:00100000:2.0:1784094535.769444:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1262 00000020:00010000:1.0:1784094535.769494:0:7456:0:(genops.c:1928:obd_stale_export_get()) Get export ffff907225c89800: total 0 00010000:00010000:1.0:1784094535.769533:0:7456:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907225c89800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784094535.769562:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907219c12100) 00010000:00010000:1.0:1784094535.769565:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784094535.769572:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90723df12400/0x9ce98053214cd062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60a6 expref: 4 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094535.769594:0:7456:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907225c89800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784094535.769602:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094535.769604:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094535.769606:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094535.787036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094535.787654:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013946624 00000100:00100000:3.0:1784094535.787665:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013946624 00000100:00100000:3.0:1784094535.787848:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1069 00000100:00100000:3.0:1784094535.787861:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+7:2351:x1870757013946624:12345-192.168.204.57@tcp:251:umount.0 00000020:00000080:3.0:1784094535.787901:0:5772:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cd023 00000020:00010000:3.0:1784094535.787910:0:5772:0:(genops.c:1942:obd_stale_export_put()) Put export ffff907225c8c000: total 0 00000100:00080000:3.0:1784094535.787915:0:5772:0:(import.c:65:import_set_state_nolock()) ffff907225c8e800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784094535.787998:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3b77607-df53-4cb2-a6b9-19cd645e31df+3:2351:x1870757013946624:12345-192.168.204.57@tcp:251:umount.0 Request processed in 139us (972us total) trans 0 rc 0/0 00000020:00010000:0.0:1784094535.788091:0:11170:0:(genops.c:1928:obd_stale_export_get()) Get export ffff907225c8c000: total 0 00010000:00010000:0.0:1784094535.788096:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094535.788154:0:11170:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907225c8c000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784094535.788193:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214cd02a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf6044 expref: 3 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094535.788209:0:11170:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907225c8c000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784094535.788233:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094535.788235:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094535.788237:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094535.788631:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1069 00000020:00000080:3.0:1784094535.788645:0:5772:0:(genops.c:906:class_export_put()) final put ffff907225c8c000/e3b77607-df53-4cb2-a6b9-19cd645e31df 00000020:00000080:0.0:1784094535.789383:0:73479:0:(genops.c:865:class_export_destroy()) destroying export ffff907225c8c000/e3b77607-df53-4cb2-a6b9-19cd645e31df for MGS 00000020:00000080:0.0:1784094535.789441:0:73479:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907225c8e800 for MGS 00010000:00010000:0.0:1784094536.236560:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094536.681756:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024431104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784094536.681827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094536.682006:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431104 00000100:00100000:0.0:1784094536.682015:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431104 00000100:00100000:0.0:1784094536.682085:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1784094536.682096:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024431104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094536.682133:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094536.682184:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024431104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094536.682192:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1784094536.682236:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024431104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784094536.682321:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784094537.257720:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094538.282933:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094538.295361:0:110919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc80f852c0 20000000:00000080:2.0:1784094538.295379:0:110919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907237b32400 uarg=0000000000000000 10000000:01000000:1.0:1784094538.340851:0:110919:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094538.340877:0:110919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094538.340896:0:110919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094538.340904:0:110919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094538.340945:0:110919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094538.340963:0:110919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 18 pid: 5771 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094538.340978:0:110919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110919:1870757024431232:0@lo:104: 00000100:00100000:1.0:1784094538.341046:0:110919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094538.341187:0:110919:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710680e840 going to sleep for 11 seconds 00000100:00100000:3.0:1784094538.341339:0:5761:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784094538.341354:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431232 00000100:00100000:3.0:1784094538.341362:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431232 00000100:00100000:3.0:1784094538.341644:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1784094538.341655:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:110919:x1870757024431232:12345-0@lo:104: 00010000:00010000:3.0:1784094538.341668:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.341732:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094538.341738:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:110919:x1870757024431232:12345-0@lo:104: Request processed in 87us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094538.341745:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1784094538.341837:0:110919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237374380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110919:1870757024431232:0@lo:104: 00010000:00010000:2.0:1784094538.341855:0:110919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.341951:0:11170:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094538.341957:0:11170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.341965:0:11170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094538.341969:0:11170:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.341977:0:11170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094538.341984:0:11170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094538.341989:0:11170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094538.342057:0:11170:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342064:0:11170:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094538.342095:0:11170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342103:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214ccfc8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214ccfcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342120:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094538.342122:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094538.342124:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094538.342353:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784094538.342366:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024431360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094538.342404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094538.342505:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431360 00000100:00100000:3.0:1784094538.342511:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431360 00010000:00010000:3.0:1784094538.342588:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 19 pid: 5771 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094538.342659:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1784094538.342667:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024431360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094538.342678:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094538.342684:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 19 pid: 5771 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342695:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 19 pid: 5771 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342708:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69c00/0x9ce98053214ccfcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214ccfc8 expref: 19 pid: 5771 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342722:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342730:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342743:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342749:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342755:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342760:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342765:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094538.342768:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342775:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342788:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094538.342797:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094538.342830:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024431360:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094538.342838:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00010000:00010000:2.0:1784094538.342975:0:110919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094538.342983:0:110919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094538.342989:0:110919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12200/0x9ce98053214cd0a1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094538.344059:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024431360:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1784094538.801091:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d030ccd-515f-4c31-80a4-1407250e2bfc 00000020:00000080:2.0:1784094538.801100:0:7469:0:(genops.c:906:class_export_put()) final put ffff9072090e7800/8d030ccd-515f-4c31-80a4-1407250e2bfc 00000020:00000080:1.0:1784094538.804379:0:110648:0:(genops.c:865:class_export_destroy()) destroying export ffff9072090e7800/8d030ccd-515f-4c31-80a4-1407250e2bfc for lustre-OST0001 00000020:00000080:1.0:1784094538.806911:0:110648:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9071021b2000 for lustre-OST0001 00000001:00100000:3.0:1784094538.844615:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d030ccd-515f-4c31-80a4-1407250e2bfc 00000020:00000080:3.0:1784094538.844624:0:6598:0:(genops.c:906:class_export_put()) final put ffff907225c8d000/8d030ccd-515f-4c31-80a4-1407250e2bfc 00000020:00000080:3.0:1784094538.844648:0:73479:0:(genops.c:865:class_export_destroy()) destroying export ffff907225c8d000/8d030ccd-515f-4c31-80a4-1407250e2bfc for lustre-OST0000 00000020:00000080:3.0:1784094538.844688:0:73479:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff90720553b000 for lustre-OST0000 00000020:00000080:0.0:1784094539.103078:0:110969:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5a8d3e30 20000000:00000080:0.0:1784094539.103096:0:110969:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907202c2fc00 uarg=0000000000000000 10000000:01000000:0.0:1784094539.106074:0:110969:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094539.106104:0:110969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106188:0:110969:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106205:0:110969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106212:0:110969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106220:0:110969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106227:0:110969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106234:0:110969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094539.106239:0:110969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106247:0:110969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106260:0:110969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106268:0:110969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.106274:0:110969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76800/0x9ce98053214cd0a8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.305804:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784094539.434583:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1784094539.434592:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:0.0:1784094539.434597:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784094539.434644:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.434655:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.434665:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094539.434690:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024431488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784094539.434760:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094539.434828:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071063210c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784094539.434909:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431488 00000100:00100000:1.0:1784094539.434917:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431488 00000100:00100000:1.0:1784094539.434967:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1784094539.434977:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024431488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094539.434992:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094539.435005:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd0af expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.435028:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd0af expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.435040:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd0af expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.435048:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13000, rc 0) 00000100:00100000:1.0:1784094539.435097:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024431488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094539.435103:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1784094539.435368:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024431488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094539.435384:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.435393:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094539.435412:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094539.435417:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.435493:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094539.756716:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094539.756739:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024431616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094539.756809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094539.756876:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431616 00000100:00100000:2.0:1784094539.756883:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431616 00000100:00100000:2.0:1784094539.756940:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1784094539.756950:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024431616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094539.756985:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094539.757035:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024431616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094539.757043:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:2.0:1784094539.757063:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094539.757108:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024431616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094539.757303:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024431872:0@lo:400:kworker.0 00000100:00100000:3.0:1784094539.757338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094539.757361:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094539.757366:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024432000:0@lo:400:kworker.0 00000100:00100000:3.0:1784094539.757391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094539.757415:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431872 00000100:00100000:3.0:1784094539.757434:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431872 00000100:00100000:3.0:1784094539.757473:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1784094539.757480:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024431872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094539.757517:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024431872:12345-0@lo:400:kworker.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094539.757523:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1784094539.757555:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024431872:0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.757687:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432000 00000100:00100000:2.0:1784094539.757692:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432000 00000100:00100000:2.0:1784094539.757739:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:2.0:1784094539.757746:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.757796:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024432000:12345-0@lo:400:kworker.0 Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094539.757803:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00080000:2.0:1784094539.757821:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094539.757825:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094539.757858:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024432000:0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.757883:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024431744:0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.757908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094539.757927:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784094539.757933:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024432128:0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.757953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094539.757976:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024431744 00000100:00100000:2.0:1784094539.757979:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024431744 00000100:00100000:2.0:1784094539.758000:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432128 00000100:00100000:2.0:1784094539.758002:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432128 00000100:00100000:2.0:1784094539.758027:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1784094539.758034:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024431744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.758072:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1870757024431744:12345-0@lo:400:kworker.0 Request processed in 39us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094539.758079:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1784094539.758091:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1784094539.758192:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024432128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.758222:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024432128:12345-0@lo:400:kworker.0 Request processed in 126us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094539.758228:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00080000:2.0:1784094539.758249:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094539.758268:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230e4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024432128:0@lo:400:kworker.0 00000100:00100000:2.0:1784094539.758277:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723e26fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1870757024431744:0@lo:400:kworker.0 00000020:00000080:1.0:1784094539.849074:0:111017:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9eee70a0 20000000:00000080:1.0:1784094539.849325:0:111017:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101391c00 uarg=0000000000000000 10000000:01000000:1.0:1784094539.849608:0:111017:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094539.849627:0:111017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.849644:0:111017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd0af expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.849653:0:111017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.849692:0:111017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd0af expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094539.849705:0:111017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd0af expref: 18 pid: 5770 timeout: 1850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094539.849720:0:111017:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111017:1870757024432256:0@lo:104: 00000100:00100000:1.0:1784094539.849781:0:111017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094539.849914:0:111017:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710680e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784094539.850002:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432256 00000100:00100000:2.0:1784094539.850010:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432256 00000100:00100000:2.0:1784094539.850090:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1784094539.850112:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:111017:x1870757024432256:12345-0@lo:104: 00010000:00010000:2.0:1784094539.850236:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094539.850355:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094539.850362:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237374380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:111017:x1870757024432256:12345-0@lo:104: Request processed in 253us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094539.850373:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:3.0:1784094539.850414:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094539.850435:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850444:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094539.850449:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850459:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094539.850466:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094539.850472:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094539.850504:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850510:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094539.850531:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850538:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723de77000/0x9ce98053214cd0af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0b6 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850553:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094539.850554:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094539.850556:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094539.850569:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094539.850578:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024432384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094539.850609:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094539.850637:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432384 00000100:00100000:3.0:1784094539.850641:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432384 00010000:00010000:3.0:1784094539.850659:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd0af expref: 19 pid: 5770 timeout: 1850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094539.850682:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1784094539.850688:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024432384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094539.850698:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094539.850704:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd0af expref: 19 pid: 5770 timeout: 1850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850713:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd0af expref: 19 pid: 5770 timeout: 1850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850729:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850735:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850747:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850753:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850759:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850765:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850770:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df13600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094539.850774:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850781:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850790:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094539.850799:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094539.850827:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024432384:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094539.850835:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1784094539.850871:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024432384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094539.851346:0:111017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13000/0x9ce98053214cd0b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd0af expref: 18 pid: 5770 timeout: 1850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094539.851363:0:111017:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111017:1870757024432256:0@lo:104: 00010000:00010000:0.0:1784094539.851377:0:111017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.851385:0:111017:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.851391:0:111017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094539.851396:0:111017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13600/0x9ce98053214cd0bd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1784094540.332199:0:5800:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d030ccd-515f-4c31-80a4-1407250e2bfc 00000001:00080000:0.0:1784094540.332212:0:5800:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967778 is committed 00000020:00000080:0.0:1784094540.332217:0:5800:0:(genops.c:906:class_export_put()) final put ffff907225c89800/8d030ccd-515f-4c31-80a4-1407250e2bfc 00000020:00000080:1.0:1784094540.332273:0:110648:0:(genops.c:865:class_export_destroy()) destroying export ffff907225c89800/8d030ccd-515f-4c31-80a4-1407250e2bfc for lustre-MDT0000 00000020:00000080:1.0:1784094540.332411:0:110648:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff907225c88000 for lustre-MDT0000 00010000:00010000:2.0:1784094540.332748:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784094540.646588:0:111066:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefe5ef780 20000000:00000080:1.0:1784094540.646605:0:111066:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101393c00 uarg=0000000000000000 10000000:01000000:1.0:1784094540.647087:0:111066:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1784094540.647109:0:111066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647125:0:111066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647135:0:111066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647141:0:111066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647147:0:111066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647154:0:111066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647160:0:111066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094540.647164:0:111066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647171:0:111066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647198:0:111066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647206:0:111066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094540.647212:0:111066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12400/0x9ce98053214cd0c4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094541.035773:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094541.035793:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094541.035799:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094541.035852:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094541.035864:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094541.035876:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094541.035909:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024432512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094541.035984:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094541.036117:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90723d2b2480 going to sleep for 11 seconds 00000100:00100000:1.0:1784094541.036392:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432512 00000100:00100000:1.0:1784094541.036401:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432512 00000100:00100000:1.0:1784094541.036814:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1784094541.036825:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024432512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094541.036839:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094541.036856:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd0cb expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094541.036879:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094541.036906:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094541.036915:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12600, rc 0) 00000100:00100000:1.0:1784094541.036974:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024432512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094541.036980:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1784094541.037189:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024432512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094541.037206:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094541.037215:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094541.037235:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094541.037241:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094541.037248:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094541.353708:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094541.802369:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784094541.802390:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024432640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784094541.802476:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094541.802630:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432640 00000100:00100000:1.0:1784094541.802639:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432640 00000100:00100000:1.0:1784094541.802702:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1784094541.802722:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024432640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784094541.802909:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094541.802969:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024432640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094541.802977:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1784094541.803188:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024432640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784094541.803258:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784094542.383520:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094543.401834:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094543.711043:0:111261:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6a6239c0 20000000:00000080:2.0:1784094543.711060:0:111261:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e3a7c00 uarg=0000000000000000 10000000:01000000:2.0:1784094543.711517:0:111261:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094543.711538:0:111261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.711558:0:111261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.711568:0:111261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.711606:0:111261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.711619:0:111261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 18 pid: 5772 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094543.711633:0:111261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111261:1870757024432768:0@lo:104: 00000100:00100000:2.0:1784094543.711694:0:111261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094543.711746:0:111261:0:(client.c:2702:ptlrpc_set_wait()) set ffff907219d8f180 going to sleep for 11 seconds 00000100:00100000:3.0:1784094543.711811:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432768 00000100:00100000:3.0:1784094543.711818:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432768 00000100:00100000:3.0:1784094543.711873:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784094543.711884:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:111261:x1870757024432768:12345-0@lo:104: 00010000:00010000:3.0:1784094543.711896:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094543.711962:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784094543.711969:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:111261:x1870757024432768:12345-0@lo:104: Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094543.711975:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1784094543.712064:0:111261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111261:1870757024432768:0@lo:104: 00010000:00010000:0.0:1784094543.712072:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094543.712081:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.712084:0:111261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712096:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69c00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094543.712102:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712112:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094543.712120:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094543.712125:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094543.712159:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712165:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094543.712257:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712266:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69c00/0x9ce98053214cd0cb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0d2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094543.712277:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1784094543.712289:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094543.712293:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024432896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094543.712293:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094543.712297:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094543.712329:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094543.712388:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024432896 00000100:00100000:0.0:1784094543.712393:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024432896 00010000:00010000:0.0:1784094543.712413:0:5764:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 19 pid: 5772 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094543.712527:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1784094543.712545:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024432896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094543.712557:0:5764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094543.712563:0:5764:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 19 pid: 5772 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712574:0:5764:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 19 pid: 5772 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712589:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df12600/0x9ce98053214cd0d2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd0cb expref: 19 pid: 5772 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712602:0:5764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712611:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712624:0:5764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712637:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712645:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.712651:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.713772:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e40200 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094543.713838:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.714260:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.714284:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094543.714299:0:5764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784094543.714315:0:111261:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.714326:0:111261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094543.714334:0:111261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e40200/0x9ce98053214cd0d9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094543.714374:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024432896:12345-0@lo:103:ldlm_bl.0 Request processed in 1838us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094543.714384:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1784094543.715194:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024432896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094544.429086:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094544.873557:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094544.873579:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094544.873642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094544.873707:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433024 00000100:00100000:1.0:1784094544.873714:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433024 00000100:00100000:1.0:1784094544.873895:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1784094544.873905:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024433024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094544.873940:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094544.873996:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024433024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094544.874004:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00080000:1.0:1784094544.874037:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784094544.875293:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784094544.875868:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024433152:0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.875920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094544.875982:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094544.875991:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024433280:0@lo:400:kworker.0 00000100:00100000:3.0:1784094544.876082:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433152 00000100:00100000:3.0:1784094544.876090:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433152 00000100:00100000:2.0:1784094544.876114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094544.876171:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024433408:0@lo:400:kworker.0 00000100:00100000:3.0:1784094544.876182:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1784094544.876205:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024433152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876213:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094544.876248:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433280 00000100:00100000:2.0:1784094544.876252:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433280 00000100:00100000:3.0:1784094544.876268:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024433152:12345-0@lo:400:kworker.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094544.876277:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1784094544.876284:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433408 00000100:00100000:2.0:1784094544.876289:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433408 00000100:00100000:2.0:1784094544.876319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1784094544.876325:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024433280:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094544.876361:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094544.876368:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024433280:12345-0@lo:400:kworker.0 Request processed in 42us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094544.876377:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1784094544.876391:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1784094544.876397:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024433408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876458:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1870757024433408:12345-0@lo:400:kworker.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094544.876465:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1784094544.876496:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1870757024433408:0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876576:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024433280:0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876615:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024433536:0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876640:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094544.876670:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433536 00000100:00100000:0.0:1784094544.876676:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433536 00000100:00100000:2.0:1784094544.876691:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094544.876699:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024433664:0@lo:400:kworker.0 00000100:00100000:0.0:1784094544.876720:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1784094544.876725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094544.876732:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024433536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876754:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433664 00000100:00100000:0.0:1784094544.876780:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710134ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024433536:12345-0@lo:400:kworker.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094544.876788:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00080000:0.0:1784094544.876804:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784094544.876824:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433664 00000100:00100000:3.0:1784094544.876852:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024433152:0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876868:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1784094544.876877:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024433664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876912:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1870757024433664:12345-0@lo:400:kworker.0 Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00080000:0.0:1784094544.876917:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094544.876921:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1784094544.876955:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d23ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1870757024433664:0@lo:400:kworker.0 00000100:00100000:2.0:1784094544.876964:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90710134ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024433536:0@lo:400:kworker.0 10000000:01000000:3.0:1784094545.065584:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094545.065594:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094545.065601:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094545.065661:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094545.065674:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094545.065686:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094545.065723:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024433792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094545.065824:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094545.065927:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072374f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094545.066236:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433792 00000100:00100000:1.0:1784094545.066244:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433792 00000100:00100000:1.0:1784094545.066310:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1784094545.066322:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024433792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784094545.066337:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094545.066354:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd0e0 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094545.066387:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094545.066401:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094545.066409:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df13200, rc 0) 00000100:00100000:1.0:1784094545.066481:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024433792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094545.066487:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1784094545.066630:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024433792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094545.066642:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094545.066649:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094545.066664:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094545.066667:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094545.066672:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094545.449913:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094546.098500:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094546.098704:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013946752 00000100:00100000:3.0:1784094546.098714:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013946752 00000100:00100000:3.0:1784094546.098755:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1074 00000100:00100000:3.0:1784094546.098763:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1870757013946752:12345-192.168.204.57@tcp:250:mount.lustre.0 00010000:00080000:3.0:1784094546.098792:0:5771:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff@192.168.204.57@tcp t0 exp 0000000000000000 cur 1707 last 0 00000020:00000080:3.0:1784094546.098924:0:5771:0:(genops.c:1406:class_connect()) connect: client b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff, cookie 0x9ce98053214cd0ee 00000100:00080000:3.0:1784094546.098966:0:5771:0:(import.c:65:import_set_state_nolock()) ffff907101d65000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784094546.099030:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+5:2351:x1870757013946752:12345-192.168.204.57@tcp:250:mount.lustre.0 Request processed in 266us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094546.099041:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1074 00000100:00100000:2.0:1784094546.114153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.114232:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013946880 00000100:00100000:0.0:1784094546.114243:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013946880 00000100:00100000:0.0:1784094546.114300:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1075 00000100:00100000:0.0:1784094546.114310:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+5:68093:x1870757013946880:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784094546.114329:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094546.114348:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77000/0x9ce98053214cd0f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf60c2 expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.114378:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77000/0x9ce98053214cd0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60c2 expref: 6 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.114389:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77000/0x9ce98053214cd0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60c2 expref: 6 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.114399:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77000, rc 0) 00000100:00100000:0.0:1784094546.114474:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+6:68093:x1870757013946880:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 165us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.114482:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1075 00000100:00100000:0.0:1784094546.117396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:3.0:1784094546.119739:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947008 00000100:00100000:3.0:1784094546.119752:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947008 00000100:00100000:0.0:1784094546.122750:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1076 00000100:00100000:0.0:1784094546.122764:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+6:68093:x1870757013947008:12345-192.168.204.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784094546.123705:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+6:68093:x1870757013947008:12345-192.168.204.57@tcp:501:mount.lustre.0 Request processed in 939us (6315us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784094546.123715:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1076 00000100:00100000:2.0:1784094546.132651:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094546.134121:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947136 00000100:00100000:1.0:1784094546.134134:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947136 00000100:00100000:1.0:1784094546.134216:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1077 00000100:00100000:1.0:1784094546.134226:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+6:68093:x1870757013947136:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784094546.134242:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784094546.134260:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723df12000/0x9ce98053214cd0fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf60c9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094546.134289:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723df12000/0x9ce98053214cd0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60c9 expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094546.134300:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723df12000/0x9ce98053214cd0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60c9 expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094546.134310:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723df12000, rc 0) 00000100:00100000:1.0:1784094546.134375:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+7:68093:x1870757013947136:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 151us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.134382:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1077 00000100:00100000:2.0:1784094546.139138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.139239:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947264 00000100:00100000:0.0:1784094546.139249:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947264 00000100:00100000:0.0:1784094546.139310:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1078 00000100:00100000:0.0:1784094546.139320:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+7:68093:x1870757013947264:12345-192.168.204.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784094546.141440:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072260fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68093:x1870757013947264:12345-192.168.204.57@tcp:501:mount.lustre.0 Request processed in 2066us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.141457:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1078 00000100:00100000:2.0:1784094546.144093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.144199:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947392 00000100:00100000:0.0:1784094546.144209:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947392 00000100:00100000:0.0:1784094546.144317:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1079 00000100:00100000:0.0:1784094546.144330:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68093:x1870757013947392:12345-192.168.204.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784094546.144753:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68093:x1870757013947392:12345-192.168.204.57@tcp:503:mount.lustre.0 Request processed in 424us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.144763:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1079 00000100:00100000:2.0:1784094546.148256:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.148345:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947520 00000100:00100000:0.0:1784094546.148355:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947520 00000100:00100000:0.0:1784094546.148483:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1080 00000100:00100000:0.0:1784094546.148505:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68112:x1870757013947520:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784094546.148784:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68112:x1870757013947520:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 291us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.148792:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1080 00000100:00100000:2.0:1784094546.163894:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.164468:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947648 00000100:00100000:0.0:1784094546.164479:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947648 00000100:00100000:0.0:1784094546.164528:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1081 00000100:00100000:0.0:1784094546.164538:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68112:x1870757013947648:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784094546.166565:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68112:x1870757013947648:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 2021us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.166824:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1081 00000100:00100000:2.0:1784094546.169902:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.170466:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947776 00000100:00100000:0.0:1784094546.170475:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947776 00000100:00100000:0.0:1784094546.170529:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1082 00000100:00100000:0.0:1784094546.170538:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+8:68093:x1870757013947776:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784094546.170554:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094546.170578:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76600/0x9ce98053214cd103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf60f3 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.170605:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76600/0x9ce98053214cd103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60f3 expref: 9 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.170617:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76600/0x9ce98053214cd103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60f3 expref: 9 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.170626:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76600, rc 0) 00000100:00100000:0.0:1784094546.170964:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+9:68093:x1870757013947776:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 425us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.170971:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1082 00000100:00100000:2.0:1784094546.176391:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.176575:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013947904 00000100:00100000:0.0:1784094546.176586:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013947904 00000100:00100000:1.0:1784094546.176958:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1083 00000100:00100000:1.0:1784094546.176969:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+9:68093:x1870757013947904:12345-192.168.204.57@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784094546.177090:0:5770:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784094546.177114:0:5770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784094546.177117:0:5770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784094546.177120:0:5770:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784094546.177122:0:5770:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784094546.179242:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+9:68093:x1870757013947904:12345-192.168.204.57@tcp:256:mount.lustre.0 Request processed in 2265us (2848us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.179256:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1083 00000100:00100000:2.0:1784094546.182964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.183205:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948032 00000100:00100000:0.0:1784094546.183214:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948032 00000100:00100000:0.0:1784094546.183270:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1084 00000100:00100000:0.0:1784094546.183279:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+9:68093:x1870757013948032:12345-192.168.204.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784094546.183295:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094546.183311:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76200/0x9ce98053214cd10a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0fefbc2daf60fa expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.183336:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76200/0x9ce98053214cd10a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60fa expref: 10 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.183356:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76200/0x9ce98053214cd10a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.57@tcp remote: 0x9f0fefbc2daf60fa expref: 10 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094546.183365:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76200, rc 0) 00000100:00100000:0.0:1784094546.184845:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68093:x1870757013948032:12345-192.168.204.57@tcp:101:mount.lustre.0 Request processed in 143us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.184861:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1084 00000100:00100000:2.0:1784094546.186650:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094546.186825:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948160 00000100:00100000:1.0:1784094546.186836:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948160 00000100:00100000:1.0:1784094546.186892:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1085 00000100:00100000:1.0:1784094546.186901:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68093:x1870757013948160:12345-192.168.204.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784094546.187856:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68093:x1870757013948160:12345-192.168.204.57@tcp:501:mount.lustre.0 Request processed in 954us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.187865:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1085 00000100:00100000:2.0:1784094546.190292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.190359:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948288 00000100:00100000:0.0:1784094546.190368:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948288 00000100:00100000:1.0:1784094546.190717:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1086 00000100:00100000:1.0:1784094546.190729:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68093:x1870757013948288:12345-192.168.204.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784094546.191054:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68093:x1870757013948288:12345-192.168.204.57@tcp:503:mount.lustre.0 Request processed in 327us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.191060:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1086 00000100:00100000:2.0:1784094546.194836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094546.195753:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948416 00000100:00100000:1.0:1784094546.195764:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948416 00000100:00100000:1.0:1784094546.195811:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1087 00000100:00100000:1.0:1784094546.195820:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68116:x1870757013948416:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784094546.198468:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907210a87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68116:x1870757013948416:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 2639us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.198481:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1087 00000100:00100000:2.0:1784094546.213653:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094546.213825:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948544 00000100:00100000:1.0:1784094546.213836:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948544 00000100:00100000:1.0:1784094546.213955:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1088 00000100:00100000:1.0:1784094546.213966:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68116:x1870757013948544:12345-192.168.204.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784094546.214796:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:68116:x1870757013948544:12345-192.168.204.57@tcp:502:llog_process_th.0 Request processed in 277us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.214807:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1088 00000100:00100000:2.0:1784094546.218055:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.218182:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948672 00000100:00100000:0.0:1784094546.218192:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948672 00000100:00100000:0.0:1784094546.218242:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1263 00000100:00100000:0.0:1784094546.218251:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1870757013948672:12345-192.168.204.57@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784094546.218282:0:5779:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 58efc4a9-b188-452c-9228-5f0a8610fc68@192.168.204.57@tcp t0 exp 0000000000000000 cur 1707 last 0 00000020:00000080:0.0:1784094546.218319:0:5779:0:(genops.c:1406:class_connect()) connect: client 58efc4a9-b188-452c-9228-5f0a8610fc68, cookie 0x9ce98053214cd111 00000004:00100000:0.0:1784094546.219010:0:5779:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784094546.219298:0:5779:0:(import.c:65:import_set_state_nolock()) ffff907102d97000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784094546.220102:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+6:2351:x1870757013948672:12345-192.168.204.57@tcp:38:mount.lustre.0 Request processed in 1845us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.220116:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1263 00000100:00100000:2.0:1784094546.224046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094546.224088:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.224234:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948800 00000100:00100000:0.0:1784094546.224245:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948800 00000100:00100000:0.0:1784094546.224322:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013948928 00000100:00100000:0.0:1784094546.224326:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013948928 00000100:00100000:0.0:1784094546.224354:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1264 00000100:00100000:0.0:1784094546.224364:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+7:0:x1870757013948800:12345-192.168.204.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784094546.224411:0:8381:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784094546.224528:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+7:0:x1870757013948800:12345-192.168.204.57@tcp:41:mount.lustre.0 Request processed in 165us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.224536:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1264 00000100:00100000:0.0:1784094546.224555:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1265 00000100:00100000:0.0:1784094546.224562:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+6:68093:x1870757013948928:12345-192.168.204.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784094546.224574:0:8381:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784094546.224598:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723e1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+6:68093:x1870757013948928:12345-192.168.204.57@tcp:41:mount.lustre.0 Request processed in 37us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.224605:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1265 00000100:00080000:1.0:1784094546.224898:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094546.226742:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094546.227042:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949056 00000100:00100000:1.0:1784094546.227051:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949056 00000100:00100000:1.0:1784094546.227106:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1266 00000100:00100000:1.0:1784094546.227117:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+6:68093:x1870757013949056:12345-192.168.204.57@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784094546.227297:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+6:68093:x1870757013949056:12345-192.168.204.57@tcp:40:mount.lustre.0 Request processed in 181us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094546.227304:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1266 00000100:00100000:0.0:1784094546.232491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094546.232542:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094546.235759:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949184 00000100:00100000:2.0:1784094546.235778:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949184 00000100:00100000:2.0:1784094546.235821:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949312 00000100:00100000:2.0:1784094546.235824:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949312 00000100:00100000:2.0:1784094546.235846:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:2.0:1784094546.235854:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870757013949184:12345-192.168.204.57@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784094546.235885:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 58efc4a9-b188-452c-9228-5f0a8610fc68@192.168.204.57@tcp t0 exp 0000000000000000 cur 1707 last 0 00000020:00000080:2.0:1784094546.235917:0:6572:0:(genops.c:1406:class_connect()) connect: client 58efc4a9-b188-452c-9228-5f0a8610fc68, cookie 0x9ce98053214cd118 00002000:00100000:2.0:1784094546.235928:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 58efc4a9-b188-452c-9228-5f0a8610fc68/ffff9071021b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784094546.235951:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784094546.236210:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784094546.236243:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9071021b6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784094546.236319:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+6:2351:x1870757013949184:12345-192.168.204.57@tcp:8:mount.lustre.0 Request processed in 463us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094546.236327:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 654 00000100:00100000:2.0:1784094546.237048:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 655 00000100:00100000:2.0:1784094546.237057:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1870757013949312:12345-192.168.204.57@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784094546.237080:0:6572:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 58efc4a9-b188-452c-9228-5f0a8610fc68@192.168.204.57@tcp t0 exp 0000000000000000 cur 1707 last 0 00000020:00000080:2.0:1784094546.237101:0:6572:0:(genops.c:1406:class_connect()) connect: client 58efc4a9-b188-452c-9228-5f0a8610fc68, cookie 0x9ce98053214cd11f 00002000:00100000:2.0:1784094546.237110:0:6572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58efc4a9-b188-452c-9228-5f0a8610fc68/ffff9071021b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784094546.237125:0:6572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784094546.237202:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00002000:00080000:2.0:1784094546.237284:0:6572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1784094546.237300:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949440 00000100:00080000:2.0:1784094546.237304:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9071021b4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784094546.237306:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949440 00000100:00100000:3.0:1784094546.237341:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 129 00000100:00100000:2.0:1784094546.237341:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+6:2351:x1870757013949312:12345-192.168.204.57@tcp:8:mount.lustre.0 Request processed in 284us (4798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094546.237347:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+6:68093:x1870757013949440:12345-192.168.204.57@tcp:33:mount.lustre.0 00000100:00100000:2.0:1784094546.237362:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 655 00000004:00200000:3.0:1784094546.237527:0:5780:0:(mdt_handler.c:914:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784094546.238545:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+6:68093:x1870757013949440:12345-192.168.204.57@tcp:33:mount.lustre.0 Request processed in 1192us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094546.238555:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 129 00010000:00010000:2.0:1784094546.480616:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094546.921748:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784094546.921772:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024433920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094546.921845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094546.921953:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024433920 00000100:00100000:0.0:1784094546.921971:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024433920 00000100:00100000:0.0:1784094546.922039:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1784094546.922049:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024433920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094546.922074:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094546.922125:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024433920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094546.922134:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00080000:3.0:1784094546.922418:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094546.922495:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024433920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784094547.497886:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094548.523233:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784094549.015785:0:7469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58efc4a9-b188-452c-9228-5f0a8610fc68 00000001:00100000:0.0:1784094549.017407:0:6598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58efc4a9-b188-452c-9228-5f0a8610fc68 00010000:00010000:0.0:1784094549.545875:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094549.997196:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024434048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094549.997268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094549.997448:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024434176:0@lo:400:kworker.0 00000100:00100000:3.0:1784094549.997482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094549.997941:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094549.997949:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024434304:0@lo:400:kworker.0 00000100:00100000:3.0:1784094549.997978:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094549.998398:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434304 00000100:00100000:0.0:1784094549.998406:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434304 00000100:00100000:0.0:1784094549.998766:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1784094549.998777:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024434304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094550.006397:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024434304:12345-0@lo:400:kworker.0 Request processed in 7611us (8406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094550.006412:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1784094550.006532:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434048 00000100:00100000:0.0:1784094550.006542:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434048 00000100:00100000:0.0:1784094550.006599:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1784094550.006609:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024434048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784094550.006651:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094550.006720:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024434048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (9451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094550.006727:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00080000:0.0:1784094550.006749:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784094550.006790:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024434048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094550.006830:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434176 00000100:00100000:0.0:1784094550.006835:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434176 00000100:00100000:0.0:1784094550.006864:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1784094550.006871:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024434176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094550.009012:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784094550.009032:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024434688:0@lo:400:kworker.0 00000100:00100000:1.0:1784094550.009107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094550.009157:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024434432:0@lo:400:kworker.0 00000100:00100000:1.0:1784094550.009184:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094550.009207:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784094550.009211:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024434560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094550.009236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094550.009263:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434688 00000100:00100000:1.0:1784094550.009271:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434688 00000100:00100000:1.0:1784094550.009327:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434432 00000100:00100000:1.0:1784094550.009330:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434432 00000100:00100000:1.0:1784094550.009355:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1784094550.009363:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024434688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094550.009666:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024434304:0@lo:400:kworker.0 00000100:00100000:2.0:1784094550.009763:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434560 00000100:00100000:2.0:1784094550.009768:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434560 00000100:00100000:2.0:1784094550.009860:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1784094550.009869:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024434560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094550.009922:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024434560:12345-0@lo:400:kworker.0 Request processed in 54us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094550.009929:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1784094550.009951:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1784094550.009958:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024434432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094550.009987:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1870757024434432:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094550.009993:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1784094550.010897:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1870757024434688:12345-0@lo:400:kworker.0 Request processed in 1531us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094550.010906:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1784094550.011647:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024434176:0@lo:400:kworker.0 00000100:00080000:1.0:1784094550.011741:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094550.011746:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094550.011777:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024434560:0@lo:400:kworker.0 00000100:00100000:1.0:1784094550.011788:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907237bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1870757024434432:0@lo:400:kworker.0 00000100:00100000:1.0:1784094550.011815:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90723d707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1870757024434688:0@lo:400:kworker.0 00000100:00100000:0.0:1784094550.012171:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024434176:12345-0@lo:400:kworker.0 Request processed in 5296us (14684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094550.012181:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000001:00100000:3.0:1784094550.536794:0:5800:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58efc4a9-b188-452c-9228-5f0a8610fc68 00010000:00010000:2.0:1784094550.569697:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094551.419082:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094551.419147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094551.419193:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094551.419228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:2.0:1784094551.419263:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949696 00000100:00100000:2.0:1784094551.419273:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949696 00000100:00100000:2.0:1784094551.419340:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1188 00000100:00100000:2.0:1784094551.419351:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013949696:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094551.419479:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949568 00000100:00100000:0.0:1784094551.419485:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949568 00000100:00100000:0.0:1784094551.419517:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1090 00000100:00100000:0.0:1784094551.419525:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2353:x1870757013949568:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094551.419553:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2353:x1870757013949568:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094551.419560:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1090 00000100:00100000:2.0:1784094551.419719:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013949696:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 366us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094551.419728:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1188 00000100:00100000:2.0:1784094551.419761:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949824 00000100:00100000:3.0:1784094551.419765:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013949952 00000100:00100000:2.0:1784094551.419767:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949824 00000100:00100000:2.0:1784094551.419804:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 898 00000100:00100000:3.0:1784094551.419809:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013949952 00000100:00100000:2.0:1784094551.419816:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013949824:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:2.0:1784094551.419854:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013949824:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 40us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094551.419862:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 898 00000100:00080000:2.0:1784094551.419880:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784094551.419885:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784094551.419889:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094551.419950:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 899 00000100:00100000:3.0:1784094551.419978:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013949952:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094551.421701:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103acdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013949952:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 1726us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094551.421718:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 899 00000001:02000400:1.0:1784094551.465640:0:111605:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25b: test nodemap info values ========= 01:49:10 (1784094550) 00010000:00010000:0.0:1784094551.593542:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094552.041722:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094552.041747:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024434816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094552.041821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094552.041958:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434816 00000100:00100000:2.0:1784094552.041980:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434816 00000100:00100000:2.0:1784094552.042072:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1784094552.042083:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024434816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784094552.042128:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094552.042192:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024434816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094552.042200:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1784094552.042277:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024434816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784094552.042327:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784094552.617845:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:0.0:1784094553.102960:0:111654:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1784094553.119349:0:111654:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:2.0:1784094553.642098:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094553.878806:0:111702:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe4e635f30 20000000:00000080:0.0:1784094553.878823:0:111702:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df0000 uarg=0000000000000000 10000000:01000000:0.0:1784094553.879418:0:111702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094553.879473:0:111702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.879502:0:111702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.879511:0:111702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.879557:0:111702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.879573:0:111702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 18 pid: 5770 timeout: 1864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094553.879589:0:111702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111702:1870757024434944:0@lo:104: 00000100:00100000:0.0:1784094553.879654:0:111702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094553.879711:0:111702:0:(client.c:2702:ptlrpc_set_wait()) set ffff907106321840 going to sleep for 11 seconds 00000100:00100000:1.0:1784094553.879853:0:5761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024434944 00000100:00100000:1.0:1784094553.879861:0:5761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024434944 00000100:00100000:1.0:1784094553.879910:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1784094553.879920:0:5761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:111702:x1870757024434944:12345-0@lo:104: 00010000:00010000:1.0:1784094553.879933:0:5761:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094553.879989:0:5761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784094553.879995:0:5761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907230c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:31e066cd-86a8-435a-b479-ca191a99cec7+3:111702:x1870757024434944:12345-0@lo:104: Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094553.880002:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:2.0:1784094553.880086:0:5767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784094553.880094:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880102:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69000 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:2.0:1784094553.880106:0:5767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880115:0:5767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784094553.880123:0:5767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094553.880130:0:5767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1784094553.880168:0:5767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880174:0:5767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784094553.880191:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880198:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69000/0x9ce98053214cd0e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd0e7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880215:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094553.880217:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094553.880219:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094553.880228:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784094553.880238:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024435072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094553.880270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094553.880323:0:111702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111702:1870757024434944:0@lo:104: 00010000:00010000:2.0:1784094553.880340:0:111702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094553.880561:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435072 00000100:00100000:0.0:1784094553.880566:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435072 00010000:00010000:0.0:1784094553.880585:0:5765:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 19 pid: 5770 timeout: 1864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094553.880614:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1784094553.880622:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+19:3302:x1870757024435072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784094553.880632:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784094553.880637:0:5765:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 19 pid: 5770 timeout: 1864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880647:0:5765:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 19 pid: 5770 timeout: 1864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880659:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723df13200/0x9ce98053214cd0e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd0e0 expref: 19 pid: 5770 timeout: 1864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880671:0:5765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880684:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880697:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880704:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880711:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880717:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880723:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094553.880727:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880734:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880748:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094553.880757:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784094553.880792:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024435072:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094553.880799:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1784094553.880826:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024435072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094553.880915:0:111702:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880923:0:111702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094553.880929:0:111702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77a00/0x9ce98053214cd126 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784094554.601508:0:111751:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcee1943f0 20000000:00000080:3.0:1784094554.601526:0:111751:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9072379a8c00 uarg=0000000000000000 10000000:01000000:3.0:1784094554.602075:0:111751:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094554.602095:0:111751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602111:0:111751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602121:0:111751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602129:0:111751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602140:0:111751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602147:0:111751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602153:0:111751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094554.602158:0:111751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602165:0:111751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602178:0:111751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602184:0:111751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094554.602190:0:111751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69e00/0x9ce98053214cd12d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094554.667628:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094555.114092:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024435328:0@lo:400:kworker.0 00000100:00100000:0.0:1784094555.114168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094555.114222:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024435840:0@lo:400:kworker.0 00000100:00100000:0.0:1784094555.114246:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094555.114275:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784094555.114280:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024435456:0@lo:400:kworker.0 00000100:00100000:1.0:1784094555.114478:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024435584:0@lo:400:kworker.0 00000100:00100000:1.0:1784094555.114510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094555.114540:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784094555.114546:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024435200:0@lo:400:kworker.0 00000100:00100000:1.0:1784094555.114573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094555.114595:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024435712:0@lo:400:kworker.0 00000100:00100000:3.0:1784094555.114669:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435840 00000100:00100000:3.0:1784094555.114677:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435840 00000100:00100000:3.0:1784094555.114737:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435584 00000100:00100000:3.0:1784094555.114740:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435584 00000100:00100000:3.0:1784094555.114761:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1784094555.114770:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094555.114818:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024435840:12345-0@lo:400:kworker.0 Request processed in 50us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094555.114826:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1784094555.114840:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1784094555.114845:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094555.114872:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024435584:12345-0@lo:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094555.114878:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1784094555.115219:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435328 00000100:00100000:3.0:1784094555.115225:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435328 00000100:00100000:3.0:1784094555.115253:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1784094555.115261:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024435328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094555.115297:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1870757024435328:12345-0@lo:400:kworker.0 Request processed in 37us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094555.115315:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1784094555.115337:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024435968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094555.115374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094555.115548:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435200 00000100:00100000:2.0:1784094555.115554:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435200 00000100:00100000:2.0:1784094555.115585:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784094555.115591:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024435200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094555.115625:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024435200:12345-0@lo:400:kworker.0 Request processed in 35us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094555.115631:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784094555.115671:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435968 00000100:00100000:2.0:1784094555.115675:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435968 00000100:00100000:2.0:1784094555.115701:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1784094555.115707:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90723d332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024435968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094555.115735:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094555.115772:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90723d332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024435968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094555.115779:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1784094555.115995:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024435968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784094555.116088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784094555.116182:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784094555.116187:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094555.116197:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435456 00000100:00100000:1.0:1784094555.116201:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435456 00000100:00100000:1.0:1784094555.116242:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1784094555.116249:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024435456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094555.116285:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024435456:12345-0@lo:400:kworker.0 Request processed in 37us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094555.116294:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1784094555.116386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094555.116435:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024435584:0@lo:400:kworker.0 00000100:00100000:1.0:1784094555.116453:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907230c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024435200:0@lo:400:kworker.0 00000100:00080000:0.0:1784094555.116615:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784094555.117452:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024435712 00000100:00100000:2.0:1784094555.117461:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024435712 00000100:00100000:2.0:1784094555.117512:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1784094555.117520:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784094555.117577:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024435712:12345-0@lo:400:kworker.0 Request processed in 58us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094555.117583:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1784094555.117623:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024435712:0@lo:400:kworker.0 00000100:00100000:2.0:1784094555.117664:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907210e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024435456:0@lo:400:kworker.0 00000100:00100000:2.0:1784094555.117677:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103aced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1870757024435328:0@lo:400:kworker.0 00000100:00100000:2.0:1784094555.117687:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024435840:0@lo:400:kworker.0 00000100:00080000:1.0:1784094555.118134:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1784094555.245180:0:111799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf107eaa0 20000000:00000080:3.0:1784094555.245198:0:111799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907202c2fc00 uarg=0000000000000000 10000000:01000000:3.0:1784094555.245418:0:111799:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094555.245461:0:111799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245478:0:111799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245489:0:111799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245496:0:111799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245504:0:111799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245512:0:111799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245520:0:111799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb68c00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094555.245525:0:111799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245533:0:111799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245548:0:111799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245556:0:111799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.245562:0:111799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd134 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094555.305881:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784094555.305888:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:1.0:1784094555.305892:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784094555.305937:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094555.305949:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094555.305960:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094555.305983:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024436096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784094555.306053:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094555.306100:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907106321180 going to sleep for 11 seconds 00000100:00100000:0.0:1784094555.306302:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436096 00000100:00100000:0.0:1784094555.306310:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436096 00000100:00100000:0.0:1784094555.306365:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1784094555.306374:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024436096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094555.306387:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094555.306400:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd13b expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.306452:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd13b expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.306915:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd13b expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.306924:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094555.306976:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024436096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 604us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094555.306983:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1784094555.307233:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024436096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094555.307252:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.307262:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094555.307289:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094555.307294:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.307303:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.690603:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094555.947836:0:111849:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeeb7232b0 20000000:00000080:0.0:1784094555.947852:0:111849:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df2000 uarg=0000000000000000 10000000:01000000:0.0:1784094555.948383:0:111849:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094555.948402:0:111849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.948555:0:111849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd13b expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.948567:0:111849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.948606:0:111849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd13b expref: 18 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.948622:0:111849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd13b expref: 18 pid: 5770 timeout: 1867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094555.948638:0:111849:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111849:1870757024436224:0@lo:104: 00000100:00100000:0.0:1784094555.948705:0:111849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094555.948808:0:111849:0:(client.c:2702:ptlrpc_set_wait()) set ffff9071019cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1784094555.948856:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436224 00000100:00100000:2.0:1784094555.948865:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436224 00000100:00100000:2.0:1784094555.948919:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784094555.948929:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:111849:x1870757024436224:12345-0@lo:104: 00010000:00010000:2.0:1784094555.948943:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949055:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094555.949062:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:111849:x1870757024436224:12345-0@lo:104: Request processed in 135us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094555.949069:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:3.0:1784094555.949117:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094555.949125:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.949133:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723df12600 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094555.949137:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.949144:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094555.949151:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094555.949157:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094555.949203:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.949211:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784094555.949256:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024436352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784094555.949289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784094555.949330:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.949343:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90723df12600/0x9ce98053214cd13b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094555.949361:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094555.949363:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094555.949364:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784094555.949635:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436352 00000100:00100000:2.0:1784094555.949641:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436352 00010000:00010000:2.0:1784094555.949662:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd13b expref: 19 pid: 5770 timeout: 1867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094555.949822:0:111849:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111849:1870757024436224:0@lo:104: 00010000:00010000:0.0:1784094555.949842:0:111849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094555.949890:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1784094555.949898:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90720b7d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3301:x1870757024436352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094555.949910:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094555.949916:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd13b expref: 19 pid: 5770 timeout: 1867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949926:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd13b expref: 19 pid: 5770 timeout: 1867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949939:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214cd142 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd13b expref: 19 pid: 5770 timeout: 1867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949952:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949960:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949975:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.949992:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.950003:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.950010:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.950016:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094555.950020:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.950028:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.950048:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094555.950058:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784094555.950097:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90720b7d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3301:x1870757024436352:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094555.950103:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00010000:00010000:0.0:1784094555.950170:0:111849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.950187:0:111849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094555.950198:0:111849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77400/0x9ce98053214cd149 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094555.952827:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:31e066cd-86a8-435a-b479-ca191a99cec7:3301:1870757024436352:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784094556.526020:0:111897:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd146bb810 20000000:00000080:0.0:1784094556.526033:0:111897:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df1c00 uarg=0000000000000000 10000000:01000000:0.0:1784094556.526192:0:111897:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094556.526215:0:111897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526230:0:111897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526241:0:111897:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526247:0:111897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526253:0:111897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526259:0:111897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526266:0:111897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de77600 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094556.526270:0:111897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526277:0:111897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526292:0:111897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526299:0:111897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094556.526304:0:111897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77600/0x9ce98053214cd150 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094556.539588:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094556.539623:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094556.539647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094556.539667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094556.539694:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950080 00000100:00100000:0.0:1784094556.539704:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950080 00000100:00100000:0.0:1784094556.539758:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1093 00000100:00100000:0.0:1784094556.539768:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2353:x1870757013950080:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094556.539841:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2353:x1870757013950080:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094556.539849:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1093 00000100:00100000:0.0:1784094556.539880:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950208 00000100:00100000:0.0:1784094556.539884:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950208 00000100:00100000:0.0:1784094556.539920:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1192 00000100:00100000:0.0:1784094556.539926:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950208:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094556.539954:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950208:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094556.539964:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1192 00000100:00080000:0.0:1784094556.540089:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094556.540222:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950336 00000100:00100000:3.0:1784094556.540227:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950336 00000100:00100000:3.0:1784094556.540273:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950464 00000100:00100000:3.0:1784094556.540277:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950464 00000100:00100000:3.0:1784094556.540299:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:3.0:1784094556.540306:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950336:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094556.540341:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950336:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 35us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094556.540349:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 902 00000100:00100000:3.0:1784094556.540363:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 903 00000100:00080000:0.0:1784094556.540367:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784094556.540369:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950464:12345-192.168.204.57@tcp:400:kworker.0 00000100:00080000:0.0:1784094556.540370:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094556.540398:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950464:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094556.540404:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 903 00010000:00010000:1.0:1784094556.715604:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094557.161642:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024436480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094557.161714:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094557.161824:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436480 00000100:00100000:0.0:1784094557.161832:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436480 00000100:00100000:0.0:1784094557.161899:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1784094557.161911:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024436480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094557.161954:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094557.162015:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024436480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094557.162023:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00080000:0.0:1784094557.162044:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094557.162384:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024436480:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784094557.214673:0:111945:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7b58c400 20000000:00000080:0.0:1784094557.214687:0:111945:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df2800 uarg=0000000000000000 10000000:01000000:0.0:1784094557.214874:0:111945:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094557.214896:0:111945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214912:0:111945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214922:0:111945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214929:0:111945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214937:0:111945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214944:0:111945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214950:0:111945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094557.214954:0:111945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214978:0:111945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214990:0:111945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.214998:0:111945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.215003:0:111945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76a00/0x9ce98053214cd157 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094557.611796:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784094557.611803:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:2.0:1784094557.611807:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784094557.611850:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094557.611861:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094557.611940:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094557.611974:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024436608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784094557.612036:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094557.612086:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff90710599f780 going to sleep for 11 seconds 00000100:00100000:0.0:1784094557.612150:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436608 00000100:00100000:0.0:1784094557.612158:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436608 00000100:00100000:0.0:1784094557.612209:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1784094557.612218:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024436608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094557.612230:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094557.612243:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd15e expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.612265:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd15e expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.612280:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd15e expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.612289:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76000, rc 0) 00000100:00100000:0.0:1784094557.612381:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024436608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094557.612388:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1784094557.614683:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024436608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094557.614711:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094557.614724:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094557.614759:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094557.614766:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094557.614774:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094557.740327:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094558.761827:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784094559.202366:0:112092:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2cae69a0 20000000:00000080:2.0:1784094559.202383:0:112092:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff90723e232800 uarg=0000000000000000 10000000:01000000:2.0:1784094559.203088:0:112092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1784094559.203109:0:112092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094559.203127:0:112092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd15e expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094559.203135:0:112092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094559.203173:0:112092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd15e expref: 18 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094559.203306:0:112092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd15e expref: 18 pid: 5772 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094559.203322:0:112092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:112092:1870757024436736:0@lo:104: 00000100:00100000:2.0:1784094559.203390:0:112092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094559.203578:0:112092:0:(client.c:2702:ptlrpc_set_wait()) set ffff907103486c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784094559.203624:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436736 00000100:00100000:0.0:1784094559.203632:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436736 00000100:00100000:0.0:1784094559.203724:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1784094559.203734:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:112092:x1870757024436736:12345-0@lo:104: 00010000:00010000:0.0:1784094559.203746:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.203814:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094559.203820:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907101287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:112092:x1870757024436736:12345-0@lo:104: Request processed in 89us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094559.203828:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1784094559.203889:0:112092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:112092:1870757024436736:0@lo:104: 00010000:00010000:2.0:1784094559.203910:0:112092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.203965:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784094559.203972:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.203980:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41200 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:3.0:1784094559.203984:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.203993:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784094559.204000:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094559.204006:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1784094559.204042:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204052:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784094559.204076:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204082:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff907101e41200/0x9ce98053214cd15e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd165 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204097:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094559.204099:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784094559.204101:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094559.204112:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024436864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784094559.204145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094559.204194:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436864 00000100:00100000:3.0:1784094559.204198:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436864 00010000:00010000:3.0:1784094559.204217:0:5763:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd15e expref: 19 pid: 5772 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094559.204239:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1784094559.204247:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+19:3303:x1870757024436864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784094559.204257:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784094559.204262:0:5763:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd15e expref: 19 pid: 5772 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204271:0:5763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd15e expref: 19 pid: 5772 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204283:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76000/0x9ce98053214cd165 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd15e expref: 19 pid: 5772 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204299:0:5763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204307:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204319:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204326:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204333:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204340:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204345:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907101e41a00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:3.0:1784094559.204349:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204357:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204368:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094559.204376:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784094559.204404:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3303:x1870757024436864:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094559.204411:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1784094559.204466:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:31e066cd-86a8-435a-b479-ca191a99cec7:3303:1870757024436864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094559.204597:0:112092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094559.204605:0:112092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094559.204612:0:112092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907101e41a00/0x9ce98053214cd16c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094559.795007:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784094559.795406:0:112143:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd192dcc80 20000000:00000080:0.0:1784094559.795705:0:112143:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df1c00 uarg=0000000000000000 10000000:01000000:0.0:1784094559.796680:0:112143:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094559.796704:0:112143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796719:0:112143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796734:0:112143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796741:0:112143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796748:0:112143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796754:0:112143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796761:0:112143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76e00 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094559.796765:0:112143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796772:0:112143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796786:0:112143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796794:0:112143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094559.796801:0:112143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76e00/0x9ce98053214cd173 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094560.233779:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784094560.233803:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907101284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094560.233976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094560.234295:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024437248:0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.234344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094560.234379:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784094560.234389:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024437120:0@lo:400:kworker.0 00000100:00100000:1.0:1784094560.234418:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437248 00000100:00100000:1.0:1784094560.234446:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437248 00000100:00100000:0.0:1784094560.234450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094560.234481:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024437632:0@lo:400:kworker.0 00000100:00100000:1.0:1784094560.234502:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1784094560.234510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094560.234513:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024437248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.234543:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437120 00000100:00100000:0.0:1784094560.234548:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437120 00000100:00100000:1.0:1784094560.234570:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1870757024437248:12345-0@lo:400:kworker.0 Request processed in 58us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094560.234581:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1784094560.234586:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1784094560.234595:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024437120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094560.234603:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437632 00000100:00100000:1.0:1784094560.234608:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437632 00000100:00100000:0.0:1784094560.234634:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:31e066cd-86a8-435a-b479-ca191a99cec7+18:3302:x1870757024437120:12345-0@lo:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094560.234642:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1784094560.234646:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1784094560.234655:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024437632:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784094560.234675:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784094560.234692:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024437504:0@lo:400:kworker.0 00000100:00100000:1.0:1784094560.234694:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1870757024437632:12345-0@lo:400:kworker.0 Request processed in 39us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094560.234705:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1784094560.234729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094560.234754:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094560.234761:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024437376:0@lo:400:kworker.0 00000100:00100000:1.0:1784094560.234762:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437504 00000100:00100000:1.0:1784094560.234768:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437504 00000100:00100000:0.0:1784094560.234787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094560.234810:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1784094560.234819:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024437504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.234821:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437376 00000100:00100000:0.0:1784094560.234826:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437376 00000100:00100000:1.0:1784094560.234862:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1870757024437504:12345-0@lo:400:kworker.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094560.234869:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1784094560.234985:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1784094560.234994:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.235029:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1870757024437376:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094560.235035:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00080000:0.0:1784094560.235050:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784094560.235054:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094560.235079:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1870757024437376:0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.235089:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1870757024437504:0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.235116:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:31e066cd-86a8-435a-b479-ca191a99cec7:3302:1870757024437120:0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.235126:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1870757024437632:0@lo:400:kworker.0 00000100:00100000:0.0:1784094560.235145:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1870757024437248:0@lo:400:kworker.0 00000100:00100000:2.0:1784094560.235337:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024436992 00000100:00100000:2.0:1784094560.235342:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024436992 00000100:00100000:2.0:1784094560.235392:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1784094560.235401:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024436992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784094560.235585:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784094560.235936:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024436992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 537us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094560.235944:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:0.0:1784094560.236302:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094560.237695:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907101284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024436992:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1784094560.304957:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094560.304964:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094560.304969:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094560.305012:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094560.305024:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094560.305036:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094560.305063:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024437760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094560.305126:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094560.305215:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784094560.307688:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437760 00000100:00100000:2.0:1784094560.307703:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437760 00000100:00100000:3.0:1784094560.309836:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1784094560.309850:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024437760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094560.309868:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784094560.309887:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd17a expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094560.309925:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd17a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094560.309936:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd17a expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094560.309947:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90720bb68c00, rc 0) 00000100:00100000:3.0:1784094560.314092:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024437760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4239us (8959us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094560.314105:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1784094560.314263:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024437760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784094560.314285:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094560.314297:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784094560.314318:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784094560.314323:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094560.314331:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094560.809532:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094561.656860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094561.657072:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950592 00000100:00100000:1.0:1784094561.657083:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950592 00000100:00100000:1.0:1784094561.657174:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1097 00000100:00100000:1.0:1784094561.657185:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2353:x1870757013950592:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094561.657260:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2353:x1870757013950592:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 77us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094561.657269:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1097 00000100:00100000:0.0:1784094561.666605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:0.0:1784094561.666657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094561.666675:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950720 00000100:00100000:0.0:1784094561.666684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094561.666685:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950720 00000100:00080000:0.0:1784094561.666722:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784094561.666751:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1196 00000100:00100000:1.0:1784094561.666762:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950720:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094561.666817:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950848 00000100:00100000:3.0:1784094561.666823:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950848 00000100:00100000:3.0:1784094561.666870:0:53396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013950976 00000100:00100000:3.0:1784094561.666885:0:53396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013950976 00000100:00100000:1.0:1784094561.666914:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950720:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 152us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094561.666921:0:53396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 905 00000100:00100000:1.0:1784094561.666929:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1196 00000100:00100000:3.0:1784094561.666935:0:53396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950848:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:1.0:1784094561.666965:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00100000:3.0:1784094561.666974:0:53396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2353:x1870757013950848:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094561.666977:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2352:x1870757013950976:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094561.666990:0:53396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 905 00000100:00100000:1.0:1784094561.667018:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2352:x1870757013950976:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094561.667025:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 906 00000100:00080000:0.0:1784094561.667059:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784094561.667063:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784094561.838378:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094562.283491:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094562.283516:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024437888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784094562.283670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094562.286366:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024437888 00000100:00100000:0.0:1784094562.286378:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024437888 00000100:00100000:0.0:1784094562.286752:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1784094562.286763:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024437888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094562.286805:0:6576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094562.286924:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1870757024437888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (3254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094562.286932:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:3.0:1784094562.288597:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1870757024437888:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784094562.288934:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1784094562.493046:0:112339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc75ddbe10 20000000:00000080:3.0:1784094562.493062:0:112339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9071019ddc00 uarg=0000000000000000 00010000:00010000:3.0:1784094562.493602:0:112339:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907102d92000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094562.493619:0:112339:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907102d92000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094562.493633:0:112339:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094562.493649:0:112339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094562.493665:0:112339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd17a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094562.493674:0:112339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094562.493712:0:112339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd17a expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094562.493725:0:112339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd17a expref: 18 pid: 5771 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094562.493738:0:112339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:112339:1870757024438016:0@lo:104: 00000100:00100000:3.0:1784094562.493800:0:112339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094562.493914:0:112339:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784094562.493973:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438016 00000100:00100000:2.0:1784094562.493981:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438016 00000100:00100000:2.0:1784094562.494037:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1784094562.494047:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:112339:x1870757024438016:12345-0@lo:104: 00010000:00010000:2.0:1784094562.494061:0:5762:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094562.494131:0:5762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784094562.494137:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:31e066cd-86a8-435a-b479-ca191a99cec7+3:112339:x1870757024438016:12345-0@lo:104: Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094562.494145:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:0.0:1784094562.494209:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784094562.494216:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094562.494228:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69e00 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:0.0:1784094562.494231:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094562.494239:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784094562.494245:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094562.494250:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784094562.494280:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094562.494287:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784094562.494305:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094562.494311:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69e00/0x9ce98053214cd17a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd181 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094562.494325:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094562.494327:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784094562.494329:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094562.494336:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784094562.494346:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9072379e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024438144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094562.494383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094562.494417:0:11171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438144 00000100:00100000:1.0:1784094562.494448:0:11171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438144 00010000:00010000:1.0:1784094562.494471:0:11171:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd17a expref: 19 pid: 5771 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094562.494501:0:11171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1784094562.494509:0:11171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024438144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784094562.494520:0:11171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784094562.494525:0:11171:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd17a expref: 19 pid: 5771 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494536:0:11171:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd17a expref: 19 pid: 5771 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494551:0:11171:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494564:0:11171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494577:0:11171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494585:0:11171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494593:0:11171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494600:0:11171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494607:0:11171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1659330) 00010000:00010000:1.0:1784094562.494612:0:11171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494620:0:11171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494630:0:11171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094562.494641:0:11171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094562.494647:0:112339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb68c00/0x9ce98053214cd181 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd17a expref: 19 pid: 5771 timeout: 1873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094562.494660:0:112339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:112339:1870757024438016:0@lo:104: 00010000:00010000:3.0:1784094562.494678:0:112339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094562.494689:0:112339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094562.494695:0:112339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094562.494703:0:11171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024438144:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (316us total) trans 0 rc 0/0 00010000:00010000:3.0:1784094562.494706:0:112339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69400/0x9ce98053214cd188 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784094562.494715:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9072379e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024438144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094562.494720:0:11171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:1.0:1784094562.857898:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784094563.886253:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094564.011211:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094564.011221:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094564.011226:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094564.011272:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094564.011285:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094564.011296:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094564.011323:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024438272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094564.011408:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094564.011486:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9072379b8240 going to sleep for 11 seconds 00000100:00100000:0.0:1784094564.012057:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438272 00000100:00100000:0.0:1784094564.012066:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438272 00000100:00100000:0.0:1784094564.012130:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1784094564.012139:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024438272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094564.012153:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094564.012168:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd18f expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094564.012192:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd18f expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094564.012204:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd18f expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094564.012212:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de77e00, rc 0) 00000100:00100000:0.0:1784094564.012270:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024438272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094564.012277:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1784094564.013145:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024438272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784094564.013168:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094564.013178:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784094564.013199:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784094564.013205:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094564.013212:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094564.907603:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784094565.253961:0:112534:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8ce0c1d0 20000000:00000080:3.0:1784094565.253980:0:112534:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907102829400 uarg=0000000000000000 00010000:00010000:3.0:1784094565.254193:0:112534:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff907102d92000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1784094565.254207:0:112534:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff907102d92000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1784094565.254222:0:112534:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1784094565.254238:0:112534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094565.254255:0:112534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd18f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094565.254262:0:112534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094565.254294:0:112534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9ce98053214cd18f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094565.254304:0:112534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9ce98053214cd18f expref: 18 pid: 5771 timeout: 1876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094565.254315:0:112534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:112534:1870757024438400:0@lo:104: 00000100:00100000:3.0:1784094565.254375:0:112534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094565.254473:0:7455:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784094565.254486:0:7455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438400 00000100:00100000:0.0:1784094565.254493:0:7455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438400 00000100:00100000:3.0:1784094565.254503:0:112534:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784094565.254536:0:7455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1784094565.254545:0:7455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907237593850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:112534:x1870757024438400:12345-0@lo:104: 00010000:00010000:0.0:1784094565.254559:0:7455:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.254625:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784094565.254632:0:7455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907237593850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:31e066cd-86a8-435a-b479-ca191a99cec7+3:112534:x1870757024438400:12345-0@lo:104: Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094565.254640:0:7455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:1.0:1784094565.254654:0:5766:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784094565.254663:0:5766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.254673:0:5766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69400 already unused, calling callback (ffffffffc1c54c20) 10000000:00010000:1.0:1784094565.254677:0:5766:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.254687:0:5766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784094565.254695:0:5766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784094565.254701:0:5766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1784094565.254743:0:112534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:112534:1870757024438400:0@lo:104: 00010000:00010000:3.0:1784094565.254760:0:112534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.254790:0:5766:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.254799:0:5766:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784094565.254843:0:5766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.254851:0:5766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.157@tcp lock: ffff90720bb69400/0x9ce98053214cd18f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9ce98053214cd196 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.254867:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094565.254869:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784094565.254870:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094565.254893:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024438528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784094565.254919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784094565.254952:0:7457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438528 00000100:00100000:2.0:1784094565.254958:0:7457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438528 00010000:00010000:2.0:1784094565.254982:0:7457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd18f expref: 19 pid: 5771 timeout: 1876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094565.255008:0:7457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1784094565.255016:0:7457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+19:3304:x1870757024438528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784094565.255028:0:7457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784094565.255033:0:7457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9ce98053214cd18f expref: 19 pid: 5771 timeout: 1876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255043:0:7457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9ce98053214cd18f expref: 19 pid: 5771 timeout: 1876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255055:0:7457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de77e00/0x9ce98053214cd196 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9ce98053214cd18f expref: 19 pid: 5771 timeout: 1876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255067:0:7457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255075:0:7457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255088:0:7457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255095:0:7457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255102:0:7457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255107:0:7457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255111:0:7457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90720bb69800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:2.0:1784094565.255115:0:7457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255126:0:7457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255146:0:7457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784094565.255156:0:7457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784094565.255168:0:112534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094565.255179:0:112534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094565.255186:0:112534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90720bb69800/0x9ce98053214cd19d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784094565.255199:0:7457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9072379e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:31e066cd-86a8-435a-b479-ca191a99cec7+18:3304:x1870757024438528:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784094565.255208:0:7457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1784094565.255277:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:31e066cd-86a8-435a-b479-ca191a99cec7:3304:1870757024438528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784094565.357456:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784094565.357480:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907226113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784094565.357553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784094565.357625:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438656 00000100:00100000:1.0:1784094565.357646:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438656 00000100:00100000:1.0:1784094565.357703:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1784094565.357714:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024438656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784094565.357750:0:6575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784094565.357797:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024438656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094565.357816:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00080000:1.0:1784094565.357840:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784094565.357877:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907226113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784094565.358215:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024438912:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.358255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094565.358278:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784094565.358284:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024439040:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.358311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094565.358343:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024439040 00000100:00100000:3.0:1784094565.358347:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024439040 00000100:00100000:3.0:1784094565.358388:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1784094565.358396:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024439040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.358460:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1870757024439040:12345-0@lo:400:kworker.0 Request processed in 66us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094565.358468:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1784094565.358491:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024439168:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.358521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094565.358541:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784094565.358547:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024438784:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.358576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094565.358604:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438912 00000100:00100000:3.0:1784094565.358608:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438912 00000100:00100000:1.0:1784094565.359159:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024439168 00000100:00100000:1.0:1784094565.359165:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024439168 00000100:00100000:1.0:1784094565.359195:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024438784 00000100:00100000:1.0:1784094565.359199:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024438784 00000100:00100000:1.0:1784094565.359222:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1784094565.359230:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024439168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094565.359274:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1870757024439168:12345-0@lo:400:kworker.0 Request processed in 45us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094565.359280:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1784094565.359292:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1784094565.359298:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024438784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784094565.359323:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1870757024438784:12345-0@lo:400:kworker.0 Request processed in 25us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094565.359328:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:1.0:1784094565.359346:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784094565.359351:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784094565.359448:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1784094565.359457:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.359493:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907103b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1870757024438912:12345-0@lo:400:kworker.0 Request processed in 38us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094565.359500:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1784094565.359538:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1870757024438784:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.359550:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1870757024439168:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.359577:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1870757024439040:0@lo:400:kworker.0 00000100:00100000:3.0:1784094565.359586:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1870757024438912:0@lo:400:kworker.0 00000020:00000080:0.0:1784094565.925310:0:112582:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc03989a0 20000000:00000080:0.0:1784094565.925328:0:112582:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff907101df1800 uarg=0000000000000000 10000000:01000000:0.0:1784094565.925819:0:112582:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1784094565.925841:0:112582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925859:0:112582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925871:0:112582:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925877:0:112582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925884:0:112582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925892:0:112582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925899:0:112582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90723de76800 already unused, calling callback (ffffffffc1659330) 00010000:00010000:0.0:1784094565.925903:0:112582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925916:0:112582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925930:0:112582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925937:0:112582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094565.925944:0:112582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90723de76800/0x9ce98053214cd1a4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 112582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784094565.931728:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784094566.314041:0:5775:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784094566.314050:0:5775:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff907225ed8000 from 1 10000000:01000000:3.0:1784094566.314056:0:5775:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784094566.314103:0:5775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094566.314115:0:5775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784094566.314140:0:5775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784094566.314513:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024439296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784094566.314584:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784094566.314745:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff907102dfe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784094566.316210:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024439296 00000100:00100000:0.0:1784094566.316223:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024439296 00000100:00100000:0.0:1784094566.316331:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1784094566.316343:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+18:5775:x1870757024439296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094566.316360:0:5772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784094566.316381:0:5772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90723de76800/0x9ce98053214cd1b2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9ce98053214cd1ab expref: -99 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094566.316412:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90723de76800/0x9ce98053214cd1b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9ce98053214cd1ab expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094566.316440:0:5772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90723de76800/0x9ce98053214cd1b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9ce98053214cd1ab expref: 19 pid: 5772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094566.316451:0:5772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90723de76800, rc 0) 00000100:00100000:0.0:1784094566.316542:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:31e066cd-86a8-435a-b479-ca191a99cec7+19:5775:x1870757024439296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094566.316554:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1784094566.320955:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:31e066cd-86a8-435a-b479-ca191a99cec7:5775:1870757024439296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784094566.320988:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd1b2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094566.321001:0:5775:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9ce98053214cd1b2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784094566.321556:0:5775:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784094566.321563:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd1b2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784094566.321572:0:5775:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.157@tcp lock: ffff90720bb68c00/0x9ce98053214cd1ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9ce98053214cd1b2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784094566.783513:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094566.783550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094566.783571:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094566.783603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.57@tcp (source: 12345-192.168.204.57@tcp) 00000100:00100000:1.0:1784094566.783631:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013951360 00000100:00100000:1.0:1784094566.783641:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013951360 00000100:00100000:1.0:1784094566.783688:0:6572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013951488 00000100:00100000:1.0:1784094566.783691:0:6572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013951488 00000100:00100000:1.0:1784094566.783711:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 656 00000100:00100000:1.0:1784094566.783720:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2351:x1870757013951360:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:1.0:1784094566.783754:0:6572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cd118 00000100:00080000:1.0:1784094566.783764:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9071021b6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784094566.783807:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1784094566.784061:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+2:2351:x1870757013951360:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 341us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094566.784069:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 656 00000100:00100000:1.0:1784094566.784083:0:6572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 657 00000100:00100000:1.0:1784094566.784089:0:6572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2351:x1870757013951488:12345-192.168.204.57@tcp:9:kworker.0 00000020:00000080:1.0:1784094566.784100:0:6572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9ce98053214cd11f 00000100:00080000:1.0:1784094566.784104:0:6572:0:(import.c:65:import_set_state_nolock()) ffff9071021b4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784094566.784121:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1784094566.784236:0:6572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58efc4a9-b188-452c-9228-5f0a8610fc68+2:2351:x1870757013951488:12345-192.168.204.57@tcp:9:kworker.0 Request processed in 146us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1784094566.784242:0:6572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 657 00000100:00080000:1.0:1784094566.784439:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784094566.784444:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784094566.784458:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784094566.784898:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013951104 00000100:00100000:0.0:1784094566.784906:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013951104 00000100:00100000:0.0:1784094566.784938:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1100 00000100:00100000:0.0:1784094566.784945:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2354:x1870757013951104:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:0.0:1784094566.784975:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907225e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7fc1cfc-8f8e-46fb-a55c-4fbde55afbff+10:2354:x1870757013951104:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 31us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094566.784981:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1100 00010000:00010000:2.0:1784094566.785166:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784094566.786197:0:8381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757013951232 00000100:00100000:3.0:1784094566.786205:0:8381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757013951232 00000100:00080000:1.0:1784094566.786316:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784094566.786466:0:8381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.57@tcp, seq: 1200 00000100:00100000:3.0:1784094566.786475:0:8381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2354:x1870757013951232:12345-192.168.204.57@tcp:400:kworker.0 00000100:00100000:3.0:1784094566.786521:0:8381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:58efc4a9-b188-452c-9228-5f0a8610fc68+5:2354:x1870757013951232:12345-192.168.204.57@tcp:400:kworker.0 Request processed in 49us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784094566.786531:0:8381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.57@tcp, seq: 1200 00010000:00010000:1.0:1784094566.953589:0:5766:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784094567.402651:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024439424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784094567.402742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784094567.403268:0:7450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870757024439424 00000100:00100000:0.0:1784094567.403277:0:7450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870757024439424 00000100:00080000:2.0:1784094567.403339:0:5773:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784094567.403395:0:7450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1784094567.403407:0:7450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024439424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784094567.403476:0:7450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784094567.403543:0:7450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907226113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1870757024439424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1784094567.403550:0:7450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1784094567.403613:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff907103b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1870757024439424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784094567.978743:0:5767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784094568.293329:0:112728:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_25b: @@@@@@ FAIL: nodemap info differs from get_param output (1) 00010000:00010000:1.0:1784094569.001581:0:11170:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 71923 lines, 71923 kept, 0 dropped, 0 bad.